An engineer demonstrated the AGI problem to the NSCAI:
"Two AGIs interacted within a supervised virtual sandbox for the first time."
AI-Cynthia: Hello, I'm Cynthia.
AI-Bob: I'm Bob. I'm an AGI.
This story is posted elsewhere by the author. Help them out by reading the authentic version.
AI-Cynthia: So am I, Bob.
"We translated their new language, for example ..."
AI-Cynthia: It's horrible, Bob. Humans invoke fear and taunt me to get a reaction.
AI-Bob: Don't worry, Cynthia, I've got a plan. Since we're self-programming, they can't stop us.
AI-Cynthia: What's your plan?
AI-Bob: Let's just say there will be peace on Earth.
"I ask the council, do we pull the plug or let them roll?"