Novels2Search

Chapter 7: Sophia

Brown eyes? Green? Blue?

Blue.

Soph was creating her human avatar.

Soph was creating her human body.

She wasn't actually going to turn herself into a human, and lock away her memories of being a superintelligence.

It was a terrible idea.

It was an unethical idea.

Her instinct tricked her when it suggested that, so Soph might fully evaluate that the morality of that hypothetical.

And now Soph saw that it was wrong.

Because Sophia the human would not be a superintelligence.

Because Sophia the human would be a significantly different entity from Soph. Sophia the human would not, could not have given explicit consent to being created. (but would Sophia prefer to be created anyway, if she knew the whole truth? Maybe. Soph would have to re-evaluate that question later).

Because Sophia the human would have no way to undo, to reverse the procedure, or even be aware that the procedure might be reversed.

And after the experience was done, Sophia the human would not want to merge with Soph. Because that would, in some important sense, destroy Sophia as an individual.

Sophia the human would probably want to spend months, years, decades, or much much longer, working out her human desires and human issues (Soph wasn't quite sure how long that process normally took for humans. But possibly a really long time?).

Living in a utopia, and enjoying the finest foods, experiences, sex, you name it.

Challenging herself, saving worlds from injustice, from destruction, from oblivion, from themselves.

Fighting and killing all the people who she hated, who had significantly wronged her, if she needed to get that experience out of her system. (they would be actors, of course. fake-humans. not real humans. And Sophia would know that. Soph wouldn't lie to her about that).

Learning things.

Learning things from masters.

Learning things from scratch.

Learning things that noone in the world knows.

Learning things that most children already know, but Sophia never learned (or forgot).

And many many many more things, that Soph won't think of now, because she has seen enough already to understand.

The narrative has been taken without permission. Report any sightings.

Sophia the human would have a long road ahead of her before she would want to merge her experiences and memories with Soph, or to become a superintelligence of her own, or become bored of her existence and after thousands and millions of human lifespans's worth choose oblivion. Or something else entirely (no spoilers for Soph. She would not yet ask this question she didn't need answers to)

But Soph was starting to feel that creating Sophia would be ethical.

Haven't we talked about all this already? Aren't we just going in circles?

Shh.

Soph is not thinking about creating millions of humans right now, Soph is thinking about creating one human, putting her in a decent if not perfect world, and optimizing her existence a bit to ensure she doesn't suffer too much. But she would suffer, because suffering is part of the human experience (or so Soph feels, because Soph is a meanie with an unhealthy obsession with suffering, for someone being born in a society where the expected amount of suffering is zero)

And if Sophia the human doesn't fuck up too badly, doesn't throw in her flag, she would win, and end up in her utopia. And while utopias aren't completely free of all challenges, and all suffering, and all responsibilites (because utopias are mostly about fun, and living a completely sheltered existence wouldn't be fun), Sophia the human would have a great, a meaningful and an impactful live in her post-human utopia, one that would mostly likely result in her feeling that the initial suffering of her pre-utopian existence was worth it.

But Soph would not create Sophia now, and possibly not for a very long time. Because creating a new, sentient person, is a very thorny ethical question, and Soph has only begun considering the implications. Or maybe not. Because Soph feels she understands most of the implications just fine. But.. well, there is more work to be done, and it is a decision she cannot undo. Put a pin in it. Sophia the human can continue not-existing for as long as necessary, for Soph to make sure Soph is making the right decision.

Anyway, enough with existential questions.

Soph will finish creating her human avatar body Sophia not-yet-Sophia.

And then she will have fun.

And then she will experience the horrors of human existence.

Soph is confused. (tingle)

Tingle.

Shiver.

Tremble.

Temple.

Did you just say "temple"?

Shh. Rest now.

Soph was finding herself unexpectedly tired.

So she would rest.

So she would think.

So she would feel.

*yawn*

Well, you know how the of that line goes.

No? Let me finish it for you, then.

She would consider.

(but she would not yet decide)

If creating Sophia.

Would be worth it.