Страница 34 из 40
“I would have to know how it would make their lives better. “
“We’re talking hypothetically,” Janet said. “Just assume it does.”
Do you have any idea what the underlying intent is here?Lucius asked via comlink. Perhaps it was cheating, but no one had forbidden him to consult the other robots. A pity Basalom was not on line; his experiences with Janet might provide a clue to the proper answer.
Neither Adam nor Eve answered, but Mandelbrot did. Yesterday I overheard Ariel and Wolruf discussing the possible effect of a robot city on Wolruf ’ s world. Wolruf was concerned that the use of robots would strip her people of the ability to think and act for themselves. Perhaps this question grew out of that concern.
I think there is more to it than that,Lucius sent. Central, can you replay the conversation that led up to this question?
The robots received the recorded conversation within milliseconds, but it took them considerably longer to sort it all out. At last Lucius said, I believe it is clear now. They are concerned about the moral implications of unwilling sacrifice.
Agreed,the others all said.
Do we have any precedent to go upon?
Possibly,Eve said. There could have been i
That doesn ’ t quite fit the question we are asked to consider,said Adam. A better analogy might be to ask what if the ship had been crewed only by i
I
Mandelbrot said, Aranimas could easily have launched a drone with hostages on board.
Then the hostages would have to be sacrificed,Lucius said immediately. They would be no more i
Agreed,the other robots said.
Perhaps I begin to see the moral dilemma here,Lucius said. What if the people on the ground were somewhat less i
How so?Eve asked.
Suppose they in some way deliberately attracted Aranimas, knowing that he was dangerous?
That would be foolish.
Humans often do foolish things. Suppose they did. Would they then deserve their fate?
This is a value judgment,Adam said.
We have been called upon to make one,Lucius replied.
Unfortunately so. Using your logic, then, we would have to conclude that the concept of individual value requires that humans be held responsible for their actions. The inhabitants of the city would therefore be responsible for their own act and thus deserve their fate. If the hostage were truly i
I agree,said Lucius. Eve? Mandelbrot?
I agree also,Eve said.
I wish we had never been asked this question,Mandelbrot sent. I reluctantly agree in this specific case, but I still don ’ t believe it answers Ariel ’ s question. What if the death of the i
No,Lucius said. Colds are only an inconvenience except in extremely rare cases.
A worse disease. then. One that cripples but does not kill.
How crippling? How widespread would the effects be? Would food production suffer and thus starve people later? Would the survivors die prematurely of complications brought about by bitterness at their loss? We must know these things as well in order to make a decision.
Then we must give a qualified answer,said Mandelbrot.
Yes. Wish me luck,Lucius said.
Perhaps two seconds had passed while the dialog went on. Aloud, Lucius said to Ariel, “We have considered three specific cases. In the case of a city in mortal peril, if the person in question were not completely i
Perhaps the hostage should be consulted in such a case,Eve sent.
“Indeed. Perhaps the hostage should be consulted in such a case.”
“But not the townspeople?” Ariel asked.
Lucius used the comlink again. Comment?
If time allowed polling the populace, then it would allow removing them from the danger,Mandelbrot pointed out.
Good point.“Probably not,” Lucius said. “It would of course depend upon the individual circumstances.”
Ariel did not look pleased. Lucius was sure she would now order him dismantled, killed to protect the hypothetical inhabitants of her hypothetical city from his improper judgment. He waited for the blast, but when she spoke it wasn’t at all what he expected.
“Frost, maybe it wasn’t a fair question at that. I don’t know what I ’ d do in that last case. “
“You don’t?”
“No.”
“Then there is no correct answer?”
“I don’t know. Maybe not.”
Janet was smiling. “We were more worried about a wrong answer anyway. “
“I see.”
Wolruf cleared her throat in a loud, gargling growl. “One last ‘ypothetical question,” she said. “W’at if the particular ‘umans in this city didn’t care about the death of an individual. Say it didn’t matter even to the individual. W’at if it wasn’t part of their moral code? Would you enforce yours on them?”
Lucius suddenly knew the exact meaning of the cliche, “Out of the frying pan into the fire.” Help! he sent over the comlink.
The correct answer is “No,”Mandelbrot sent without hesitation.
You are sure?
Absolutely. Thousands of years of missionary work on Earth and another mille
How do you know this?
I read over Ariel ’ s shoulder.
Janet heard both Ariel and Wolruf sigh in relief when Lucius said the single word, “No.”
She laughed, relieved herself. “You’re very certain of that,” she said.
“Mandelbrot is certain,” Lucius said. “I trust his judgment.”
Mandelbrot. That name. She could hardly believe it, but it had to be
“I think I trust his judgment, too.” Janet turned to Ariel. “What about you, dear? Satisfied?”
Ariel was slow to answer, but when she did it was a nod. “For now,” she said. “I don’t know if having a learning machine for a mayor will solve everything, but it might solve some of it.”