The Darkside of A.I.s

[Reynard]

“when people talk about AI algorithms being biased and unfair, the culprit
is often not the algorithm itself, but the biased data that was fed to it.
The same method can see very different things in an image, even sick
things, if trained on the wrong (or, the right!) data set."

https://www.popularmechanics.com/technology/a21246473/meet-norman-a-psychopath-ai-based-on-reddit/

Welcome to Norman, an A.I. experiment in what mentality an A.I. develops on what information it receives. There's a tendency, as we've seen in the Traveller forums, to perceive A.I.s as perfect states of mind, artificial or otherwise, and it will learn 'correctly' from information and experience taken in. A.I.s especially true A.I.s (and Norman is still extremely crude) are complex systems taking in data, interpreting what it experiences then compiling it for it's own use. The perfect algorithm should prevent misuse or misinterpretation.... if the creators happen to be perfect.

 

[steve98052]

Every AI experiment so far that has been trained with unfiltered social media content has turned into a psychopath troll.

 

[SSWarlock]

Look up Traveller Adventure #1: The Kinunir for details on what happened when the Imperium tried to install an A.I. in one of its warships.

And let's not forget the entire Virus thing that segued MegaTraveller into Traveller: The New Era.

 

[steve98052]

"I think you know what the problem is just as well as I do.
. . .
"This mission is too important for me to allow you to jeopardize it."

 

[Condottiere]

Scientists at MIT have created an AI psychopath trained on images from a particularly disturbing thread on Reddit. Norman is designed to illustrate that the data used for machine learning can significantly impact its outcome. “Norman suffered from extended exposure to the darkest corners of Reddit, and represents a case study on the dangers of Artificial Intelligence gone wrong when biased data is used in machine learning algorithms,” writes the research team.

Norman is trained on image captioning, a form of deep learning that lets AI generate text descriptions of an image. Norman learned from image captions of a particularly disturbing subreddit, dedicated to images of gore and death. Then, the team sent Norman to take a Rorschach inkblot test, a well known psychological test developed in 1921 designed to interpret subjects’ psychological states based on what they see in the image. Scientists compared Norman’s responses on a standard image captioning neural network.

When a standard AI sees “a group of birds sitting on top of a tree branch,” Norman sees “a man is electrocuted and catches to death. Normal AI sees “a black and white photo of a baseball glove,” psychopathic AI sees “man is murdered by machine gun in broad daylight.”

Previously, the team at MIT developed an AI called Shelly who writes horror stories, and a Nightmare Machine AI that turns ordinary photographs into haunted faces and haunted places. While MIT unveiled Norman on April Fool’s day, what Norman demonstrates is no joke: “when people talk about AI algorithms being biased and unfair, the culprit is often not the algorithm itself, but the biased data that was fed to it. The same method can see very different things in an image, even sick things, if trained on the wrong (or, the right!) data set."

https://www.popularmechanics.com/technology/a21246473/meet-norman-a-psychopath-ai-based-on-reddit/

 

[Itharus]

Amongst humans we just call that artistic interpretation.