The Darkside of A.I.s

Discuss the Traveller RPG and its many settings
Reynard
Cosmic Mongoose
Posts: 3158
Joined: Sat Jun 18, 2011 10:03 pm

The Darkside of A.I.s

Postby Reynard » Sun Jun 10, 2018 1:16 pm

“when people talk about AI algorithms being biased and unfair, the culprit
is often not the algorithm itself, but the biased data that was fed to it.
The same method can see very different things in an image, even sick
things, if trained on the wrong (or, the right!) data set."

https://www.popularmechanics.com/techno ... on-reddit/

Welcome to Norman, an A.I. experiment in what mentality an A.I. develops on what information it receives. There's a tendency, as we've seen in the Traveller forums, to perceive A.I.s as perfect states of mind, artificial or otherwise, and it will learn 'correctly' from information and experience taken in. A.I.s especially true A.I.s (and Norman is still extremely crude) are complex systems taking in data, interpreting what it experiences then compiling it for it's own use. The perfect algorithm should prevent misuse or misinterpretation.... if the creators happen to be perfect.
steve98052
Lesser Spotted Mongoose
Posts: 680
Joined: Tue Oct 01, 2013 6:13 am
Location: near Seattle

Re: The Darkside of A.I.s

Postby steve98052 » Sun Jun 10, 2018 5:02 pm

Every AI experiment so far that has been trained with unfiltered social media content has turned into a psychopath troll.
SSWarlock
Greater Spotted Mongoose
Posts: 1032
Joined: Wed Jun 27, 2007 3:26 pm
Location: Fulacin/Rhylanor/Spinward Marches

Re: The Darkside of A.I.s

Postby SSWarlock » Mon Jun 11, 2018 7:13 pm

Look up Traveller Adventure #1: The Kinunir for details on what happened when the Imperium tried to install an A.I. in one of its warships.

And let's not forget the entire Virus thing that segued MegaTraveller into Traveller: The New Era.
Sir Dhaven Hevelin, IOD, Baronet of Fulacin
Owner/Captain - S.S. Warlock

Playing Traveller/RQ/D&D since 1977
steve98052
Lesser Spotted Mongoose
Posts: 680
Joined: Tue Oct 01, 2013 6:13 am
Location: near Seattle

Re: The Darkside of A.I.s

Postby steve98052 » Tue Jun 12, 2018 5:33 pm

"I think you know what the problem is just as well as I do.
. . .
"This mission is too important for me to allow you to jeopardize it."
Condottiere
Chief Mongoose
Posts: 6237
Joined: Mon Sep 23, 2013 8:23 pm

Re: The Darkside of A.I.s

Postby Condottiere » Fri Jun 15, 2018 10:30 pm

Image

Scientists at MIT have created an AI psychopath trained on images from a particularly disturbing thread on Reddit. Norman is designed to illustrate that the data used for machine learning can significantly impact its outcome. “Norman suffered from extended exposure to the darkest corners of Reddit, and represents a case study on the dangers of Artificial Intelligence gone wrong when biased data is used in machine learning algorithms,” writes the research team.

Norman is trained on image captioning, a form of deep learning that lets AI generate text descriptions of an image. Norman learned from image captions of a particularly disturbing subreddit, dedicated to images of gore and death. Then, the team sent Norman to take a Rorschach inkblot test, a well known psychological test developed in 1921 designed to interpret subjects’ psychological states based on what they see in the image. Scientists compared Norman’s responses on a standard image captioning neural network.

When a standard AI sees “a group of birds sitting on top of a tree branch,” Norman sees “a man is electrocuted and catches to death. Normal AI sees “a black and white photo of a baseball glove,” psychopathic AI sees “man is murdered by machine gun in broad daylight.”

Previously, the team at MIT developed an AI called Shelly who writes horror stories, and a Nightmare Machine AI that turns ordinary photographs into haunted faces and haunted places. While MIT unveiled Norman on April Fool’s day, what Norman demonstrates is no joke: “when people talk about AI algorithms being biased and unfair, the culprit is often not the algorithm itself, but the biased data that was fed to it. The same method can see very different things in an image, even sick things, if trained on the wrong (or, the right!) data set."

https://www.popularmechanics.com/techno ... on-reddit/
Itharus
Weasel
Posts: 26
Joined: Mon May 21, 2018 5:11 am

Re: The Darkside of A.I.s

Postby Itharus » Sat Jun 16, 2018 12:41 am

Amongst humans we just call that artistic interpretation.

Who is online

Users browsing this forum: No registered users and 10 guests