Marshall Honorof
TechNewsDaily
Fri, 17 May 2013 14:52 CDT

© Shutterstock
Complex robots are like animals: They learn by doing. Future robots may even respond to reward systems: complete a task with aplomb, and a gain a "feeling" of satisfaction for a job well done.
While this technology could create more efficient, goal-oriented
robots, it could also have some very dire ramifications for humanity. After all, robots that feel rewarded by making humans happy may eventually decide that if no humans exist, no human will ever be unhappy again.
"Robots without preferences can't have complicated behaviors," Roman V. Yampolskiy, director of the Cybersecurity Research Lab at the University of Louisville, told TechNewsDaily. "To make machines which are independent and creative, we need to give them rewards and preferences."
While Yampolskiy believes that robots can be indispensible tools, he also warns that as they learn to seek rewards, they may learn to circumvent helping humans. "I am trying to make sure that any AI software we develop is safe to use and beneficial to humanity," he said.
Yampolskiy asserts that robots with the capacity for feelings of pleasure would, in all likelihood, take all the same shortcuts that humans use to acquire it. In a recent paper, he described the process of "wireheading," which sent an electric jolt through the pleasure center of a
rat's brain. "The rat's self-stimulation behavior completely displaced all interest in sex, sleep, food and water, ultimately leading to premature death," Yampolskiy wrote.