You are in:  Design | Embedded Systems

Sign-up for newsletters:

Electronics Weekly newsletters - Sign up for Made By Monkeys, Mannerisms, Gadget Master and Daily and Monthly newsletters

Read The Magazine

Latest Issue: 8 - 14 Feb, 2012
Get Electronics Weekly

Game theory teaches robots how to deceive

Steve Bush
Friday 10 September 2010 10:58
This robot has been taught to deceive by laying a false trail then hiding

Scientists at Georgia Institute of Technology have taught a robot how to hide by deception.

"We have developed algorithms that allow a robot to determine whether it should deceive a human or other intelligent machine and we have designed techniques that help the robot select the best deceptive strategy to reduce its chance of being discovered," said Professor Ronald Arkin.

The first step was to teach the deceiving robot how to recognise a situation that warranted the use of deception.

Arkin and colleague Dr Alan Wagner used interdependence theory and game theory to develop algorithms that tested the value of deception in a specific situation.

A situation had to satisfy two key conditions to warrant deception - there must be conflict between the deceiving robot and the seeker, and the deceiver must benefit from the deception.

Once a situation was deemed to warrant deception, the robot carried out a deceptive act by providing a false communication to benefit itself.

The technique developed by the Georgia Tech researchers based a robot's deceptive action selection on its understanding of the individual robot it was attempting to deceive.

To test their algorithms, the researchers ran 20 hide-and-seek experiments with two autonomous robots.

Coloured markers were lined up along three potential pathways to locations where the robot could hide.

The hider robot randomly selected a hiding location from the three location choices and moved toward that location, knocking down coloured markers along the way.

Once it reached a point past the markers, the robot changed course and hid in one of the other two locations.

The presence or absence of standing markers indicated the hider's location to the seeker robot.

"The hider's set of false communications was defined by selecting a pattern of knocked over markers that indicated a false hiding position in an attempt to say, for example, that it was going to the right and then actually go to the left," explained Wagner.

The hider robots were able to deceive the seeker robots in 75 percent of the trials, with the failed experiments resulting from the hiding robot's inability to knock over the correct markers to produce the desired deceptive communication.

"The experimental results weren't perfect, but they demonstrated the learning and use of deception signals by real robots in a noisy environment," said Wagner. "The results were also a preliminary indication that the techniques and algorithms could be used to successfully produce deceptive behaviour in a robot."

Are there ethical issues in teaching robots to lie?

"We have been concerned from the very beginning with the ethical implications related to the creation of robots capable of deception and we understand that there are beneficial and deleterious aspects," explained Arkin. "We strongly encourage discussion about the appropriateness of deceptive robots to determine what, if any, regulations or guidelines should constrain the development of these systems."

The work was funded by the US Office of Naval Research.

 

Comments powered by Disqus

Share the content

Most Viewed

Products

Related Jobs

Resources