Turing Test Pass Claimed at Royal Society Event

[petskup]

In a press release by the University of Reading it is claimed the Turing test was passed.
http://robotenomics.com/2014/06/08/turing-test-pass-claimed-at-university-of-reading-event

[1714154762]

1714154762

[1714154762]

1714154762

[1714154762]

1714154762

[1714154762]

1714154762

[Justine]

So, how does it benefit us?

[Este Nuno]

So, how does it benefit us?

We will have programs who can act as believable human customer support representatives at some point. Also I'm sure there will be AI that people become friendly with in some way. Personal assistants will become much better than they are now(Siri ect).

[DolanDuck]

If a computer is mistaken for a human more than 30% of the time during a series of five minute keyboard conversations it passes the test. No computer has ever achieved this, until now. Eugene managed to convince 33% of the human judges that it was human.

[platorin]

And what if Internet is intelligent and has gain consciousness, but does not manifest it to us? ;]

[Este Nuno]

And what if Internet is intelligent and has gain consciousness, but does not manifest it to us? ;]

What if Satoshi Nakamoto is the internet itself...

[Bitcoin Magazine]

No it means that Allah the merciful is not satan but life itself 

[petskup]

Trailer to University of Reading Turing test event, The Royal Society, 7 June 2014.
https://www.youtube.com/watch?v=0Hgw9RVwbaw

You can test Eugene Goostman yourself (if you can get through the congestion).
http://www.princetonai.com/bot/bot.jsp

[b!z]

The Turing Test should be performed with judges experienced in computer science, artificial intelligence etc, not any random people

[phosphorush]

Don't you guys think that simulating a 13 year old is a way to hide the flaws (but yeah it's an improvement)? Also, we could go philosophical and question the validity of the turing test, it seems a pragmatic yet insuficient way to determine if the AI is intelligent...

[platorin]

And what if Internet is intelligent and has gain consciousness, but does not manifest it to us? ;]

What if Satoshi Nakamoto is the internet itself...

Could be. Everything is possible.

[phosphorush]

I'm writing a sci-fiction story and I thought about making an AI grow out of some sort of blockchain, because like DNA there is an equal copy of all the data in every computer... Good idea? Any tips?

[Ron~Popeil]

Maybe Dank is a computer.

[petskup]

AI vs. AI. Two chatbots talking to each other
http://www.youtube.com/watch?v=WnzlbyTZsQY

[DrG]

Just don't ask it to control nuclear weapons when owned by a company called Skynet.

[WoopDeBoop]

It didn't pass the turing test.

They were told that some participants didn't speak English as a first language, that some were young and they were given a 5 minute time limit to decide who was a machine.

The turing test doesn't mention any of the above. It should fool 50% of people that it is a real person, not fool 30% of people in a 5 minute time window that it might be a kid who speaks poor English

[cinder]

They lower the expectation and claim the test is pass.


You could lower your kid's score to below average and claim they pass your test also.

[medUSA]

Trailer to University of Reading Turing test event, The Royal Society, 7 June 2014.
https://www.youtube.com/watch?v=0Hgw9RVwbaw

This is just a trailer and the demo site is down.
I was searching the net for more info...
http://www.reading.ac.uk/news-and-events/releases/PR583836.aspx

Apparently, only 10 judges out of 30 thought the software was a foreign teenager. I could not find any transcript of the conversations, but this guy found a transcript of the questions and answers for the 2012 test:
http://www.slate.com/articles/technology/bitwise/2014/06/turing_test_reading_university_did_eugene_goostman_finally_make_the_grade.html

Assuming the answers are not that much better in 2014, I think AI conversation is still in its infancy.

[petskup]

What does Passing The Turing Test mean? Indicators of Progress in AI with Robin Hanson!(1:11hrs)
Robin Dale Hanson (born August 28, 1959) is an associate professor of economics at George Mason University and a research associate at the Future of Humanity Institute of Oxford University. He is known as an expert on idea futures, markets and was involved in the creation of the Foresight Exchange and DARPA’s FutureMAP project. He invented market scoring rules like LMSR (Logarithmic Market Scoring Rule) used by prediction markets such as Consensus Point (where Hanson is Chief Scientist), and has conducted research on signaling.
http://www.youtube.com/watch?v=8kzJSDFZAz4

[u9y42]

The Turing Test should be performed with judges experienced in computer science, artificial intelligence etc, not any random people

That would defeat the point of the test, though the test itself is only somewhat relevant to the whole concept of AI (and badly needs updating).

If a computer is mistaken for a human more than 30% of the time during a series of five minute keyboard conversations it passes the test. No computer has ever achieved this, until now. Eugene managed to convince 33% of the human judges that it was human.

That's not true; this wasn't the first time a computer program was able to fool at least 30% of the people it talked with. For reference: http://www.newscientist.com/article/dn25692-no-skynet-turing-test-success-isnt-all-it-seems.html?full=true

A couple of quotes from the newscientist article:

But as early as 1991, a bot called PC Therapist created by Joseph Weintraub took part in a Turing test and fooled 5 out of 10 judges into thinking it was human – a pass rate of 50 per cent. Meanwhile, much more recently, in 2011, Rollo Carpenter's Cleverbot chatted with 30 humans in front of a live audience of over 1000 and fooled 59.3 per cent of the judges and audience into thinking it was human.

"The purpose of this June's Royal Society experiment is not to find if a machine can now pass one interpretation of Turing test success, 30 per cent, especially as a machine surpassed this with a deception rate of 50 per cent back in 1991 and machines do not have anywhere near the conversational skills of HAL from 2001: A Space Odyssey."

Rather, the organisers wanted to "encourage/inspire children to take up computing and robotics, is also about awareness and prevention of cybercrime".