Computer Beats Jeopardy Champs

The friendliest place on the web for anyone that follows U2.
If you have answers, please help by responding to the unanswered posts.

MrsSpringsteen

Blue Crack Addict
Joined
Nov 30, 2002
Messages
29,283
Location
Edge's beanie closet
I saw the second night-Watson got the final question wrong.

(AP) 2/16/11

Machines first out-calculated us in simple math. Then they replaced us on the assembly lines, explored places we couldn't get to, even beat our champions at chess. Now a computer called Watson has bested our best at "Jeopardy!"

A gigantic computer created by IBM specifically to excel at answers-and-questions left two champs of the TV game show in its silicon dust after a three-day tournament, a feat that experts call a technological breakthrough.

Watson earned $77,147, versus $24,000 for Ken Jennings and $21,600 for Brad Rutter. Jennings took it in stride writing "I for one welcome our new computer overlords" alongside his correct Final Jeopardy answer.

The next step for the IBM machine and its programmers: taking its mastery of the arcane and applying it to help doctors plow through blizzards of medical information. Watson could also help make Internet searches far more like a conversation than the hit-or-miss things they are now.

Watson's victory leads to the question: What can we measly humans do that amazing machines cannot do or will never do?

The answer, like all of "Jeopardy!," comes in the form of a question: Who – not what – dreamed up Watson? While computers can calculate and construct, they cannot decide to create. So far, only humans can.

"The way to think about this is: Can Watson decide to create Watson?" said Pradeep Khosla, dean of engineering at Carnegie Mellon University in Pittsburgh. "We are far from there. Our ability to create is what allows us to discover and create new knowledge and technology."

Experts in the field say it is more than the spark of creation that separates man from his mechanical spawn. It is the pride creators can take, the empathy we can all have with the winners and losers, and that magical mix of adrenaline, fear and ability that kicks in when our backs are against the wall and we are in survival mode.

What humans have that Watson, IBM's earlier chess champion Deep Blue, and all their electronic predecessors and software successors do not have and will not get is the sort of thing that makes song, romance, smiles, sadness and all that jazz. It's something the experts in computers, robotics and artificial intelligence know very well because they can't figure out how it works in people, much less duplicate it. It's that indescribable essence of humanity.


Nevertheless, Watson, which took 25 IBM scientists four years to create, is more than just a trivia whiz, some experts say.

Richard Doherty, a computer industry expert and research director at the Envisioneering Group in Seaford, N.Y., said he has been studying artificial intelligence for decades. He thinks IBM's advances with Watson are changing the way people think about artificial intelligence and how a computer can be programmed to give conversational answers – not merely lists of sometimes not-germane entries.

"This is the most significant breakthrough of this century," he said. "I know the phones are ringing off the hook with interest in Watson systems. The Internet may trump Watson, but for this century, it's the most significant advance in computing."

And yet Watson's creators say this breakthrough gives them an extra appreciation for the magnificent machines we call people.

"I see human intelligence consuming machine intelligence, not the other way around," David Ferrucci, IBM's lead researcher on Watson, said in an interview Wednesday. "Humans are a different sort of intelligence. Our intelligence is so interconnected. The brain is so incredibly interconnected with itself, so interconnected with all the cells in our body, and has co-evolved with language and society and everything around it."

"Humans are learning machines that live and experience the world and take in an enormous amount of information – what they see, what they taste, what they feel, and they're taking that in from the day they're born until the day they die," he said. "And they're learning from all the input all the time. We've never even created something that attempts to do that."

The ability of a machine to learn is the essence of the field of artificial intelligence. And there have been great advances in the field, but nothing near human thinking.

"I've been in this field for 25 years and no matter what advances we make, it's not like we feel we're getting to the finish line," said Carnegie Mellon University professor Eric Nyberg, who has worked on Watson with its IBM creators since 2007. "There's always more you can do to bring computers to human intelligence. I'm not sure we'll ever really get there."

Bart Massey, a professor of computer science at Portland State University, quipped: "If you want to build something that thinks like a human, we have a great way to do that. It only takes like nine months and it's really fun."

Working on computer evolution "really makes you appreciate the fact that humans are such unique things and they think such unique ways," Massey said.

Nyberg said it is silly to think that Watson will lead to an end or a lessening of humanity. "Watson does just one task: answer questions," he said. And it gets things wrong, such as saying grasshoppers eat kosher, which Nyberg said is why humans won't turn over launch codes to it or its computer cousins.

Take Tuesday's Final Jeopardy, which Watson flubbed and its human competitors handled with ease. The category was U.S. cities, and the clue was: "Its largest airport is named for a World War II hero; its second largest, for a World War II battle."

The correct response was Chicago, but Watson weirdly wrote, "What is Toronto?????"

A human would have considered Toronto and discarded it because it is a Canadian city, not a U.S. one, but that's not the type of comparative knowledge Watson has, Nyberg said.

"A human working with Watson can get a better answer," said James Hendler, a professor of computer and cognitive science at Rensselaer Polytechnic Institute. "Using what humans are good at and what Watson is good at, together we can build systems that solve problems that neither of us can solve alone."

That's why Paul Saffo, a longtime Silicon Valley forecaster, and others, see better search engines as the ultimate benefit from the "Jeopardy!"-playing machine.

"We are headed toward a world where you are going to have a conversation with a machine," Saffo said. "Within five to10 years, we'll look back and roll our eyes at the idea that search queries were a string of answers and not conversations."

The beneficiaries, IBM's Ferrucci said, could include technical support centers, hospitals, hedge funds or other businesses that need to make lots of decisions that rely on lots of data.

For example, a medical center might use the software to better diagnose disease. Since a patient's symptoms can generate many possibilities, the advantage of a Watson-type program would be its ability to scan the medical literature faster than a human could and suggest the most likely result. A human, of course, would then have to investigate the computer's finding and make the final diagnosis.

IBM isn't saying how much money it spent building Watson. But Doherty said the company told analysts at a recent meeting that the figure was around $30 million. Doherty believes the number is probably higher, in the "high dozens of millions."

In a few years, Carnegie Mellon University robotic whiz Red Whittaker will be launching a robot to the moon as part of Google challenge. When it lands, the robot will make all sorts of key and crucial real-time decisions – like Neil Armstrong and Buzz Aldrin did 42 years ago – but what humans can do that machines can't will already have been done: Create the whole darn thing.
 
Watson is impressive, yet it seems obvious that a computer would win in a trivia contest since trivia is just a memorization of facts. The responding time and recognition is very impressive though.
 
I hadn't seen the second game yet, but I figured that was how it was going to end, since Watson cleaned house in the first game (despite getting the final jeopardy question wrong. Though I think it knew it wasn't sure, because it barely wagered any money).

TIME magazine has a slightly different take on AI then what is suggested in the article Mrs. S posted:

Singularity: Kurzweil on 2045, When Humans, Machines Merge - TIME

I think one of the reasons Watson beat the human competitors is because it didn't have to be slowed down by emotion, other competing thoughts, and various physiological factors. All it had to do was deal with questions and answers with no other distractions of any kind.
 
Watson is impressive, yet it seems obvious that a computer would win in a trivia contest since trivia is just a memorization of facts. The responding time and recognition is very impressive though.

This. Which is why I didn't bother watching and thought the whole thing was kind of stupid.

And of course, terrifying.
 
Unimportant whether it beat the humans or not. Important in the type of questions it could answer. IBM chose Jeopardy because of the puns and wordplay as well as the basic trivia answers, not just the answering of questions, but the processing of language in the way the questions were constructed.

This is way cool.

The NY Times Magazine article from last year shows just the progress Watson made from last year to the Jeopardy challenge.
 
I hadn't seen the second game yet, but I figured that was how it was going to end, since Watson cleaned house in the first game (despite getting the final jeopardy question wrong. Though I think it knew it wasn't sure, because it barely wagered any money).

Apparently, Watson sucks at geography.
 
Unimportant whether it beat the humans or not. Important in the type of questions it could answer. IBM chose Jeopardy because of the puns and wordplay as well as the basic trivia answers, not just the answering of questions, but the processing of language in the way the questions were constructed.

Well this is true(didn't think of that to be honest), although I have that the wording on Jeopary has changed over the years. I used to be an avid watcher, now I only catch it here and there and have found that they seem to be a little more direct these days compared to years ago, or maybe I've just gotten used to their approach :wink:
 
I watched a little of this,
I didn't find it that interesting at all.

A super computer could have all the data of few dozen libraries, that it is able to sort through and get the answers is surprising?

jesus, if one sits at home and googles they can get all the answers :shrug:

the fact that it is able to distinguish (with context) that 'bat' can be for baseball or a flying animal is a bit of an advancement.

One thing machines can not do, is take 'a leap' of imagination to find new knowledge, such as Eisenstein did with his Theory of Relativity.
 
I also have a hard time finding much interest in this, though I'm not really sure why. Especially when for example I got all gaga watching Chaser the World's Smartest Dog demonstrate her far more limited language comprehension skills on NOVA last week, and unlike Watson she can't really be 'tweaked' to human benefit. I guess I'm just more excited by the mysteries behind minds we have relationships with but only dimly understand, ones which weren't developed solely to benefit us, than the potential of ones we create in our own image to compensate for our limitations. Or maybe it's, like kramwest joked, Watson leaves me cold because it doesn't actually want to win, which seems like the essence of thinking somehow, striving.
 
Last edited:
Or maybe it's, like kramwest joked, Watson leaves me cold because it doesn't actually want to win, which seems like the essence of thinking somehow, striving.

That was part of my point.

If Watson doesn't know it won, it's just a really complicated string of software code to fit the situation. :meh:

If Watson knew it won, that would be interesting.

If Watson knew it won and gloated, then all of us humans are fucked.
:D

I hope this got a few more people thinking and talking about A/I (artificial intelligence). I'm not sure that A/I ever can be self-aware, but if it can...:yikes:
 
An article said the specific computer behind Watson will be disassembled again. So much for winning the game. :D
 
Thus contest was fixed before it began

Jeopardy! special favored Watson
February 17, 2011

I have been a fan of Jeopardy! for many years. I believe the rules for the contest between Watson, IBM's super computer, and two Jeopardy! "experts" favored the computer. The question appeared on the screen then was read by host Alex Trebec. Contestants could ring in after Alex read the question. Watson could analyze the question during that hiatus in nano (giga/terra?) seconds, while human contestants had to read and analyze the question in real time then push the button. Obviously the computer could scan through its massive memory, reach a conclusion and respond at least a split second before the contestants could respond in most cases. On many occasions, one of the contestants was trying to push the button in what would have been a competitive time in an all-live contest. If I were to restage the event, I would not allow Watson to begin its deliberations until reading of the question was completed; or at least after some fraction of that time frame.

there is that, I found posted elsewhere



and also, I know that if a contestant pushes the button before Alex is done reading the question, (i think they see a light that goes off) the button is delayed for a second or two. Therefore humans are nervous about pushing too soon and will hesitate. Watson does not have to deal with human emotions and free to push the split second time is up.

So Watson, can push at 1/1000 of a second and Jennings may have pushed at 3/1000 of a second. In reality Watson's knowledge is not better than Jennings.
 
It was never the intention to show that Watson knew more than others, because that would be pretty pointless. The whole exercise was, besides PR, to see how computers can be programmed in such a way that they understand text and context. It's more like Wolfram Alpha.
It will be interesting to see if it really can be translated into better search engines or be beneficial for medical research etc.
 
I think one of the reasons Watson beat the human competitors is because it didn't have to be slowed down by emotion

In addition to the other things you mentioned, that's great for Jeopardy.

But what about emotional intelligence? Unless they can find a way to give computers emotional intelligence, won't that always be a significant difference?

That guy who said we will be having conversations with machines-doesn't sound appealing to me. Then again it might be preferable to some humans.
 
Back
Top Bottom