Children of the Sun > Newsday

Countdown to Skynet

(1/13) > >>

Cassander:
We haven't been discussing Watson?  I think we need to turn in our geek badges.

I first read about this back in May in a magazine and have been following it ever since.  Basically an IBM super-computer is going to compete on Jeopardy starting Monday.


--- Quote ---Next week the IBM supercomputer known as "Watson" will take on two of the most accomplished Jeopardy players of all time, Ken Jennings and Brad Rutter, in a three-game match starting on February 14. If Watson manages to best the humans, it will represent the most important advance in machine intelligence since IBM's "Deep Blue" beat chess grandmaster Garry Kasparov in 1997. But this time around, the company also plans to make a business case for the technology. Trivial pursuit this is not.

And impressive technology it is. On the hardware side, Watson is comprised of 90 Power 750 servers, 16 TB of memory and 4 TB of disk storage, all housed in a relatively compact ten racks. The 750 is IBM's elite Power7-based server targeted for high-end enterprise analytics. (The Power 755 is geared toward high performance technical computing and differs only marginally in CPU speed, memory capacity, and storage options.) Although the enterprise version can be ordered with 1 to 4 sockets of 6-core or 8-core Power7 chips, Watson is maxed out with the 4-socket, 8-core configuration using the top bin 3.55 GHz processors.

The 360 Power7 chips that make up Watson's brain represent IBM's best and brightest processor technology. Each Power7 is capable of over 500 GB/second of aggregate bandwidth, making it particularly adept at manipulating data at high speeds. FLOPS-wise, a 3.55 GHz Power7 delivers 218 Linpack gigaflops. For comparison, the POWER2 SC processor, which was the chip that powered cyber-chessmaster Deep Blue, managed a paltry 0.48 gigaflops, with the whole machine delivering a mere 11.4 Linpack gigaflops.

But FLOPS are not the real story here. Watson's question-answering software presumably makes little use of floating-point number crunching. To deal with the game scenario, the system had to be endowed with a rather advanced version of natural language processing. But according to David Ferrucci, principal investigator for the project, it goes far beyond language smarts. The software system, called DeepQA, also incorporates machine learning, knowledge representation, and deep analytics.

Even so, the whole application rests on first understanding the Jeopardy clues, which, because they employ colloquialisms and often obscure references, can be challenging even for humans. That's why this is such a good test case for natural language processing. Ferrucci says the ability to understand language is destined to become a very important aspect of computers. "It has to be that way," he says. "We just cant imagine a future without it."

But it's the analysis component that we associate with real "intelligence." The approach here reflects the open domain nature of the problem. According to Ferrucci, it wouldn't have made sense to simply construct a database corresponding to possible Jeopardy clues. Such a model would have supported only a small fraction of the possible topics available to Jeopardy. Rather their approach was to use "as is" information sources -- encyclopedias, dictionaries, thesauri, plays, books, etc. -- and make the correlations dynamically.

The trick of course is to do all the processing in real-time. Contestants, at least the successful ones, need to provide an answer in just a few seconds. When the software was run on a lone 2.6 GHz CPU, it took around 2 hours to process a typical Jeopardy clue -- not a very practical implementation. But when they parallelized the algorithms across the 2,880-core Watson, they were able to cut the processing time from a couple of hours to between 2 and 6 seconds.

Even at that, Watson doesn't just spit out the answers. It forms hypotheses based on the evidence it finds and scores them at various confidence levels. Watson is programmed not to buzz in until it reaches a confidence of at least 50 percent, although this parameter can be self-adjusted depending on the game situation.

To accomplish all this, DeepQA employs an ensemble of algorithms -- about a million lines of code --- to gather and score the evidence. These include temporal reasoning algorithms to correlate times with events, statistical paraphrasing algorithms to evaluate semantic context, and geospatial reasoning to correlate locations.

It can also dynamically form associations, both in training and at game time, to connect disparate ideas. For example it can learn that inventors can patent information or that officials can submit resignations. Watson also shifts the weight it assigns to different algorithms based on which ones are delivering the more accurate correlations. This aspect of machine learning allows Watson to get "smarter" the more it plays the game
--- End quote ---

Here's an episode of Nova about Watson that looks more in-depth and behind-the-scenes-y (haven't watched it all yet).

nacho:
Nonsense! An automobile will never beat a horse!

Hopefully the remaining secret place will be stable enough to get these episodes up.

nacho:
So the first episode of the Watson Jeopardy is in our special place. Go get it... It's fascinating.

I'm watching the birth of Skynet!

RottingCorpse:
Holy shit!

The first five minutes or so of the Watson Jeopardy episode were more terrifying than any horror movie I saw last year. I saw the extinction of the human race flash by.

Then the programmers came on and they showed the early footage of Watson fucking up all over the place and I realized that a) it's just algorithms, and b) Watson is only programmed for this one function. And he started missing answers in the actual competition. there's nothing remotely resembling self-awareness there.

Still, it's pretty amazing and that type of comprehension is a huge step towards creating actual A.I. The question becomes how good an idea that really is AND how far off it is.

In the words of my wife, "Go humans!"

Cassander:
See, I am kind of rooting for Watson because 1) I hate Ken, and 2) we need computers like this sooner rather than later.  In interviews, the head of the project talks a lot about the "Star Trek computer" as a far-off goal: a computer that understands what you are asking it and what it is you want to know, not just a search engine.  This would be primarily used by doctors and scientists as, essentially, a next-generation of obtaining data.  Search engines find "matches" but a computer like Watson that's been fed every scientific journal or medical paper on a certain subject is going to be able to find more valuable information sooner and aid in diagnoses or hypothoses because it "understands" what you are trying to get at, not just offering you look-alike terms without context. 

What was also funny is you could tell at the beginning when Watson was just kicking ass that the humans were getting really frustrated about not being fast enough on the buzzer to the point where Ken decided to change his strategy and buzz in as soon as possible and hope that he knew or could come up with an educated guess in the "extra" time.  This is actually a pretty widely-used strategy by a lot of Jeopardy players who, like Watson, parse a few keywords, instinctively guess their probability of knowing the answer, buzz in, then (unlike Watson) put the info together later.  So there's your human element, RC....strategy and tactics.  Watson can't do that stuff.  And, apparently, they haven't even programmed him to recognize other players wrong answers and re-configure his probability algorithm. 

Navigation

[0] Message Index

[#] Next page

Go to full version