This week's edition of The Economist has an interesting piece in its technology section on search engines. Thankfully, not another critique of Google / its recent IPO, but at what we might expect of tomorrow’s search engines. The article talks about research, done by Microsoft, into search engines that can answer questions.

A very simplistic example of how the technology works is this. Imagine a search engine homepage with a text box, allowing you to pose any question - e.g. the question "When was Neowin founded?". The search engine computers would then take the phrase, break it down and manipulate it (in terms of structure, tense etc) and then run a search on that data. The search engine would then return a list of the results; more intelligent engines could discard many (e.g. "never" would be discarded) of the results and leave the users with a list of possible answers (e.g. 4).

The technology is still a prototype, and is currently called 'Ask MSR' (MS Research). Bink has a collection of links and papers by MS researchers on the topic. Technologies like these give search engines the edge, if, and it's a big if, they work well. Dr Brill, researcher working on the system, wants to develop something that might give a fifty word answer to your question (view his research paper - PDF | HTML). The Economist notes that the system works ~40% of the time; not bad, but still needing work.

View: The article @ The Economist | More links @ Bink


Build 9 24 August 2004

* Version number incremented to 1.1
* Redesigned user interface
* Added right click context menu to profile list on main window
* Added new services to service help (including new XP SP2 services)
* Added colors and minor modications to text window logging to fsasctl
* Added additional support for terminating the desktop (explorer.exe)
* Added running programs filter to programs window
* Added Tools menu option to allow user to set Program Options and launch the Service Manager
* Added Tool Tip help througout the program (can be disabled via Program Options)
* Added abilty to shutdown or restart the computer after fsasctl has finished execution (not available for Windows 9x/ME)
* Fixed bug where Comments embedded in program executables were not being displayed properly in the programs window



There are 29 additional comments
Advertisement
Quote this comment Reply to this comment #1 Posted by Lycan on 30 Aug 2004 - 19:59
would be cool yeh to get answers on a broad Question
(1 reply) Quote this comment Reply to this comment #2 Posted by moua on 30 Aug 2004 - 20:05
So... when was it founded ?
And what about www.ask.com ?
Quote this comment #2.1 Posted by Jugalator on 30 Aug 2004 - 22:30
It seems to be pretty brain dead.

Gave this reply to "When was Neowin founded?"

http://uptime.bxboy.com/
Quote this comment Reply to this comment #3 Posted by daimon on 30 Aug 2004 - 20:07
We also some kinds of prototypes in MS Office. Also McAfee.com had a similar thing on their web site in the past but that was like a text recognition thing. Ask.com is far from achieving that aim, the Jevees is quite dull.
Quote this comment Reply to this comment #4 Posted by Sn1p3t on 30 Aug 2004 - 20:15
This sounds very useful for research. I hope they can get the accuracy up to a higher range
(3 replies) Quote this comment Reply to this comment #5 Posted by Xenoxide on 30 Aug 2004 - 20:40
Yes, yes, this technology was hyped 5 years ago when Jeeves/Ask came out. And look how completely useless and frustrating it turned out to be.

I can't see Microsoft having much better success with it either.
Quote this comment #5.1 Posted by rogerroger on 30 Aug 2004 - 23:21
QUOTE
the system works ~40% of the time


That is about what askjeeves.com has been at! Microsoft could have saved a lot fo time by just buying them. Why reinvent the wheel when you can buy it?
Quote this comment #5.2 Posted by mbg on 31 Aug 2004 - 01:56
I'm not sure it's the same as Ask Jeeves. You can get the better results than Ask Jeeves by typing the same question into Google... Google just strips out the common words (i.e. where, is) and uses the rest as keywords... and it's better at it than Ask Jeeves.

It sounds like Microsoft is trying to genuinely "understand" what the user is trying to find.
Quote this comment #5.3 Posted by noyb on 02 Sep 2004 - 11:27
If that were true the first 100 results would be Porn.
Quote this comment Reply to this comment #6 Posted by nX07 on 30 Aug 2004 - 20:46
If they do things right and such, I think they call put it off to become a useful tool!
Quote this comment Reply to this comment #7 Posted by lare2 on 30 Aug 2004 - 21:34
Computer Associates has a safety box named SAMMY, wich also respond customer support related questions.
Quote this comment Reply to this comment #8 Posted by brianshapiro on 30 Aug 2004 - 22:01
most searches i do couldnt be formed as questions anyway, though maybe natural language could help in some way
Quote this comment Reply to this comment #9 Posted by Goalie_CA on 30 Aug 2004 - 22:01
MS must first realize that the technology they want to implement today will be difficult 20 years from now. Remember in the 80's, everyone figured ai was the next big thing, lol.
Quote this comment Reply to this comment #10 Posted by Bundus on 30 Aug 2004 - 22:02
NLP = Natural Language Processing

The biggest hurdle is going to be grammer structure for the 100+ some odd languages out there.

I did a very similar thing in my final project for College. Using an Access Database (shudder, i know), i could type in "When does John Smiths drivers licence expire", and it would come back right...however it was coded with keywords in mind...

so like....

licence
drivers licence
permit

...would point to the "licence" column in the database.....while crude, the technology can be done.
(4 replies) Quote this comment Reply to this comment #11 Posted by Jugalator on 30 Aug 2004 - 22:27
"When was Neowin founded?"

If queries like this really worked most of the time, it would certainly become a killer app and very very cool indeed. Also a field Google hasn't dug into (yet), or any other successfully either for that matter. I don't consider Ask Jeeves successful. However, I have no idea how they'd do it. Sooo many ambiguities in short natural language questions, and other tough problems to crack.

I can imagine "Where can I find free porn sites without advertisment?"

It would be pretty cool if it all became a game of forming your question as well as possible. Hehe
Quote this comment #11.1 Posted by Bundus on 30 Aug 2004 - 22:38
ooo....also has some negative implications...

Where can i find Doom 3 DVD ISO

...would be a haven for piracy and a lot of other illegal material, however, i suppose they could sprinkle a bit of censorship here and there.
Quote this comment #11.2 Posted by Erich on 31 Aug 2004 - 02:10
Cencorship is bad!!! Maybe instead of shielding people from the problem, they could try and eliminate it. Especially with tools like google, and something like this, you'ld think it would make it easier for internet enforcement to do their job. "What is the IP address' of the last 100 people to ddos this site?"
Quote this comment #11.3 Posted by Jugalator on 31 Aug 2004 - 07:24
QUOTE
ooo....also has some negative implications...

Where can i find Doom 3 DVD ISO


Try that question out with Google's "I'm feeling lucky".
I got the link to an active BitTorrent tracker with it... Good enough
Quote this comment #11.4 Posted by bradford108 on 31 Aug 2004 - 07:28
QUOTE
ooo....also has some negative implications...

Where can i find Doom 3 DVD ISO

...would be a haven for piracy and a lot of other illegal material, however, i suppose they could sprinkle a bit of censorship here and there.


Guides already exist showing Google search structure which will reliably find pirated material, mp3's, etc..
(1 reply) Quote this comment Reply to this comment #12 Posted by omega3112 on 30 Aug 2004 - 23:01
STAR TREK !!!
Quote this comment #12.1 Posted by PayneX on 31 Aug 2004 - 08:05
We need voice recognition first (that doesn't suck), vocal reproduction (that doesn't suck) and this search system not to be another jeeves. But we're getting there.
Quote this comment Reply to this comment #13 Posted by Erich on 31 Aug 2004 - 01:47
There are several companies working on this technology. I know for one, my company, telus. When you call our main number, you talk to a computer with voice recognition and it tries to recognize certain words and grammar etc, then direct you to the right department. Let me tell you this is a WIP!!! But anyways they are regularly improving the vocabulary and grammar and the beauty of the whole system is in that future they will be adding multilanguage support etc. At the moment it's having problem with different dialects
(1 reply) Quote this comment Reply to this comment #14 Posted by dhavalhirdhav on 31 Aug 2004 - 04:15
this is pretty cool.. if M$ gets success with it.. then I can see Google
Quote this comment #14.1 Posted by Jugalator on 31 Aug 2004 - 07:22
However, I hope Google will fight back with something better then.
Competition is ALWAYS good (at least for their customers, hehe)
Quote this comment Reply to this comment #15 Posted by psykil on 31 Aug 2004 - 05:54
Q: "When was Neowin founded?"
A: "4"

needs work.
Quote this comment Reply to this comment #16 Posted by pctuk on 31 Aug 2004 - 07:46
Whilst I think this might be good for most users, I think advanced users will still use keyword searches. I can always articulate a query much easier using search engine syntax rather than natural language. Sure, this technology will have its uses, but it won't be the most useful for everyone.
Quote this comment Reply to this comment #17 Posted by Jugalator on 31 Aug 2004 - 09:05
lol, Eric Brill, one of those behind this new technology have a hilarious blog:
http://research.microsoft.com/~brill/blog.htm
(1 reply) Quote this comment Reply to this comment #18 Posted by Magallanes on 31 Aug 2004 - 13:29
Q: When was neowin founded?.
A: Some page about the foundation.


Q: ¿Cuando neowin fue fundado? (spanish)
A: a random page.


I wonder how many language it will support.

Quote this comment #18.1 Posted by Jugalator on 31 Aug 2004 - 22:51
I'd assume one.
[1]

Commenting has either been disabled on this article or you are not logged in. Click here to login or register, its free!

Note: Anonymous commenting is disabled in order to keep the quality of responses to a high standard.


Scroll to the Top
....
My Preferences
....
Communicating with server
Loading
Please Wait...
....
Loading
 X 
....