Kiwi develops new and improved web search

A Kiwi researcher has designed a new search algorithm that uses statistical language models to ‘see through’ the search terms used and capture the intended meaning of a query in a way Google can’t...

 

25th January 2012

Although 80 percent of searches immediately find what people are looking for, sometimes it takes hours to find the right page, says Dr Daniel Crabtree, creator of the project.

The 27 year old researcher has been gaining the attention of major search players after developing a new algorithm that could give search engines a better understanding of the meaning behind a user's queries.

"Search engines still throw up mixed results with ambiguous search terms. If you searched for ‘jaguar’ for instance, it could refer to the animal, the car, even an Apple operating system or ‘80s video game console.

"Search engines currently don’t deal with that ambiguity because they simply search for web pages that contain the words you’ve entered.”

He says the algorithms he has developed group pages together - which is called clustering - to separate different interpretations.

"One aspect of the model for instance is that it recognises word order. If you typed in ‘New Zealand air’, for example, it would cluster results around air quality rather than Air New Zealand which is the search result you get from Google."

Dr Crabtree says his model aims to help search engines understand queries and group related words together to deliver what someone is “really searching for”.

"Search engines don’t appear to have improved that much in recent years. That’s partly because they’ve been focused on other issues, such as revising their search algorithms to stop spam or companies ‘gaming’ the search results," he says.

Although his model has been tested on a small scale and he has spoken to major search engines about his research, none of them appear to be using it yet.

"The major search engines seemed interested in hiring me a few years ago, but I’m keen to continue working on some of my other projects," says Dr Crabtree who started his first web business when he was 13 and attended Stanford Business School in 2008.

Since completing his PhD, Crabtree has been working on a new web concept—“focused on finding and sharing information on the internet”—codenamed Project Mandelbrot.

© iStart Technology in Business www.iStart.co.nz

View all latest news










12/01/25_ex_h

MOST POPULAR//


Finalists named in $250K Greentree software contest

Half of all NZers victims of fraud as cybercrime runs rampant

Hutt City Council goes mobile

IT spend will top NZ $6 billion by 2015

Jobs vindicated: Flash player for mobile devices dead, Adobe shares tumble

Gartner reveals top 10 commercial business apps for tablets


View all latest news




 

site by doubleclique