The internet was made available for public use in the mid 1990s.Since then it has changed our life ina way few other things have been able to, in the past. The internet consists of nearly 487bn gigabytes(GB) of data. A search engine helps us find what we want in this endless sea of data. It is up to thesearch engine to prevent us from getting lost. So search engines are becoming increasingly importantin the internet world. This paper will cover the current search engine technologies, problems with thecurrent technology and the improvements to build better web search engines.
The number of internet users are around 1.97 billion as of 30 June 2010. It is incorporated invirtually all aspect of modern human life. The Internet consists of a vast rangeof information resources and services. Buried in which lies information of interest . The trick is to findit. This is where search engines play a critical role. A web search engine is designed to search for information, resulting in the generation of a list of results. The result will consist of web pages,images, video and other types of files.Archie was one of the first search engines.. It was created in 1990 by Alan Emtage, BillHeelan and J. Peter Deutsch, at McGill University in Montreal. The working of Archie was very simplecompared to current search engines. It downloaded the directory listings of all the files located onpublic sites, and created a searchable database of file names. WebCrawler, came out in 1994,allowedthe users to search for any word in any webpage, which has now become the standard. Lycos waslaunched in 1994 and became a major success. Yahoo!, allowed the search on its web directory only,rather than all the web pages like other search engines. Users could also browse the directory insteadof doing a keyword-based search. Search engines attracted a lot of investments in the Internetinvesting frenzy that occurred in the late 1990s.Several companies received record gains duringtheir initial public offerings. Some search engines have enterprise-only editions, such as NorthernLight. Many search engine companies were also caught up in the dot-com bubble, ending in their demise.Around 2000, the Google search engine rose to prominence. The main difference betweenGoogle and other search engines was Google focused on search, they did not sacrifice the quality of