Sophto's BloGy

The topic about search engines is very very interesting and AMAZING to me, imagine crawling through the whole Internet indexing its contents .. that is just CRAZY man and it really requires geniuses to make it successful like google for example. To get the feeling of how awesome designing search engines, take a look at this document about Google. However, designing search engines is faced by many challenges here is some of them:

• The Size of the Web: as you know the Web is growing very fast. It is estimated no to be around 23.91 billion indexed pages.
• Currency: this one concern with websites get updated very frequently which means search engines must visit them periodically.
• Relevancy: one of the big challenges is wether the search engine will provide you with what you really want when giving a keyword or it will give you something called false-positive.
• Dynamically generated Web-sites: sites that are generated from databases like dictionary site and so on.
• They can be tricked: yes they can be tricked, by giving false information in the metadata section of the webpage and garbage information in the body. This act will of course push down many websites that are relevant to your keywords. 
• Secure webpages: of course search engines will not be able to index them since the are secure. However, some websites they don’t like to be indexed and this is where a lot of problems occurs. These websites might be governmental ones.