Google Steps Up Search Index Through “Caffeine” Process

Posted Jun 9, 2010

Google Inc. (NASDAQ:GOOG) made a huge announcement about their search index.  The company announced a new system called “caffeine,” which provides 50% faster web results whether they are blog posts, forum posts, images, etc.

“Our old index had several layers, some of which were refreshed at a faster rate than others; the main layer would update every couple of weeks. To refresh a layer of the old index, we would analyze the entire web, which meant there was a significant delay between when we found a page and made it available to you. With Caffeine, we analyze the web in small portions and update our search index on a continuous basis, globally. As we find new pages, or new information on existing pages, we can add these straight to the index. That means you can find fresher information than ever before?no matter when or where it was published,” stated Google Software Engineer Carrie Grimes on the official blog.

Caffeine takes up about 100 million gigabytes of storage in one database.  Hundreds of thousands of gigabytes in information data is added per day.