How Twitter Uses Apache Lucene For Real-Time Search

As we countdown to the annual Lucene/Solr Revolution conference in Austin this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Michael Busch’s session on how Twitter executes real-time search with Apache Lucene.

Twitter’s search engine serves billions of queries per day from different Lucene indexes, while appending more than hundreds of millions of tweets per day in real time. This session will give an overview of Twitter’s search architecture and recent changes and improvements that have been made. It will focus on the usage of Lucene and the modifications that have been made to it to support Twitter’s unique performance requirements.

Michael Busch is architect in Twitter’s Search & Content organization. He designed and implemented Twitter’s current search index, which is based on Apache Lucene and optimized for realtime search. Prior to Twitter Michael worked at IBM on search and eDiscovery applications. Michael is Lucene committer and Apache member for many years.

http://www.slideshare.net/lucidworks/search-at-twitter-presented-by-michael-busch-twitter

Twitter’s search engine serves billions of queries per day from different Lucene indexes, while appending more than hundreds of millions of tweets per day in real time. This session will give an overview of Twitter’s search architecture and recent changes and improvements that have been made. It will focus on the usage of Lucene and the modifications that have been made to it to support Twitter’s unique performance requirements.

lucenerevolution-avatarJoin us at Lucene/Solr Revolution 2015, the biggest open source conference dedicated to Apache Lucene/Solr on October 13-16, 2015 in Austin, Texas. Come meet and network with the thought leaders building and deploying Lucene/Solr open source search technology. Full details and registration…

You Might Also Like

New survey: 67% of shoppers want AI to explain products, not buy them

Consumer-centric data reveals shoppers don't want AI to shop for them. They...

Read More

Top 5 Use Cases for ACP in B2B Commerce

The rise of agentic commerce opens compelling new frontiers for B2B businesses.

Read More

The Role of Open Standards in MCP and ACP — Why Interoperability Matters

Open standards are what make MCP (Model Context Protocol) and ACP (Agentic...

Read More

Quick Links