Over 100 open source search enthusiasts gathered at the SF Bay Lucene/Solr Meetup on September 22. We had a special honored guest – Lucene’s creator, Cloudera architect, and ASF Chairman, Doug Cutting – kick things off with some background on the inception of Lucene. What a treat to hear from Doug on Lucene’s 10th anniversary!
Robert Muir then provided a great overview of the killer improvements to Lucene expected in the 4.0 release including index format customization, additional scoring algorithms, and major performance improvements.
A new Lucene/Solr Meetup member, Mike Cvet, discussed how Greplin is using Lucene to offer personal search for Gmail, Twitter, Facebook, Salesforce, Dropbox, Yammer, Basecamp, etc.  Greplin is handling peak insertions of 5,000 documents per second, and has implemented some cool hacks to handle batch operations, spell checking, and tokenization.

Mark Miller covered the many new features and advancements that users can look forward to in Solr 4, including performance optimizations, near-realtime search, SolrCloud, DirectSolrSpellChecker, and Realtime Get.

Slides for these presentations are at: http://www.lucidimagination.com/devzone/events/meet-ups/SFbay_lucene_solr_meetup

We had some interesting lightning talks from Kuro Kurosaka of Basis Technology, Eric Rosenblum of Envirospectives, and Amit Nithianandan from Zvents who discussed tuning Solr’s parameters using JMX – for more on this, see Amit’s blog post at http://hokiesuns.blogspot.com/2011/09/using-jmx-to-modify-parameters-of.html

For those interested in checking out some of the Solr 4.0 features, the new Lucidworks 2.0 platform incorporates many of the top 4.0 features such as near-realtime search, load balancing and failover for query traffic using Apache Zookeeper, faster fuzzy queries, and field collapsing. Downloads are available at: http://www.lucidimagination.com/downloads/lucidworks-enterprise/license/lwe/lucidworks-enterprise-installer-2.0.jar

Finally, if you are interested in a summary of the new features in Apache Solr/Lucene 3.4 – and how to use them – download the new Programmer’s whitepaper at: http://www.lucidimagination.com/devzone/technical-articles/whitepapers/programmers-guide-open-source-search-search-whats-new-apache-solr-lucene-3-4