June 9, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Shenghua Wan’s talk, “Solr Distributed Indexing at WalmartLabs”. As a retail giant, Walmart provides millions of items’ information via its e-commerce websites, and the number grows quickly. This calls for big […]
September 26, 2016
As previously mentioned: On October 13th, Lucene/Solr Revolution 2016 will once again be hosting “Stump The Chump” in which I (The Chump) will be answering tough Solr questions — submitted by users like you — live, on stage, sight unseen. Today, I’m happy to announce the Panel of experts that will be challenging me with […]
September 21, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Solr Committer Ramkumar Aiyengar’s talk, “Building the News Search Engine”. Meet the backend which drives News Search at Bloomberg LP. In this session, Ramkumar Aiyengar talks about how he and his […]
September 19, 2016
It all started in Boston… In 2010, for the inaugural Lucene Revolution in Boston MA, I tried to weasel out of giving a prepared talk by proposing a Live Q&A style session where I’d be put on the spot with tough, challenging, unusual questions about Solr & Lucene — live, on stage. I don’t remember […]
September 13, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Peter Gazaryan and Eugene Steinberg’s talk, “Deep Data at Macys: Searching Hierarchical Documents for eCommerce Merchandising”. The traditional notion of relevance focuses on the “information need”. In eCommerce, online customer’s “information […]
September 8, 2016
It’s that time of the year again – time for our third annual survey of the Solr marketplace and ecosystem. Every day, we hear from organizations looking to hire Solr talent. Recruiters want to know how to find and hire the right developers and engineers, and how to compensate them accordingly. Lucidworks is conducting our […]
September 7, 2016
Don’t get me wrong, Data Science is really cool – trust me. I say this (tongue in cheek of course) because most of the information that you see online about Data Science is (go figure) written by Data “Scientists”. And you can usually tell – they give you verbiage and mathematical formulas that only they […]
September 6, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Brett Hoerner’s talk, “Solr at Scale for Time-Oriented Data”. This talk will go over tricks used to index, prune, and search over large (>10 billion docs) collections of time-oriented data, and […]
September 2, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting George Bailey and Cameron Baker’s talk, “Rackspace Email’s solution for indexing 50k documents per second”. Customers of Rackspace Email have always needed the ability to search and review login, routing, and […]
August 30, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Sematext’s Radu Gheorghe and Rafał Kuć’s talk, “Large Scale Log Analytics with Solr”. Radu and Rafał will also be presenting at Lucene/Solr Revolution 2016. This talk is about searching and analyzing […]
August 25, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting a talk from the newest Solr committer, Alexandre Rafalovitch. Alexandre will also be presenting at Lucene/Solr Revolution 2016. Solr is too big of a product to troubleshoot as if it were […]
August 23, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Verizon’s Joaquin Delgado and Diana Hu’s talk, “Where Search Meets Machine Learning”. Joaquin and Diana discuss ML-Scoring, an open source framework they’ve created that tightly integrates machine learning models into popular […]
August 22, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Bloomberg’s Michael Nilsson and Diego Ceccarelli’s talk, “Learning to Rank in Solr”. In information retrieval systems, learning to rank is used to re-rank the top X retrieved documents using trained machine […]
August 17, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Gregg Donovan’s session, “Lessons from Sharding Solr at Etsy”. Gregg covers the following lessons learned at Etsy while sharding Solr: How to enable SolrJ to handle distributed search fanout and merge; […]
August 16, 2016
Solr as a SparkSQL DataSource Part II Co-authored with Kiran Chitturi, Lucidworks Data Engineer Last August, we introduced you to Lucidworks’ spark-solr open source project for integrating Apache Spark and Apache Solr, see: Part I. To recap, we introduced Solr as a SparkSQL Data Source and focused mainly on read / query operations. In this […]
August 16, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Joel Bernstein’s session about Parallel Computing in SolrCloud. This presentation provides a deep dive into SolrCloud’s parallel computing capabilities – breaking down the framework into four main areas: shuffling, worker collections, […]
August 15, 2016
Suggesters, also known as autocomplete, typeahead or “predictive search” are powerful ways to accelerate the conversation between user and search application. Querying a search application is a little like a guessing game – the user formulates a query that they hope will bring back what they want – but sometimes there is an element of […]
August 12, 2016
As we countdown to the annual Lucene/Solr Revolution conference in Boston this October, we’re highlighting talks and sessions from past conferences. Today, we’re highlighting Devansh Dhutia’s session on how Gannet manages schema changes to large Solr collections. Deploying schema-changes to solr collections with large volumes of data can be problematic when the reindex activity can […]
August 11, 2016
Are we the only ones who feel like this summer is flying by? While the thought of saying goodbye to warm summer days pains us a little inside, we are excited that Lucene/Solr Revolution 2016 is just two short months away! The conference will be held October 11-14 in Boston, MA. If you haven’t secured […]
August 10, 2016
Our search UX framework now with support for Windows, developer mode, and more.
August 9, 2016 Better faceting and enhanced signals with our customizable search and data apps UI framework.
July 6, 2016Introduction For quite some time now, Lucidworks has been hosting a community site named Search Hub (aka LucidFind) that consists of a searchable archive of a number of Apache Software Foundation mailing lists, source code repositories and wiki pages, as well as related content that we’ve deemed beneficial. Previously, we’ve had three goals in building […]
June 27, 2016
We’re happy to announce another new addition to the Lucidworks team! Please welcome Jeff Depa, our new Senior Vice President of Worldwide Field Operations in May 2016 (full press release: Lucidworks Appoints Search Veterans to Senior Team). Jeff will lead the company’s day-to-day field operations, including its rapidly growing sales, alliances and channels, systems engineering and […]
May 24, 2016
Single Sign-On (SSO) mechanisms allow a user to use the same ID and password to gain access to a connected system or systems. In a web services or distributed computing environment, single sign-on can only be achieved by registering information about the sign-on authority with all systems that require its services. The previous article in […]
May 9, 2016
This blog post is about new features in the Lucidworks spark-solr open source toolkit. For an introduction to the spark-solr project, see Solr as an Apache Spark SQL DataSource Performing text analysis in Spark The Lucidworks spark-solr open source toolkit now contains tools to break down full text into words a.k.a. tokens using Lucene’s text […]
April 13, 2016
Happy Friday – Apache Solr 6 just released! From the official announcement: “Solr 6.0.0 is available for immediate download at: http://lucene.apache.org/solr/mirrors-solr-latest-redir.html “See the CHANGES.txt “Solr 6.0 Release Highlights: Improved defaults for “Similarity” used in Solr, in order to provide better default experience for new users. Improved “Similarity” defaults for users upgrading: DefaultSimilarityFactory has been removed, implicit […]
April 8, 2016
This is the third in a series of articles on securing your data in Lucidworks Fusion. Secure Fusion: SSL Configuration covers transport layer security and Secure Fusion: Authentication and Authorization covers general application-level security mechanisms in Fusion. This article shows you how Fusion can be configured to use an LDAP server for authentication and authorization. […]
March 23, 2016
This is the second in a series of articles on securing your data in Lucidworks Fusion. Here’s Part One. This post covers Fusion’s basic application-level security mechanisms. At the application layer, Fusions delivers security via: Authentication – users must sign on using a username and password. Authorization – each username is associated with one or […]
March 10, 2016
Our annual snapshot of the vibrant Solr community and the amazing things developers all over the world are doing with Apache Solr.
February 24, 2016
This is the first in a series of articles on securing your data in Lucidworks Fusion. The first step in securing your data is to make sure that all data sent to and from Fusion is encrypted by using HTTPS and SSL instead of regular HTTP. Because this encryption happens at the transport layer, not […]
February 23, 2016
Our latest interactive infographic takes a look at the murky origins – and potential of dark data http://lucidworks.com/darkdata
February 17, 2016
Solr’s DateRangeField I have to credit David Smiley as co-author here. First of all, he’s largely responsible for the spatial functionality and second he’s been very generous explaining some details here. Mistakes are my responsibility of course. Solr has had a new DateRangeField for quite some time (since 5.0, see SOLR-6103. DateRangeFields are based on […]
February 13, 2016
Trey Grainger has joined as Lucidworks SVP of Engineering where he’ll be heading up our engineering efforts for both open source Apache Lucene/Solr and our Lucidworks Fusion platform.
February 10, 2016
The Solr suggester search component was previously discussed on this blog in the post Solr Suggester by Solr committer Erick Erickson. This post shows how to add a Solr suggester component to a Fusion query pipeline in order to provide the kind of auto-complete functionality expected from a modern search app. By auto-complete we mean […]
February 4, 2016
A brief history of everybody’s favorite open source search engine.
February 2, 2016
Part three in a series demonstrating how it’s possible to build a real Apache Solr application using just a few simple commands.
January 27, 2016
We are pleased to welcome Jake Mannix to the Lucidworks team as our new Principal Data Engineer. Jake’s past work includes: Working on data pipelining with Apache Spark to scale a semantic search engine at the Allen Institute for Artificial Intelligence. Jake was tech lead for Twitter’s Data Science / Data Engineering team, building both the […]
January 20, 2016
The best of the blog from the past year including Solr authentication, Hadoop connectors, facets and stats, Docker, Spark, and increasing indexing and performance.
January 13, 2016
Lucidworks engineer, Apache Lucene committer, and co-author of Lucene in Action as well as co-author of Java Development with Ant is profiled on Dave Rael’s Developer on Fire podcast. Subscribe or listen on iTunes or via the podcast’s feed.
January 9, 2016
Lucidworks is happy to announce that several of our connectors for indexing content from Hadoop to Solr are now open source. We have six of them, with support for Spark, Hive, Pig, HBase, Storm and HDFS, all available in Github. All of them work with Solr 5.x, and include options for Kerberos-secured environments if required. HDFS for Solr […]
December 17, 2015
Lucidworks CEO Will Hayes latest Forbes columns looks at the ways scammers take advantage of the big holes in big data to prey on all of us: “The immense amount of data we expose about ourselves make it incredibly easy to get targeted. … These profiles make it easier than ever for up-to-no-gooders to target us […]
December 16, 2015
Part two in a series demonstrating how it’s possible to build a real Apache Solr application using just a few simple commands.
December 8, 2015
How to implement PagerDuty alerts in Lucidworks Fusion for monitoring, resolution, and escalation.
November 20, 2015
This is my fourth blog post on a technique that I call Query Autofiltering. The basic idea is that we can use meta information stored within the Solr/Lucene index itself (in the form of string or non-tokenized text fields) to generate a knowledge base from which we can parse user queries and map phrases within […]
November 19, 2015
It is now even easier to get started with Solr: you can run Solr on Docker with a single command.
November 3, 2015