In a recent project we were asked to implement a full text search engine called Sphinx. Sphinx was created back in 2001 because the creators could not find a decent search solution for a database driven website. Due to the really fast searching and indexing, Sphinx is currently used on a wide variety of sites which all have to handle a lot of data (think of sites as blogcatalog.org and thepiratebay.org).