How to install Sphinx Search with libstemmer support on Unbuntu 10.04

I have made a little recipe to install Sphinx Search with libstemmer (for added number of languages) on Ubuntu 10.04 Lucid with postgres support and no MySQL support.

Here is what needs to be done as the root user on your Ubuntu linux terminal:

0-) Before we start, we need to make sure all Sphinx dependecies are met:

aptitude install -y python-software-properties
apt-add-repository ppa:pitti/postgresql
aptitude update
aptitude install -y postgresql-server-dev-9.0 build-essential


1-) Get the current version of sphinx and uncompress it.

cd /opt
wget http://sphinxsearch.com/files/sphinx-2.0.1-beta.tar.gz
tar -xvzf sphinx-2.0.1-beta.tar.gz


2-) Get libsnowball / libstemmer to add more languages to the stemming process and uncompress it

wget http://snowball.tartarus.org/dist/libstemmer_c.tgz
tar -xvzf libstemmer_c.tgz'


3-) Copy all files from libstemmer to the sphinx directory so they can be compile together

cp -fa libstemmer_c/* sphinx-2.0.1-beta/libstemmer_c/

./configure --prefix=/etc/sphinx --without-mysql --with-pgsql --enable-id64 --with-libstemmer


5-) Make and install sphinx using 4 jobs to speed up compiling (most people have 4 core processors, so make it 4 jobs)

make -j4 install


6-) Create simbolic links to sphinx executables so it can be accesses from anywhere

cd /usr/local/bin
run('ln -s /etc/sphinx/bin/indexer')
ln -s /etc/sphinx/bin/indextool
ln -s /etc/sphinx/bin/search
ln -s /etc/sphinx/bin/searchd
ln -s /etc/sphinx/bin/spelldump



Now, follow instruction on the next blog post in order to configure you sphinx instalation

Comments

  1. licordelpoloJuly 5, 2011 at 6:51 PM

    Great post! thanks for you hard work :)

    In the sixth step, I think that run(' it's not necessary.

    ReplyDelete

Post a Comment

Popular posts from this blog

Draft Version of Tryton_Sphinx integration

I have made a draft version of the module to connect Tryton to Sphinx Search server. This module currently gets all the objects from the Tryton.pool.Pool and make any field that was originally selected by the author to be indexed (an searchable) on the database also searchable on Sphinx Search, with the benefit of full-text indexing on char and text fields, while making other fields available as attributes. I choose to implement this way in order to maintain compatibility with the current modules developed for Tryton 1.8, 2.0 and the future Tryton 2.2, in a manner that no module developer should make any additional effort in order to make their module compatible with the new search methodology if the Tryton. I have pushed my code to a github repository, along with the basic instruction on how to download, install, create the sphinx configuration, index the Tryton Pool ojects and run a searchd daemon in order to listen to incoming search queries. https://github.com/dfamorato/try
Read more

Project Abstract

This project proposes implementing full text search of records and attributes in Tryton using Sphinx Search Sever ( http://sphinxsearch.com/ ) in a pythonic implementation. The idea is to improve Tryton search capability to a more flexible, scalable and powerful option. I propose to use Sphinx Search Server because it is very fast (C++ language), can work in multiple OSes and has windows binaries (which might be included with NESO), it is very scalable, has proven success cases, we can implement in a pythonic way using SphinxAPI (which eliminates the need to install and support Apache Tomcat if we use Apache Solr), because it supports 2 of databases used by Tryton (PostgreSQL and Mysql), maybe can also support SQLlite3 through xmlpipe (if needed) and also supports NoSQL databases and future integrations (like MongoDB and CouchDB). My commitment is to submit fully functional code, using a wiki or project management system to keep track of ideas and milestones (Google Code or Assembl
Read more