Nomad - A Tiny Search Engine.

Installation

Installing Nomad is very easy. The first thing you should do is to get a tarball. Untar it and you are ready to run (well almost :-). You just need to take care of few simple things.

Pre-requisites

  1. Python 2.2+ complier (Tested on 2.2.1)
  2. MySQL 3.23+ (Tested on 3.23.51 and 4.0.1, WILL NOT WORK on 3.22.x)
  3. MySQLDb 0.9.3 beta (This won't support less than MySQL 3.23)
  4. Apache with mod_python(or whatever way you know. This is just to run Nomad Searcher)

Instructions To Get Nomad Crawler Running.

  1. Create datbase with name "NomadDB" or whatever you wish to name it.
    Choose the username password to access your Nomad database.
    Don't forget to change the required values in /Constants.py file.
  2. Run CreateTable.py at your prompt.
    python CreateTables.py
    Now the tables have ben created. Check in your database to confirm.
  3. Change configuration
    Open up the Constants.py file in any text editor to change the values.
    The comments given in the file are self-explanatory.
    If you change the START_FROM_FILE constant, do check out the startup.txt file to specify the FQDNs to start crawl with.
  4. Run the Crawler
    python crawler.py
  5. Check the log [DEFAULT is /debug.log] and DATA directory [DEFAULT is /data/]
  6. To see the stats, RUN
    python stats.py

Instructions To Get Nomad Searcher Running.

  1. Create an entry in your httpd.conf file. Below given is the Sample VirtualHost Directive

    ServerAdmin webmaster@localhost
    DocumentRoot /path/to/nomad

    SetHandler python-program
    AddHandler python-program .py
    PythonHandler mod_python.publisher
    AllowOverride All
    Options Indexes ExecCGI
    PythonDebug on


    ErrorLog logs/error_log
    CustomLog logs/access_log common

  2. Open the URL (http://host/path/to/nomad/search) in netscape or whatever your favourite browser is.