global crawler

Any one develop a sphider for global crawling not limited to sites added from admin,please help me

In a command line just run: cd /path/to/sphider/admin
php spider.php -u [www.sphider.eu] -l -f
this then means that the spider will leave the domain

just put a tick in : allow spider to leave the domain.
Works great for me.

so if i add:

php spider.php -u [www.sphider.eu] -l -f

Then it will crawl the whole web? Or am I misunderstanding the question and the answers?

Thanx for sharing...........
-------------
seo India

alias007 Wrote:
-------------------------------------------------------
> so if i add:
>
> php spider.php -u -l -f
>
>
> Then it will crawl the whole web? Or am I
> misunderstanding the question and the answers?

Yes, until your database implodes...Sphider will NOT index the entire web.