Welcome! Log In Create A New Profile

Advanced

New Option: Spider (crawl) but do not index

Posted by codazoda 
New Option: Spider (crawl) but do not index
September 24, 2009 05:28PM
I've modified my version of Shpider to have a new "Spider but do not index" option. This option will add URLs to the database without matching keyword searches to them. This is useful for things like news articles where you want all the articles to be searchable but you do not want the list itself to be searchable, returning only articles as results and no site maps and such.

If you're interested in this modification, let me know and I'll build a patch file for you to play with.
Re: New Option: Spider (crawl) but do not index
September 26, 2009 11:29AM
Hello codazoda,
I interested for this great option.
Thats my email:
c.hollebeke(a t)gmail.com

Grtz,
Tuxy
Re: New Option: Spider (crawl) but do not index
September 27, 2009 10:52PM
I interested for this great option. [2]

Please leave the instructions here or send me a message via e-mail.

"celsojr100(-a-t) g m ail . co m"
Re: New Option: Spider (crawl) but do not index
September 28, 2009 12:54AM
This sounds like your mod could be very useful. Can you post the mod here? Thanks!!
Re: New Option: Spider (crawl) but do not index
September 29, 2009 05:31PM
This is really a great option, please send me the patch, thanks.
ilham.ali dot gmail dot com
Re: New Option: Spider (crawl) but do not index
October 15, 2009 02:57AM
friend,
shares with all the changes that you did
Re: New Option: Spider (crawl) but do not index
October 20, 2009 10:47AM
I'am interested as well! Sounds like a very nice feature!!


My Email is: mail(A_T)norlyng . d k


Kind regards!
Re: New Option: Spider (crawl) but do not index
November 05, 2009 12:42PM
Hi,
I interested for this great option.
Can you PM to me?
Anonymous User
Re: New Option: Spider (crawl) but do not index
November 06, 2009 05:38PM
hello
u hav done a gudd work.......
i m workin for a website for some company.......
plzz mail me .............at
smthnlikeu@yahoo.co.in
Anonymous User
Re: New Option: Spider (crawl) but do not index
November 06, 2009 05:38PM
hello
u hav done a gudd work.......
i m workin for a website for some company.......
plzz mail me .............at
smthnlikeu@yahoo.com
Re: New Option: Spider (crawl) but do not index
November 29, 2009 07:25PM
Hello,

I'm interested for this option.

Send me a PM please smiling smiley

Thanks
Re: New Option: Spider (crawl) but do not index
January 10, 2010 06:00PM
DO you cheat us? I think.... en
Sorry, only registered users may post in this forum.

Click here to login