Dear Sir/Mam Now i am facing another problem. when i am trying to index facebook.com it shows me error like : Disallowed files and directories in robots.txt: [facebook.com] 1. Link [facebook.com]: file checking forbidden in robots.txt file Completed at 00:56:54. when i look into robots.txt file on my server that is empty. Please Reply as soon as possible. Thanks Rahul errahulsinghsolanki@gmail.com http://www.sphider.eu/forum/read.php?2,9362,9362#msg-9362 Sat, 25 May 2013 07:29:18 +0300 Phorum 5.2.10 http://www.sphider.eu/forum/read.php?2,9362,9433#msg-9433 http://www.sphider.eu/forum/read.php?2,9362,9433#msg-9433
[www.facebook.com]

# Notice: if you would like to crawl Facebook you can
# contact us here: [www.facebook.com]
# to apply for white listing. Our general terms are available
# at [www.facebook.com]]]> mario Sphider Support Thu, 17 May 2012 18:54:22 +0300 http://www.sphider.eu/forum/read.php?2,9362,9366#msg-9366 http://www.sphider.eu/forum/read.php?2,9362,9366#msg-9366 Don't try to search for it by means of the above search form. The PHORUM search engine is most crummy.
Here is the direct link:
[www.sphider.eu]

If you don't like to mod your Sphider installation, Sphider-plus contains this mod as state of the art.

Tec]]> Tec Sphider Support Wed, 25 Apr 2012 10:36:29 +0300 http://www.sphider.eu/forum/read.php?2,9362,9365#msg-9365 http://www.sphider.eu/forum/read.php?2,9362,9365#msg-9365 9716181663 Sphider Support Wed, 25 Apr 2012 09:48:55 +0300 http://www.sphider.eu/forum/read.php?2,9362,9363#msg-9363 http://www.sphider.eu/forum/read.php?2,9362,9363#msg-9363
As you can not change that file you have to live with those restrictions, I guess.]]> Willy Sphider Support Wed, 25 Apr 2012 09:37:48 +0300 http://www.sphider.eu/forum/read.php?2,9362,9362#msg-9362 http://www.sphider.eu/forum/read.php?2,9362,9362#msg-9362
Now i am facing another problem. when i am trying to index facebook.com it shows me error like :

Disallowed files and directories in robots.txt:
[facebook.com]

1. Link [facebook.com]: file checking forbidden in robots.txt file

Completed at 00:56:54.


when i look into robots.txt file on my server that is empty. Please Reply as soon as possible.

Thanks
Rahul
errahulsinghsolanki@gmail.com]]> 9716181663 Sphider Support Wed, 25 Apr 2012 09:07:33 +0300