Show all posts by user
If you are having a problem with Sphider, this is the place to look for an answer.
indexing very large sites possible? (and many other questions) - 4 years ago
i have a site www.dreadlockssite.com thats at least 1.5 million pages (just moved to a new site structure just starting my 1st sitemap crawl) everytimne i start the indexer it seems so slow and causes my sitemap crawler to timeout and the site itself sliows way down (i think) no pages in the admin for Sphider will load till i kill the spider process on the server wich has only crawled 8by soaringeagle - Sphider Support
will sphider do what i need it to do - 4 years ago
i have a large social network 1.5 million pages in the current sitemap im moving to a diferent system i need a search engine that can index the entire site including media like vids mp3's photos etc embeded and uploaded plus it need to also search sections like blogs forums profiles videos photos etc and return results just from those sections and be able to update daily by cron job or betteby soaringeagle - Sphider Support