Indexing issue: MTN.com

Hi,

I indexed http://www.mtn.com/Careers/Pages/Vacancies.aspx
but only a few pages/URLs (8) were index and the rest were not indexed. However, there are more than 1000 jobs under this page.

I tried it many times, with the option of FULL INDEXING and 3 LEVEL indexing also.

Please advise.

Regards,
ZG

Are you running your Sphider on a ‚Shared Hosting’ server? Eventually your indexer suffers from a time-out, because of a too short time slice. Have a look at the corresponding log file of your index procedure. What info is presented at the final rows? Is the procedure broken, or does it end officially?

Additionally: Even if you select ‘Full’ as index depth, the original Sphider will only fetch links beyond the root folder as defined in your ‘Sites’ view like

http://www.mtn.com/Careers/Pages/all_files_here
http://www.mtn.com/Careers/Pages/all_subfolders/all_files_here

But the original Sphider will not find links like

http://www.mtn.com/investors/shares/pages/analysts.asp
http://www.mtn.com/Sustainability/csi/Pages/csi.aspx
http://www.mtn.com/Pages/Home.aspx

Tec



Edited 1 time(s). Last edit at 04/01/2012 12:52PM by Tec.