directory structure:
/public_html/
../templates/
/templates/ is .htaccess protected and in robots.txt i have:
User-agent: *
Disallow: /templates/
but Sphider+ is trying to access the directory (i'm being prompted for authentication)
other than this particulap problem, SP seems to be following robots.txt fine.
