Howto: Index using a script (Theme MOD and Mass-Indexing) November 23, 2013 04:50PM |
Registered: 6 years ago Posts: 22 |
#Usage: php spider.php <options> # #Options: # -all Reindex everything in the database # -u <url> Set url to index # -f Set indexing depth to full (unlimited depth) # -d <num> Set indexing depth to <num> # -l Allow spider to leave the initial domain # -r Set spider to reindex a site # -m <string> Set the string(s) that an url must include (use \n as a delimiter between multiple strings) # -n <string> Set the string(s) that an url must not include (use \n as a delimiter between multiple strings) # ---------------------------------------------------------------------------------------------- php spider.php -u http://blahhhh.org/forums -d 5; php spider.php -u http://blahhhhhh.net/forums -d 5; php spider.php -u http://forums.blahhhhhhee.com -d 5; php spider.php -u http://blahhhrrhhh.com/forums -d 5; #php spider.php -u http://blahhhhhqqh.com/forums -d 5; #php spider.php -u http://blahhhhhddh.com/forums -d 5; php spider.php -u http://blahvvhhhhh.com/forums -d 5; php spider.php -u http://blahhnnhhhh.com/forums -d 5; exit;
cd /home/sites/public_html/admin/ screen ./run_indexer_depth.sh
Ctrl+A+D
cd /home/sites/public_html/admin/ ./run_indexer_depth.sh
#Usage: php spider.php <options> # #Options: # -all Reindex everything in the database # -u <url> Set url to index # -f Set indexing depth to full (unlimited depth) # -d <num> Set indexing depth to <num> # -l Allow spider to leave the initial domain # -r Set spider to reindex a site # -m <string> Set the string(s) that an url must include (use \n as a delimiter between multiple strings) # -n <string> Set the string(s) that an url must not include (use \n as a delimiter between multiple strings) # ---------------------------------------------------------------------------------------------- php spider.php -u http://blahhhh.org/forums -r; php spider.php -u http://blahhhhhh.net/forums -r; php spider.php -u http://forums.blahhhhhhee.com -r; php spider.php -u http://blahhhrrhhh.com/forums -r; #php spider.php -u http://blahhhhhqqh.com/forums -r; #php spider.php -u http://blahhhhhddh.com/forums -r; php spider.php -u http://blahvvhhhhh.com/forums -r; php spider.php -u http://blahhnnhhhh.com/forums -r; exit;
yum install screen
apt-get install screen
Uptime: 1 days, 20 hours, 10 minutes Tasks: 211 total, 1 running, 210 sleeping, 0 stopped, 0 zombie Cpu(s): 3.1%us, 0.3%sy, 0.0%ni, 95.5%id, 0.9%wa, 0.0%hi, 0.2%si, 0.0%st Mem: 3960652k total, 2700808k used, 1259844k free, 185548k buffers Swap: 5996536k total, 0k used, 5996536k free, 1447388k cached
-sh-3.2$ screen -r There are several suitable screens on: 31448.script (Detached) 31452.script (Detached) 31469.script (Detached) 31427.script (Detached) 31436.script (Detached) 31461.script (Detached) 31441.script (Detached) 31422.script (Detached)