Log Analyzer 

Log Analyzer is a professional log file analysis and spider visits tracking tool. The program analyzes Web server log files and presents your Web site usage statistics in comprehensive graphs and tables
site optimization log file analysis visits from search engines

Robots.txt 

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the Robots.txt files, required to instruct search engine spiders, which parts of a Web site are not to be indexed
site optimization log file analysis robots.txt editor spider instructions search engine indexation search engine optimization