| Sponsored Links | ||||||||||||||
|
| ||||||||||||||
|
Collapse All
|
||||||||||||||
| Software Name | Software Type | Category | Price | |||||||||||
| 1 | Robots.txt 2.0 |
windows | Web Development->Website Promotion | $99.90 |
View Detail
|
|||||||||
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with |
||||||||||||||
| 2 | robots.txt generator |
script | PHP | Free |
View Detail
|
|||||||||
|
||||||||||||||
| 3 | Robots.txt 2.0 |
windows | Network Internet->Other | Free |
View Detail
|
|||||||||
|
||||||||||||||
| 4 | robots.txt 1.0.3 |
linux | Internet->HTTP | Free |
View Detail
|
|||||||||
robots.txt is a script in PHP that acts like a normal robots.txt file, but with a few differences. When a Spider attempts to access robots.txt, the script will "disallow" access to a list of pre-defined directories. When a normal user attempts to access robots.txt, it will "disallow" access to all directories. This is a security precuation and an attempt to prevent users from finding "hidden" directories by looking at the robots.txt file. Whats New in This Release: · The two serious bugs that meant robots.txt did not function properly were fixed. · A bug that meant the data printed back would not be parseable by Web crawlers was fixed. · A new function to clean up data from the files was added. |
||||||||||||||
| 5 | Robots.txt 2.0.1 |
windows | Network Internet->Web Searching Tools | $99 |
View Detail
|
|||||||||
Robots.txt is a graphic editor for Robot Exclusion Files and a log manager package tool. Robots.txt allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. Here are some key features of "Robots txt": · Visually generate industry standard Robots.txt files · Identify malicious and unwanted spiders and ban them from your site · Direct search engine crawlers to the appropriate pages for multilingual sites · Keep spiders out of sensitive and private areas of your Web site · Upload the correctly formatted robots.txt file directly to your FTP server not switching from Robots.txt Editor · Track spider visits · Create spider visits reports in HTML, Microsoft Excel CSV and XML formats |
||||||||||||||
| 6 | Advanced Robots.txt generator 1.2 |
windows | Network Internet->Other | $35 |
View Detail
|
|||||||||
Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. Here are some key features of "Advanced Robots txt generator": · Advanced Robots.txt generator offers support for ~300 Robots and Crawlers · Automatic creation of Robots.txt file · Automatic scanning of local site directories · Comparison and correction with previously saved Robots.txt projects · Unlimited number of projects and websites · Automatic uploading to the web server · WYSIWYG selection of Robots and file/directory exclusions · Unlimited combinations for the Robot controls · Online and offline documentation · Manual in PDF format · Unlimited and free customer support · Free Upgrades for life. |
||||||||||||||
| 7 | Advanced Robots.txt Generator 1.2 |
windows | Web Development->Misc Web Authoring Tools | $65.00 |
View Detail
|
|||||||||
Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. The following is a list of the features of Advanced Robots.txt Generator. * Support for ~300 Robots and Crawlers * Automatic creation of Robots.txt file * Automatic scanning of local site directories * Comparison and correction with previously saved Robots.txt projects * Unlimited number of projects and websites * Automatic uploading to the web server * WYSIWYG selection of Robots and file/directory exclusions * Unlimited combinations for the Robot controls * Online and offline documentation * Manual in PDF format * Unlimited and free customer support * Free Upgrades for life. |
||||||||||||||
| 8 | Oven Fresh Robots.txt Maker 3 |
windows | Software Development->Tools Editors | $15.95 |
View Detail
|
|||||||||
Make, Save, and Upload Your Robots.txt File in Minutes. Fill in a simple form and the code is generated for you. Upload your robots.txt file with the built-in FTP Access or use your own FTP uploader. No Additional Fees or costs. No Additional Fees or costs. You can make, save, and upload your robots.txt file in no time at all with Robots.txt Maker. Help prevent the indexing of your files and directories that if indexed by themselves could frustrate a viewers search experience and possibly alienate them. For instance, a viewer could become discouraged after clicking on a link that only shows your photos without any way to reach your web site. Try It Now!. |
||||||||||||||
| 9 | RoboGen ROBOTS.TXT Editor 1.52 |
windows | Network Internet->Web Searching Tools | $24 |
View Detail
|
|||||||||
RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public. RoboGen does this by providing the user a way to log onto his FTP server and then select the documents and directories which are not to be made searchable. RoboGen maintains a database of over 180 search engine user-agents, which are selectable from a drop down menu. |
||||||||||||||
| 10 | Robots.Txt Generator Software 1.0 |
windows | Network Internet->Web Searching Tools | $19 |
View Detail
|
|||||||||
Robots.Txt Generator Software is a must have tool for all Webmasters. The software generates a .txt file contain over 400 search engine. You can block or give permision for scanning or indexing your Web site. It is very usefull to block bad Web robots scanning your Web site and colecting email addresses. This version contain only 12 robots. |
||||||||||||||
| 11 | Oven Fresh Robots Txt Maker 3.0 |
windows | Web Development->Web Design Tools | $9 |
View Detail
|
|||||||||
With the help of Oven Fresh Robots Txt Maker you will discover how easy it is to make your robots.txt file. Just fill in simple form fields and Oven Fresh Robots Txt Maker will generate the code for you. Here are some key features of "Oven Fresh Robots Txt Maker": · Easy Step-By-Step Instructions · Make a robots.txt file by filling in simple form fields · Popular user agent list · Selection of frequently used comments · Easy to add directories · Add files quickly · Comprehensive Help documentation · Priority Email Support |
||||||||||||||
| 12 | Oven Fresh Robots Txt Maker Pro 3.0 |
windows | Web Development->Web Design Tools | $15.95 |
View Detail
|
|||||||||
You can make, save, and upload your robots.txt file in no time at all with Robots Txt Maker Pro. Help prevent the indexing of your files and directories that if indexed by themselves could frustrate a viewers search experience and possibly alienate them. For instance, a viewer could become discouraged after clicking on a link that only shows your photos without any way to reach your web site. Try It Now! |
||||||||||||||
| 13 | Oven Fresh Robots Txt Maker 1.5 |
windows | Web Development->Web Design Tools | $9.95 |
View Detail
|
|||||||||
For example, a visitor becomes discouraged after clicking on a link from a search engine database that only shows your photos without any way to reach your web site. Just fill in simple form fields and Robots Txt Maker will generate the code for you. Copy and Paste the code into a standard text editor, name it "robots.txt", and upload it to the root directory of your web server. As long as you have some basic knowledge of how to edit your web page, you can make a robots.txt file for your web site in no time at all. |
||||||||||||||
| 14 | Oven Fresh Robots.txt Maker 3.5 |
windows | Web Development->HTML Editors | $15.95 |
View Detail
|
|||||||||
Make a Website Robots.txt File Easily. No experience needed. Protect your private files from being indexed by search engine robots. Dont let visitors become discouraged after clicking on a link from a search engine database that only shows your photos or private pages without any way to reach your Website. Take steps now to prevent robots from indexing files that could frustrate a viewers search experience and possibly alienate them. Using Robots.txt Maker will help you make a professional Website robots.txt file in minutes. Easily save the robots.txt file to disk. Requirements: Win2000, WinXP, WinVista - 3.7MB Hard Space Whats new in this version: New Features: Easy on the eye interface, reduced size. . |
||||||||||||||
| 15 | Robot-Manager Standard Edition 1.0 |
windows | Software Development->Misc Programming Tools | $59.95 |
View Detail
|
|||||||||
Web Spider Software The premier web spider software that helps you streamline and enhance your search engine optimization efforts. Easily generate industry standard robots.txt files Identify malicious and unwanted spiders and exclude them from your site Direct search engine spiders to correct content for multi lingual sites Keep spider our of sensitive and private areas of your web site Uploads the correctly formatted robots.txt file to your web site Robot-Manager Standard is a specialized web spider software you can use to precisely direct search engine robots and spiders to the pages which enhance your overall theme, thus eliminating pages which might dilute your search term relevancy. Key Features of the Standard Edition Automatically creates correctly formatted, industry standard Robot Exclusion Files in real-time Uploads the robots.txt file to your web server Allows you to manually edit the robots.txt file and export those changes Allows grouping of spiders with similar attributes for smaller robots.txt files Reads your web site structure either locally or from the web server Database of most major US and international spider user-agent identifiers Allows you to Add, Edit, and Delete your own spiders Can be used in some situations to direct search engine spiders to optimized pages Easy-to-learn-and-use step-by-step user interface with Quick Help |
||||||||||||||
| 16 | Chilkat Spider ActiveX 1.1.0 |
windows | Software Development->Components Libraries | Free |
View Detail
|
|||||||||
Chilkat Spider ActiveX is a web crawler component. It will help you create programs to spider a site. robots.txt compliant. |
||||||||||||||
| 17 | Robot-Analyzer Professional 2.1 |
windows | Web Development->Website Promotion | $179.95 |
View Detail
|
|||||||||
|
||||||||||||||
| 18 | Spider Trap |
script | PHP | Free |
View Detail
|
|||||||||
|
||||||||||||||
| 19 | Web Bot Programming Library 1.0.0 |
windows | Software Development->File Editors | $0 |
View Detail
|
|||||||||
Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance. Whats new in this version: None |
||||||||||||||
| 20 | Chilkat Spider ActiveX 1.0.0 |
windows | Software Development->File Editors | $0 |
View Detail
|
|||||||||
Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance. Whats new in this version: None |
||||||||||||||
My Software
You have not saved any software. Click "Save" next to each software to save it to your software basket
- robots.txt editor
- robots.txt
- robots.txt generator
- robots.txt file
- robots.txt maker
- search engine optimization
- search engine indexation
- robots index exclusion
- spider instructions
- site optimization
- log file analysis
- robot exclusion
- robot meta tag
- martijn koster
- search engine