Visual Web Ripper 2

Visual Web Ripper can automatically walk through whole web sites and collect complete content structures such as product catalogues or search results, and save the content in a database or as XML.

Visual Web Ripper can collect content on a scheduled basis, so your collected content will always be up-to-date.

The Visual Web Ripper programming interface provides full access to every single feature in Visual Web Ripper, so you can create and modify projects, or run a project and access collected data directly.

Do you have to extract large amounts of data from various web sites but manual copy-and-paste operations would take forever? Then it’s time to try Visual Web Ripper! It’ll automate the data extraction process and let you save extracted data to a database or as XML.

Visual Web Ripper runs as a Windows service that can collect content on a scheduled basis, so your collected content will always be up-to-date. For example, you could extract currency rates from a website on a daily basis and always have up-to-date currency rates in your database.

Visual Web Ripper is very easy to use because of the visual designer that allows users to collect content by simply clicking on the content elements they want to extract. The visual designer, data collector and scheduler combines into a very powerful ready-to-use application, but you can take things a step further and obtain complete control of the application by using the programming API.

If you have .NET programming skills you can bring the full power of Visual Web Ripper straight into your own applications. The Visual Web Ripper programming interface provides full access to every single feature in Visual Web Ripper, so you can create and modify projects, or run a project and access collected data directly before it is even saved in your database or written to XML.

Major Features:

1. Visual Web Ripper has a visual editor to define projects and templates. You use a mouse to click on the content you want to collect, so no coding is required.
2. Visual Web Ripper can automatically walk through whole web sites and collect complete content structures such as product catalogues or search results
3. Visual Web Ripper can walk through a website just as you would when using a normal Internet browser, so AJAX and other javascripts are fully supported.
4. Visual Web Ripper has a fast multi-threaded data collector for web sites where AJAX is not required for data extraction.
5. Visual Web Ripper can repeatedly submit forms for all possible combinations of input values in dropdown boxes, or you can supply a list of input values by yourself.
6. You can supply parameter data from a database, such as form input values or URLs that should be visited.
7. You can schedule content extraction to keep data up-to-date. The scheduler includes email notification, logging and status screens.
8. Advanced selection techniques make project templates more resistant to structural changes on web pages, so a scheduled project can keep collecting data even if the structure of a web pages changes slightly.
9. Email notifications can be sent out if the structure of a webpage changes so significantly that you must modify the scheduled project to continue extracting content from the webpage.
10. You can collect many different types of content, such as text, links, images, files, meta tags, tag attributes and many more.
11. Visual Web Ripper supports AJAX and other javascripts, so now you can collect content from all these cool websites that are fully AJAX enabled.
12. You can save extracted content in a SQL Server database or as XML. You can also save the data in an internal memory structure that can be used in conjunction with the API.
13. You can use custom post-processing modules (.NET assemblies) to post-process data after it has been extracted. Custom modules are automatically triggered after a project has run.
14. Visual Web Ripper includes a powerful API. You can use the API to modify and run projects from within your own applications, or use the API in conjunction with a post-processing module to easily post-process collected data.
15. The Visual Web Ripper installer package includes examples showing how to build custom post-processing modules and how to use the API.