Web data extraction
-
Scheduling
If you require us to monitor and refresh the data we will revisit at a frequency that you tell us.
-
Notifications
As soon as information changes, or new data is added, we will let you know.
-
Data Delivery
We provide all of the data in a structured format or can provide a 'feed' of information that will integrate with your internal systems
Whether you are looking for a one-off project to gather data from multiple website or if you require crawling combined with monitoring for changes then we can provide you with a solution.
Some examples of what we have done are below
Monitoring court databases
One of the leading legal software suppliers in the UK asked us to monitor several online court databases for updates and changes, which happen on a regular basis. It was proving impossible for an individual to know when a court's information changed. We created a system to monitor this information, to alert when anything changed and provide a comprehensive online database for our client to use.
Monitoring for new cars for sale
We created a tool to monitor various online car sales websites to look for new specific cars listed by private buyers. The tool needed to be sophisticated enough to know when a car had been listed previously as well as to discount professional sellers, such as car dealerships. When a new car was found we automatically provide an alert and a link to the client via email as well as SMS.
Lead Generation
For one of our clients we monitor specific discussion forums relating to their industry. We look for mentions of either their brand name, product names or the names of competitor products. This is used as lead generation, as well as brand protection, linking to potential customers.