I need to capture product data from a site on a regular basis and wondered if any one knows of a good software program? I've trialed Mozenda but its a monthly subscription and pricey in the long term. Obviously something thats free would be best but I don't mind paying either. Just need a decent program thats reliable and doesn't require much programming knowledge.
You can try ScraperWiki.com if you know python.
I've experimented with Screen-Scraper and found it easy to use. The application comes in multiple versions: basic (which is free), professional, and enterprise. Also, multiple platforms are supported.
Hire a programmer to do it so that there is only a one off cost. I often see similar projects on freelancing websites like Elance and oDesk.
I really like iMacros. You can give it a test drive to see if it meets your needs with the totally free Firefox extension (there's also IE versions), but there are also more full featured application and "server" versions that have more features and ability to do thing in an unattended manner.
Here are some other alternatives to consider:
License the data from the provider. Call em up and ask 'em.
Use Amazon Mechanical Turk to get humans to copy and paste and format it for ya. They are cheap.
For automation, it depends on how complicated the HTML is and how often it changes. You could use Excel's Web Data Import if it's really simple.
You can use irobot from IRobotSoft, which is totally free, and provides more functionalityies than other paid software. Watch demos here http://irobotsoft.com/help/ for how simple it is.
Questions on their forum were answered very quickly.
Source: http://stackoverflow.com/questions/2334164/a-good-web-data-extraction-screen-scraper-program
No comments:
Post a Comment