Blog

ScraperWiki Tutorial Screencast for Non-Programmers

If you’ve been going through our first ambitious tutorial and taster session for non-coders then good for you! I hope you found it enlightening. For those of you yet to try it, here it is.

It is a step-by-step guide so please give it a go and don’t just try and follow the answers as you’ll learn more from rummaging around out site. Also check out the introductory video at the start of the tutorial if you’re not familiar with ScraperWiki. So don’t look at the answers which are in screencast form below unless you have had a go!

Here’s the twitter scraper and datastore download. This is the first part of the tutorial where you fork (make a copy of) a basic Twitter scraper, run it for your chosen query, download the data and schedule it to run at a frequency to allow the data to be refreshed and accumulated:

The next one is a SQL Query View which looks at the data with a journalistic eye in ScraperWiki. This is the second part of the tutorial where you look into a datastore using the SQL language and find out which are the top 10 publications receiving complaints from the Press Complaints Commission and also who are the top 10 making the complaints:

And last we show you how to get a live league table view that updates with a scraper. This is the final part of the tutorial where you make a live league table of the above query that refreshes when the original scraper updates:

If you have any questions please feel free to contact me nicola[at]scraperwiki.com. For full training sessions or scraping projects like OpenCorporates or AlphaGov contact aine[at]scraperwiki.com

Tags: , , ,

Trackbacks/Pingbacks

  1. Data Scraping Comes of Age With ScraperWiki.com – - Tech News AggregatorTech News Aggregator - February 24, 2012

    [...] you are interested in writing your own data scraping routines, you can watch several how-to screencasts on ScraperWiki here. You can program in php, Python, or Ruby. Most of the time you are gonna have to know some SQL code [...]