-
Recent Posts
Our Tweets
- $1 million to build a data platform - @scraperwiki closes new round of investment http://t.co/7KWdjVbb 16 hours ago
- If you are planning to come to #jdcdc at The Washington Post please just take 1 ticket - the streams all merge after the training sessions! 19 hours ago
- Blog by @slinkp23 on how he scraped public school budgets at #jdcny last Friday... and ate food! http://t.co/dEHoF1h9 1 day ago
- #Props to Dragon for #scraping #salaries of #SouthDakota #lobbyists https://t.co/s739Dbu9 2 days ago
- The extraordinary story of scraping New York State lobbying data from a crazy .aspx page http://t.co/UJjTCAo1 2 days ago
Find us on Facebook
Archives
Categories
Meta
Category Archives: journalism
Journalism Data Camp NY potential data sets
Here is a review of some of the datasets that have been submitted for the Columbia Journalism Data Camp this Friday. This list is only for backup in case not enough ideas show up with people on the day (never … Continue reading
Posted in developer, events, journalism
2 Comments
“the impact on our industry only begins this weekend” says Susan E McGregor, Professor at the world’s foremost school of journalism
This is a guest blog post by Susan E. McGregor – Assistant Professor at the Tow Center for Digital Journalism Columbia University The Tow Center for Digital Journalism at Columbia University Graduate School of Journalism is proud to be partnering … Continue reading
Scraping the protests with Goldsmiths
Zarino here, writing from carriage A of the 10:07 London-to-Liverpool (the wonders of the Internet!). While our new First Engineer, drj, has been getting to grips with lots of the under-the-hood changes which’ll make ScraperWiki a lot faster and more … Continue reading
Posted in developer, events, journalism
Tagged API, google maps, occupy, protests, views, wikipedia
1 Comment
Which witch is which?
I hope you all had a spooky Halloween and have gorged yourselves on candy. In keeping with the festive cheer, The Guardian Datastore has hopped aboard and with a digger in resident, Chris Blower, and scraped the court cases of … Continue reading
Posted in journalism
Tagged Chris Blower, DataBlog, Halloween, Lisa Evans, The Guardian, wtich
Leave a comment
Diggers and Dinosaurs – Scraping at the Mozilla Festival
In a complete paradigm shift of the epic battle between Godzilla and Mothra we are turning our backs on the old claymation medium and embracing the digital age where dinosaurs and diggers (yes, I am aware we are a machine … Continue reading
Posted in events, journalism
Tagged datajournalism, EJC, European Journalism Centre, mozfest, Mozilla Festival London 2011, OKFN, Open Knowledge Foundation
1 Comment
Start Talking to Your Data – Literally!
Because ScraperWiki has a SQL database and an API with SQL extraction, I can SQL inject (haha!) straight into the API URL and use the JSON output. So what does all that mean? I scraped the CSV files of Special … Continue reading
ScraperWiki goes on the Records at The Texas Tribune
Here at ScraperWiki, we’ve got a good eye for data. Not just structuring, formatting and quality, but also where data can tell stories (hence the addition of views to the site). The decision to put a scraper of the Texas … Continue reading
ScraperWiki Tutorial Screencast for Non-Programmers
If you’ve been going through our first ambitious tutorial and taster session for non-coders then good for you! I hope you found it enlightening. For those of you yet to try it, here it is. It is a step-by-step guide … Continue reading
CIJ Workshop in Blog Form!
Here’s an introduction to a little thing called ScraperWiki. Please watch it so that you don’t develop bad habits that could annoy the programmers you want helping you! OBJECTIVES FOR THIS WORKSHOP Have your own ScraperWiki account and understand all … Continue reading
Investigative Journalism, ScraperWiki style!
Just to let all hacks and journo hackers out there know, we’ll be running a ScraperWiki workshop at the Centre for Investigative Journalism Summer School. So get tickets whilst you can! The lineup looks amazing and the ScraperWiki gurus Nicola … Continue reading