Category Archives: journalism

Journalism Data Camp NY potential data sets

Here is a review of some of the datasets that have been submitted for the Columbia Journalism Data Camp this Friday. This list is only for backup in case not enough ideas show up with people on the day (never … Continue reading

Posted in developer, events, journalism | 2 Comments

“the impact on our industry only begins this weekend” says Susan E McGregor, Professor at the world’s foremost school of journalism

This is a guest blog post by Susan E. McGregor – Assistant Professor at the Tow Center for Digital Journalism Columbia University The Tow Center for Digital Journalism at Columbia University Graduate School of Journalism is proud to be partnering … Continue reading

Posted in events, journalism | Tagged , , | Leave a comment

Scraping the protests with Goldsmiths

Zarino here, writing from carriage A of the 10:07 London-to-Liverpool (the wonders of the Internet!). While our new First Engineer, drj, has been getting to grips with lots of the under-the-hood changes which’ll make ScraperWiki a lot faster and more … Continue reading

Posted in developer, events, journalism | Tagged , , , , , | 1 Comment

Which witch is which?

I hope you all had a spooky Halloween and have gorged yourselves on candy. In keeping with the festive cheer, The Guardian Datastore has hopped aboard and with a digger in resident, Chris Blower, and scraped the court cases of … Continue reading

Posted in journalism | Tagged , , , , , | Leave a comment

Diggers and Dinosaurs – Scraping at the Mozilla Festival

In a complete paradigm shift of the epic battle between Godzilla and Mothra we are turning our backs on the old claymation medium and embracing the digital age where dinosaurs and diggers (yes, I am aware we are a machine … Continue reading

Posted in events, journalism | Tagged , , , , , , | 1 Comment

Start Talking to Your Data – Literally!

Because ScraperWiki has a SQL database and an API with SQL extraction, I can SQL inject (haha!) straight into the API URL and use the JSON output. So what does all that mean? I scraped the CSV files of Special … Continue reading

Posted in developer, journalism, video | Tagged , , | Leave a comment

ScraperWiki goes on the Records at The Texas Tribune

Here at ScraperWiki, we’ve got a good eye for data. Not just structuring, formatting and quality, but also where data can tell stories (hence the addition of views to the site). The decision to put a scraper of the Texas … Continue reading

Posted in journalism, news | Tagged , , , | Leave a comment

ScraperWiki Tutorial Screencast for Non-Programmers

If you’ve been going through our first ambitious tutorial and taster session for non-coders then good for you! I hope you found it enlightening. For those of you yet to try it, here it is. It is a step-by-step guide … Continue reading

Posted in journalism, video | Tagged , , | Leave a comment

CIJ Workshop in Blog Form!

Here’s an introduction to a little thing called ScraperWiki. Please watch it so that you don’t develop bad habits that could annoy the programmers you want helping you! OBJECTIVES FOR THIS WORKSHOP Have your own ScraperWiki account and understand all … Continue reading

Posted in events, journalism | Tagged , | 4 Comments

Investigative Journalism, ScraperWiki style!

Just to let all hacks and journo hackers out there know, we’ll be running a ScraperWiki workshop at the Centre for Investigative Journalism Summer School. So get tickets whilst you can! The lineup looks amazing and the ScraperWiki gurus Nicola … Continue reading

Posted in events, journalism | Tagged | Leave a comment