Comments for ScraperWiki Data Blog http://blog.scraperwiki.com A blog about ScraperWiki and all things data Thu, 09 Feb 2012 04:40:59 +0000 hourly 1 http://wordpress.com/ Comment on Why the Government scraped itself by steve white http://blog.scraperwiki.com/2011/06/13/why-the-government-scraped-itself/#comment-1493 Thu, 09 Feb 2012 04:40:59 +0000 http://blog.scraperwiki.com/?p=758214953#comment-1493 hmm is the theory the personell and details will change more often then the site structure, that justify the effort of writing scrapers of the gov sites

]]> Comment on Big fat aspx pages for thin data by P http://blog.scraperwiki.com/2012/02/07/big-fat-aspx-pages-for-thin-data/#comment-1488 Wed, 08 Feb 2012 03:23:29 +0000 http://blog.scraperwiki.com/?p=758216287#comment-1488 Yes that website was pretty awful. That’s just about what I would expect from a state government website though.

]]> Comment on How to get along with an ASP webpage by Big fat aspx pages for thin data | ScraperWiki Data Blog http://blog.scraperwiki.com/2011/11/09/how-to-get-along-with-an-asp-webpage/#comment-1486 Tue, 07 Feb 2012 06:06:15 +0000 http://blog.scraperwiki.com/?p=758215794#comment-1486 [...] this point it’s worth a recap on how to get along with an asp webpage, because that is what this [...]

]]> Comment on 100 Years of history…and I just hope that we do it justice… by Big fat aspx pages for thin data | ScraperWiki Data Blog http://blog.scraperwiki.com/2012/02/02/100-years-of-history-and-i-just-hope-that-we-do-it-justice/#comment-1485 Tue, 07 Feb 2012 06:06:13 +0000 http://blog.scraperwiki.com/?p=758216222#comment-1485 [...] Go to ScraperWiki.com → ← 100 Years of history…and I just hope that we do it justice… [...]

]]> Comment on Journalism Data Camp NY potential data sets by pallih http://blog.scraperwiki.com/2012/02/02/journalism-data-camp-ny-potential-data-sets/#comment-1416 Fri, 03 Feb 2012 19:44:02 +0000 http://blog.scraperwiki.com/?p=758216196#comment-1416 A while back I wrote a scraper for accident reports in Iceland:

https://scraperwiki.com/scrapers/umferdarslys/

]]> Comment on Journalism Data Camp NY potential data sets by 100 Years of history…and I just hope that we do it justice… | ScraperWiki Data Blog http://blog.scraperwiki.com/2012/02/02/journalism-data-camp-ny-potential-data-sets/#comment-1409 Thu, 02 Feb 2012 22:19:43 +0000 http://blog.scraperwiki.com/?p=758216196#comment-1409 [...] Go to ScraperWiki.com → ← Journalism Data Camp NY potential data sets [...]

]]> Comment on How to scrape and parse Wikipedia by Chris Davis http://blog.scraperwiki.com/2011/12/07/how-to-scrape-and-parse-wikipedia/#comment-1398 Fri, 27 Jan 2012 08:32:30 +0000 http://blog.scraperwiki.com/?p=758215842#comment-1398 Waiting 6 months for the latest DBpedia update isn’t a concern any more. They have a version that is being synchronized live with Wikipedia now – see http://live.dbpedia.org/.

I agree with the criticism about how semantic web applications sometimes assume far too clear boundaries between entities. However, this isn’t an inherent problem with DBpedia since they’ve basically outsourced the task of creating entity definitions to the Wikipedia community. The only way they would show these caves being connected together in one system was if people on Wikipedia said that they were.

In practical terms, I think that ScraperWiki can still be an awesome tool for scraping Wikipedia since the DBpedia parser does sometimes have problems parsing certain fields, and I don’t think they have very good support yet for parsing tables.

]]> Comment on The long dark tea time of the computer programmer by Jason Chown http://blog.scraperwiki.com/2012/01/13/the-long-dark-tea-time-of-the-computer-programmer/#comment-1374 Fri, 13 Jan 2012 13:31:49 +0000 http://blog.scraperwiki.com/?p=758216075#comment-1374 I think Douglas Adams already pointed out the incomputability of making a good cup of tea!

Seriously though: Games development is in some respects actually much harder (and requires much deeper understanding) than robotics. In a game you would have to model the physics of the fluid in the cup (using Navier-Stokes equations) as well as program a virtual robot that is able to do what your physical robot would do…

]]> Comment on Scraping the protests with Goldsmiths by Contenidosenred. Comunicación, contenidos y edición digital http://blog.scraperwiki.com/2011/12/09/scraping-the-protests/#comment-1373 Thu, 12 Jan 2012 12:38:13 +0000 http://blog.scraperwiki.com/?p=758215974#comment-1373 [...] Un ejemplo es este mapa que fué realizado a partir de tal sólo 3 artículos de Wikipedia, tal y como lo explica el equipo de ScraperWiki en este artículo. [...]

]]> Comment on CIJ Workshop in Blog Form! by tlee http://blog.scraperwiki.com/2011/07/21/cij-workshop-in-blog-form/#comment-1364 Sun, 08 Jan 2012 02:14:43 +0000 http://blog.scraperwiki.com/?p=758215133#comment-1364 Another pretty comprehensive SQL tutorial is at http://www.1keydata.com/sql/sql.html

]]>