{"id":2616,"date":"2012-12-30T18:05:40","date_gmt":"2012-12-30T23:05:40","guid":{"rendered":"http:\/\/www.bytebot.net\/blog\/?p=2616"},"modified":"2012-12-30T18:05:40","modified_gmt":"2012-12-30T23:05:40","slug":"open-data-becoming-open-information","status":"publish","type":"post","link":"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information","title":{"rendered":"Open data becoming open information"},"content":{"rendered":"<p>Many talk about open data, but many don&#8217;t realize the power it has to convert open data into open information. An example of this is what has happened recently in New York: <a href=\"http:\/\/www.usatoday.com\/story\/news\/nation\/2012\/12\/26\/gun-database-draws-criticism\/1791507\/\">newspaper&#8217;s gun owner database draws criticism<\/a>.<\/p>\n<p>The article is provocative:\u00a0<a href=\"http:\/\/www.lohud.com\/article\/20121224\/NEWS04\/312240045\/The-gun-owner-next-door-What-you-don-t-know-about-weapons-your-neighborhood\">The gun owner next door: What you don&#8217;t know about the weapons in your neighborhood<\/a>. The converted data, taken from public sources via a Freedom of Information Act (FOIA) request, is placed as overlays into Google Maps to form information in\u00a0<a href=\"http:\/\/www.lohud.com\/interactive\/article\/20121223\/NEWS01\/121221011\">Map: Where are the gun permits in your neighborhood?<\/a><\/p>\n<p>The USA is a great nation because it has the FOIA. In Malaysia, we&#8217;ve been trying to get a FOIA only to be told its not required and a Whistleblower&#8217;s Act is better. Having an FOIA with a standard reporting set can ensure we can build maps of dengue hotspots, look at trends if neighborhoods are safe or if crime is increasing, etc. Instead we have a Home Minister saying his crime stats are correct and we should just believe him, yet everyone knows someone that&#8217;s been a victim of crime. Its disgusting, but I digress.<\/p>\n<p>This isn&#8217;t a post about gun laws either. People die with or without guns, but massacres only seem to happen in America. Malaysians get gunned down despite illegal possession of a gun probably equating you to receiving the death penalty. Go figure.<\/p>\n<p>This is about open data becoming open information. Gun owners could never guess that their details would be pasted online. They submit data when they renew their gun permits. Anyone can ask for this data, compile it, add it on an overlay with something modern like Google Maps, and publish this as information.<\/p>\n<p>I understand that sexual offenders get on a registry, and this information is also available as a matter of public record.<\/p>\n<p>Data by itself means little to many. But in the hands of a data scientist, it gets converted to useful information, infographics, et al. Is it bad that thieves today can know which house to potentially rob? Is it good that you don&#8217;t send your kids to your neighbors house because there are guns in it?<\/p>\n<p>There are many other examples where I can see usefulness in having open data becoming open information. Think about having the CV of every member of parliament available as a matter of public record. I&#8217;d like to know if I&#8217;m more intelligent than the average politician (in Malaysia I estimate that the average person in the Klang Valley is more educated than about 70% of politicians). Imagine knowing if your public servant has served you well in the last five years, because people had access to a public repository of complaints that each was meant to take up on (this comes from opening up the hansard).\u00a0<\/p>\n<p>When you play around with information, you can skew it. This is what the (controlled) media and politicians do in Malaysia. This is why its important that the data used to create the information is open as well. If the data is open, people can independently conclude that the information is correct. Or can always question it. Not everyone I expect will do this, and I believe the 1%-10%-rest rule applies: 1% will convert data into information, 10% will decide what information to spread, and the rest will just believe this.<\/p>\n<p>This is a great contrast to how regimes control the media and expect 1% to feed 99% of the information.\u00a0<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20Open%20data%20becoming%20open%20information&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2012%2F12%2F30%2Fopen-data-becoming-open-information&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"ba0d49c451\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-2616\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-2616\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-2616\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Many talk about open data, but many don&#8217;t realize the power it has to convert open data into open information. An example of this is what has happened recently in New York: newspaper&#8217;s gun owner database draws criticism. The article is provocative:\u00a0The gun owner next door: What you don&#8217;t know about the weapons in your [&hellip;]<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20Open%20data%20becoming%20open%20information&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2012%2F12%2F30%2Fopen-data-becoming-open-information&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"ba0d49c451\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-2616\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-2616\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-2616\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2012\/12\/30\/open-data-becoming-open-information?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_options":[]},"categories":[1],"tags":[1475],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4vJD-Gc","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":440,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2006\/11\/02\/core-data-and-mysql-as-a-data-store","url_meta":{"origin":2616,"position":0},"title":"Core Data and MySQL as a data store?","date":"2\/11\/2006","format":false,"excerpt":"I've been thinking a lot about Core Data recently. It supports SQLite out of the box, and its rather scalable and fast. Main reason being sqlite3 is included on every desktop and server of OS X that has shipped since 10.4 (Tiger). It got me thinking about using MySQL as\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3357,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2017\/05\/22\/uber-data-extractor","url_meta":{"origin":2616,"position":1},"title":"Uber Data Extractor","date":"22\/5\/2017","format":false,"excerpt":"This is pretty cool: Uber Trip History Bookmarklet. It allows you to get your complete Uber trip history, download it as a CSV file, and then run the Uber Data Visualiser. You get to learn quite a bit about your trips. I\u2019ve attached a snapshot of mine, there\u2019s more data\u2026","rel":"","context":"In &quot;Tech&quot;","img":{"alt_text":"Uber Data Visualizer","src":"https:\/\/i0.wp.com\/www.bytebot.net\/blog\/wp-content\/uploads\/2017\/05\/Uber_Data_Visualizer.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":2945,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2014\/07\/06\/keeping-citizens-data-in-local-data-centers","url_meta":{"origin":2616,"position":2},"title":"Keeping citizens data in local data centers","date":"6\/7\/2014","format":false,"excerpt":"Moscow has just made waves by trying to tell web services at personal data of local Russians needs to be stored on Russian soil - see: Moscow seeks to tighten grip online (it's an FT link which is behind a paywall, but surely a search will find similar articles). Not\u2026","rel":"","context":"In &quot;General&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":567,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2007\/06\/09\/expresscard-for-data-virgin-postpaid-for-the-cheapest-mobile-data-option","url_meta":{"origin":2616,"position":3},"title":"ExpressCard for data + Virgin postpaid for the cheapest mobile data option?","date":"9\/6\/2007","format":false,"excerpt":"Reading Dave Hall's experience with 3, I can attest to their horrendous service. I never looked at Virgin offering cheap rates, but from their website, it seems that on a post-paid account, I can get 300MB of data for $10\/month. I'm currently paying 3 $29 for 200MB of data (and\u2026","rel":"","context":"In &quot;General&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2150,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2011\/06\/14\/roaming-data","url_meta":{"origin":2616,"position":4},"title":"Roaming data","date":"14\/6\/2011","format":false,"excerpt":"My last few weeks have been spent in China, Korea and Japan. I've been roaming with my cellphone, with my data connection turned off. The question is for how long? It's interesting to note that in both China and Korea, you can roam, with unlimited data for about RM36\/day (USD$12).\u2026","rel":"","context":"In &quot;General&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1347,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery","url_meta":{"origin":2616,"position":5},"title":"On Ma.gnolia, and data recovery","date":"24\/2\/2009","format":false,"excerpt":"There's a good podcast from Chris Messina and Larry Halff, about what really happened at Ma.gnolia. If you're at all interested in what happened (i.e. how did they lose all their bookmark data), don't hesitate to watch the video. I took some quick notes: half a terabyte database file got\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"amp_enabled":true,"_links":{"self":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/2616"}],"collection":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/comments?post=2616"}],"version-history":[{"count":0,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/2616\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/media?parent=2616"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/categories?post=2616"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/tags?post=2616"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}