{"id":1347,"date":"2009-02-24T10:09:28","date_gmt":"2009-02-24T15:09:28","guid":{"rendered":"http:\/\/www.bytebot.net\/blog\/?p=1347"},"modified":"2009-02-24T10:09:28","modified_gmt":"2009-02-24T15:09:28","slug":"on-magnolia-and-data-recovery","status":"publish","type":"post","link":"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery","title":{"rendered":"On Ma.gnolia, and data recovery"},"content":{"rendered":"<p>There&#8217;s a good podcast from Chris Messina and Larry Halff, about <a href=\"http:\/\/factoryjoe.com\/blog\/2009\/02\/16\/what-really-happened-at-magnolia-and-lessons-learned\/\">what really happened at Ma.gnolia<\/a>. If you&#8217;re at all interested in what happened (i.e. how did they lose all their bookmark data), don&#8217;t hesitate to watch the video. I took some quick notes:<\/p>\n<ul>\n<li>half a terabyte database file got corrupted<\/li>\n<li>a mysql 5 database<\/li>\n<li>everything was running even though there was corruption, and eventually, the site went down<\/li>\n<li>backup system also failed, as it didn&#8217;t backup the data from mysql<\/li>\n<li>backup was just backing up corrupted data (file sync over a firewire network was the backup mechanism)<\/li>\n<li>a Rails application, he now recommends clouds over running your own infrastructure for startups<\/li>\n<li>a couple of xserves (for database, etc.) and four intel mac minis as front end web servers<\/li>\n<li>the site didn&#8217;t actually make any money<\/li>\n<\/ul>\n<p>So I don&#8217;t know if <a href=\"http:\/\/www.xaprb.com\/blog\/2009\/02\/19\/the-magnolia-data-might-not-be-permanently-lost\/\">Baron<\/a> can rescue Ma.gnolia, per se, but I think the problem was largely:<\/p>\n<blockquote><p>\nDoing a file sync over the Firewire network, as the backup mechanism\n<\/p><\/blockquote>\n<p>You can&#8217;t safely backup MySQL that way. I don&#8217;t know what mechanism was used, but it sounds like rsync, and as much as I love rsync, I wouldn&#8217;t use it to backup a live running MySQL database that way.<\/p>\n<p>With two servers, there should have been MySQL replication.<\/p>\n<p>I&#8217;m curious if the data recovery Baron talks about is that of using the utility <tt><a href=\"http:\/\/www.gnu.org\/software\/ddrescue\/ddrescue.html\">ddrescue<\/a><\/tt>? After all, ddrescue gets the raw data off the block device, without even trying to mount it. After that, you can attempt to recover the MySQL data off disk. In fact, I was surprised that the Ubuntu folk have a very nice <a href=\"https:\/\/help.ubuntu.com\/community\/DataRecovery\">Data Recovery<\/a> page &#8211; no information about extracting MySQL databases, but its nothing a little hackery won&#8217;t get you.<\/p>\n<p>I tried to ping Larry on Twitter, to ask what engine they were using&#8230; No response, per se. Good luck, and I hope the users get their data back, in time!<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20On%20Ma.gnolia%2C%20and%20data%20recovery&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2009%2F02%2F24%2Fon-magnolia-and-data-recovery&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"6e8be351fb\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-1347\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-1347\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-1347\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>There&#8217;s a good podcast from Chris Messina and Larry Halff, about what really happened at Ma.gnolia. If you&#8217;re at all interested in what happened (i.e. how did they lose all their bookmark data), don&#8217;t hesitate to watch the video. I took some quick notes: half a terabyte database file got corrupted a mysql 5 database [&hellip;]<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20On%20Ma.gnolia%2C%20and%20data%20recovery&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2009%2F02%2F24%2Fon-magnolia-and-data-recovery&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"6e8be351fb\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-1347\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-1347\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-1347\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/24\/on-magnolia-and-data-recovery?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_options":[]},"categories":[23],"tags":[517,767,768,766,1775,187],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4vJD-lJ","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":809,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2008\/05\/03\/playing-with-mysqls-online-backup","url_meta":{"origin":1347,"position":0},"title":"Playing with MySQL&#8217;s Online Backup","date":"3\/5\/2008","format":false,"excerpt":"Something that has excited me for a long time with upcoming features in the MySQL Server, is online backup. Since seeing it first being demonstrated by Chuck Bell at the Heidelberg Developers Conference in 2007, I've been enthralled. Now you too, can try online backup. If you've not read the\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3491,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2019\/11\/10\/database-tab-sweep","url_meta":{"origin":1347,"position":1},"title":"Database Tab Sweep","date":"10\/11\/2019","format":false,"excerpt":"I miss a proper database related newsletter for busy people. There\u2019s so much happening in the space, from tech, to licensing, and even usage. Anyway, quick tab sweep. Paul Vall\u00e9e (of Pythian fame) has been working on Tehama for sometime, and now he gets to do it full time as\u2026","rel":"","context":"In &quot;MongoDB&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2253,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2012\/02\/05\/mysql-ha-reloaded-by-ivan-zoratti","url_meta":{"origin":1347,"position":2},"title":"MySQL HA reloaded by Ivan Zoratti","date":"5\/2\/2012","format":false,"excerpt":"MySQL HA reloaded - old tricks and cool new tools to guarantee high availability to your MySQL Servers by Ivan Zoratti of SkySQL. This talk is a little longer, so check out: HA Reloaded - many ways to provide High Availability. The slides are already online. Questions to ask: which\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1308,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2009\/02\/06\/incremental-backup-that-uses-mysql","url_meta":{"origin":1347,"position":3},"title":"Incremental backup that uses MySQL","date":"6\/2\/2009","format":false,"excerpt":"A while back, Ted Ts'o asked for a incremental backup solution that used a database. It reminded me of the talk at the 2009 MySQL Conference & Expo, titled Build your own MySQL time machine. Chuck and Mats will talk about the backup and replication code, and will show off\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1638,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2010\/01\/12\/some-mysql-related-links","url_meta":{"origin":1347,"position":4},"title":"Some MySQL-related links","date":"12\/1\/2010","format":false,"excerpt":"Check out how Linden Labs, creators of the popular game Second Life, upgraded their MySQL database. The MySQL they use? Straight out of Debian! Of course, now, they're running with the Percona patchset, against MySQL 5.0.84. Definitely a good read. Its good to see Lars post about contributing to the\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":961,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2008\/08\/26\/a-video-of-online-backup","url_meta":{"origin":1347,"position":5},"title":"A video of online backup","date":"26\/8\/2008","format":false,"excerpt":"Robin just wrote a new article, titled A Quick Look at MySQL 6.0's New Backup, and I thought, that maybe you'd like to also see this in presentation\/video format... At OSCON, Giuseppe actually gave a quick talk at the Sun booth, about our online backup. He also showed how to\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"amp_enabled":true,"_links":{"self":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/1347"}],"collection":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/comments?post=1347"}],"version-history":[{"count":1,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/1347\/revisions"}],"predecessor-version":[{"id":1348,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/1347\/revisions\/1348"}],"wp:attachment":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/media?parent=1347"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/categories?post=1347"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/tags?post=1347"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}