{"id":640,"date":"2007-10-11T01:25:36","date_gmt":"2007-10-11T06:25:36","guid":{"rendered":"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard"},"modified":"2007-10-15T01:30:48","modified_gmt":"2007-10-15T06:30:48","slug":"moving-to-another-shard","status":"publish","type":"post","link":"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard","title":{"rendered":"Moving to another shard"},"content":{"rendered":"<p>I must be moving to another shard, having outgrown my current one. Its a <a href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/04\/25\/federation-at-flickr-a-tour-of-the-flickr-architecture\">manual operation<\/a>.<\/p>\n<div align=\"center\"><img decoding=\"async\" src=\"https:\/\/i0.wp.com\/www.bytebot.net\/shots\/flickr-db-migration.png\" data-recalc-dims=\"1\" \/><br \/><i>Flickr tells me they&#8217;re moving my stuff around<\/i><\/p>\n<div align=\"left\">Incidentally, I can&#8217;t sign out. Or view the main page. Or any of the groups I&#8217;m subscribed to. Its completely locked. But it does take under-15 minutes&#8230; (at least for the load I have &#8211; ~11,500 images).<\/div>\n<\/div>\n<p><b>Update:<\/b> Read <a href=\"http:\/\/kitchensoap.com\/\">John Allspaw<\/a>&#8216;s comments at the <a href=\"http:\/\/highscalability.com\/how-flickr-handles-moving-you-another-shard\">HighScalability link<\/a> to this blog post. He&#8217;s in-charge of operations, and an all round nice guy, and great presenter.<\/p>\n<p>Technorati Tags: <a class=\"performancingtags\" href=\"http:\/\/technorati.com\/tag\/flickr\" rel=\"tag\">flickr<\/a>, <a class=\"performancingtags\" href=\"http:\/\/technorati.com\/tag\/shard\" rel=\"tag\">shard<\/a>, <a class=\"performancingtags\" href=\"http:\/\/technorati.com\/tag\/moving\" rel=\"tag\">moving<\/a><\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20Moving%20to%20another%20shard&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2007%2F10%2F11%2Fmoving-to-another-shard&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"7e911eece1\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-640\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-640\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-640\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>I must be moving to another shard, having outgrown my current one. Its a manual operation. Flickr tells me they&#8217;re moving my stuff around Incidentally, I can&#8217;t sign out. Or view the main page. Or any of the groups I&#8217;m subscribed to. Its completely locked. But it does take under-15 minutes&#8230; (at least for the [&hellip;]<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20Moving%20to%20another%20shard&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2007%2F10%2F11%2Fmoving-to-another-shard&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"7e911eece1\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-640\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-640\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-640\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2007\/10\/11\/moving-to-another-shard?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_options":[]},"categories":[23],"tags":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4vJD-ak","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":533,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2007\/04\/25\/federation-at-flickr-a-tour-of-the-flickr-architecture","url_meta":{"origin":640,"position":0},"title":"Federation at Flickr: A tour of the Flickr Architecture","date":"25\/4\/2007","format":false,"excerpt":"I've always been a big Flickr fan, and user, and love them even more now that their 2GB limit is gone. So this was a most interesting talk, and I think photographers and Flickr users alike will find it interesting what's behind Flickr. Dathan also has a very interesting blog.\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1595,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2009\/10\/14\/flickrs-upgraded-shard","url_meta":{"origin":640,"position":1},"title":"Flickr&#8217;s upgraded shard","date":"14\/10\/2009","format":false,"excerpt":"While going about my day, I stumbled upon John Allspaw's tweet about his experience with MySQL 5.0.51 versus Percona's 5.0.83 highperf Percona build. For those that don't remember John from the MySQL Conference & Expo's, he's the guy managing operations at Flickr, and he recently even wrote a book about\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2250,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2012\/02\/05\/sphinx-user-stories-by-stephane-varoqui","url_meta":{"origin":640,"position":2},"title":"Sphinx user stories by St\u00c3\u00a9phane Varoqui","date":"5\/2\/2012","format":false,"excerpt":"Stephane Varoqui, Field Services SkySQL, Vlad Fedorkov, Director of PS, Sphinx Inc, Christophe Gesche, LAMP Expert, Delcampe, Herve Seignole, Web Architect, Groupe Pierre & Vacances Center Parcs - this is a big talk! Pros: Filtering takes place on attributes in separate tables. Rely on the optimizer choice. HASH JOIN can\u2026","rel":"","context":"In &quot;MariaDB&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2262,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2012\/02\/05\/building-simple-complex-replication-clusters-with-tungsten-replicator-by-giuseppe-maxia","url_meta":{"origin":640,"position":3},"title":"Building simple &#038; complex replication clusters with Tungsten Replicator by Giuseppe Maxia","date":"5\/2\/2012","format":false,"excerpt":"Giuseppe Maxia of Continuent. MySQL replication is single threaded. Multi-master replication is complex with MySQL. Circular replication works but is very fragile. Once you've achieved the feat, how do you avoid conflicts? The lack of global transaction ID today also means you may have slaves that may not be synchronized\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":537,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2007\/04\/26\/mysql-at-google","url_meta":{"origin":640,"position":4},"title":"MySQL at Google","date":"26\/4\/2007","format":false,"excerpt":"MySQL: The Real Grid Database, Mark Callaghan, Chip Turner A tremendous amount of work also done by Wei Li and Gene Pang. Google has a large MySQL deployment, and they enhance it as needed. MySQL@Google: too many queries, transactions, data, and rapid growth. Real workload with OLTP and reporting. Workload\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3478,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2019\/07\/31\/moving-images-from-an-iphone-quickly","url_meta":{"origin":640,"position":5},"title":"Moving images from an iPhone quickly","date":"31\/7\/2019","format":false,"excerpt":"Wanted to move 60GB of photos from an iPhone to the Mac. It turns out that Dropbox does not save Live Photos, Google Photos does, but it is all in reduced size (unless you pay them). Extraction via Image Capture was taking forever. Had to make sure on the iPhone,\u2026","rel":"","context":"In &quot;Tech&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"amp_enabled":true,"_links":{"self":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/640"}],"collection":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/comments?post=640"}],"version-history":[{"count":0,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/640\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/media?parent=640"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/categories?post=640"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/tags?post=640"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}