{"id":790,"date":"2008-04-15T12:14:41","date_gmt":"2008-04-15T17:14:41","guid":{"rendered":"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels"},"modified":"2008-04-15T17:13:13","modified_gmt":"2008-04-15T22:13:13","slug":"ahead-in-the-cloud-by-verner-vogels","status":"publish","type":"post","link":"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels","title":{"rendered":"Ahead in the Cloud by Werner Vogels"},"content":{"rendered":"<p><strong>Ahead in the Cloud &#8211; The power of Infrastructure as a Service<\/strong><br \/>\nCTO Amazon.com, Dr. Werner Vogels<\/p>\n<p>Pretty much everyone in the audience uses Amazon!<\/p>\n<p>Announced: Persistent Storage for Amazon EC2.<\/p>\n<p>Hitting one page, might actually go to 250 different services, before the page is generated for you. Shows the use of a tool (Amazon internal), that graphs it.<\/p>\n<p>SaaS: Develop -> Test -> Operate<\/p>\n<p>Hardware costs? Software costs? Maintenance? Load balancing? Scaling? Utilisation? Idle machines? Bandwidth management? Server hosting? Storage management? High availability? All this is the differentiated heavy lifting that Amazon bases their services on.<\/p>\n<p>SaaS comes at a very big cost that you have to address.<\/p>\n<p>70\/30 switch: 30% of time, energy and dollars on differentiated value creation; 70% of time, energy and dollars on differentiated heavy lifting.<\/p>\n<p>At Amazon, we expect data centres to fail. But we also expect software to tolerate this failure.<\/p>\n<p>&#8220;Scalable Infrastructure that allows applications to meet infinite demand, cheaply and reliably&#8221; (statement, made with picture of large amount of Sun hardware)<\/p>\n<p>Amazon S3 (storage), SimpleDB, EC2 (computer power), FPS (payment service). All this is scalable (increase\/decrease capacity on demand).<\/p>\n<p>Scalability. Availability. Performance. Cost-Effectiveness.<\/p>\n<p>Growth: largest selection on earth, good customer experience, drives prices down, drives traffic, sellers, selection, and this is a cycle for growth. It brings a lower cost structure, that also lowers prices down then.<\/p>\n<p>This means that incremental scalability is key to Amazon&#8217;s business. Grow one step at a time, consistently. Turn a fixed cost, into a variable cost, as your business grows seamlessly.<\/p>\n<p>Elastic cloud: grow and shrink on demand, with minimal disruption to performance. Operational efficiency, fault-tolerant, and remember, everyone has different growth paths. Heterogeneity &#8211; do not believe that all your nodes have the same capacity! A year from now, you will have more powerful machines, your software must scale for this.<\/p>\n<p>Everything fails, all the time. An epic truth.<\/p>\n<p>Failures are highly correlated. By every possible worst way! Systems do not fail by stopping &#8211; they will fail by sending out garbage ;) Your system must be able to deal with that.<\/p>\n<p>Determinism is an illusion. An illusion created in a very small space. &#8220;Let go of control!&#8221;<\/p>\n<p>Engineer for performance at 99.9%. Remember, address uncertainty &#8211; acquire resources on demand, pay for what you use, leverage other&#8217;s core competencies, turn fixed costs into variable costs. Never every pay again for something sitting in your data centre doing nothing for you.<\/p>\n<p>All data access at Amazon is primary key based. Eventual consistent, for high read volume and always writeable. Query-based access, was non-relational.<\/p>\n<p>Primary Key Access: Amazon S3; Query-based Access: SimpleDB; EC2 with persistent storage for a dedicated solution<\/p>\n<p>Persistent storage? Raw disk, attach a volume to EC2. You can also detach. Infinite scalability in terms of data. From snapshots, you can create new volumes.<\/p>\n<p>&#8220;All you need is a credit card&#8221; &#8211; for AWS. Lots of laughter :)<\/p>\n<p>Technorati Tags: <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/keynote\">keynote<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/infrastructure\">infrastructure<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/amazon\">amazon<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/aws\">aws<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/mysql\">mysql<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/mysqluc08\">mysqluc08<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/mysqluc2008\">mysqluc2008<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/verner%20vogels\">verner vogels<\/a>, <a class=\"performancingtags\" rel=\"tag\" href=\"http:\/\/technorati.com\/tag\/saas\">saas<\/a><\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20Ahead%20in%20the%20Cloud%20by%20Werner%20Vogels&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2008%2F04%2F15%2Fahead-in-the-cloud-by-verner-vogels&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"da445166f7\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-790\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-790\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-790\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Ahead in the Cloud &#8211; The power of Infrastructure as a Service CTO Amazon.com, Dr. Werner Vogels Pretty much everyone in the audience uses Amazon! Announced: Persistent Storage for Amazon EC2. Hitting one page, might actually go to 250 different services, before the page is generated for you. Shows the use of a tool (Amazon [&hellip;]<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li class=\"share-email\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"\" class=\"share-email sd-button share-icon\" href=\"mailto:?subject=%5BShared%20Post%5D%20Ahead%20in%20the%20Cloud%20by%20Werner%20Vogels&body=http%3A%2F%2Fwww.bytebot.net%2Fblog%2Farchives%2F2008%2F04%2F15%2Fahead-in-the-cloud-by-verner-vogels&share=email\" target=\"_blank\" title=\"Click to email a link to a friend\" data-email-share-error-title=\"Do you have email set up?\" data-email-share-error-text=\"If you&#039;re having problems sharing via email, you might not have email set up for your browser. You may need to create a new email yourself.\" data-email-share-nonce=\"da445166f7\" data-email-share-track-url=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=email\"><span>Email<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-790\" class=\"share-facebook sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\" ><span>Facebook<\/span><\/a><\/li><li class=\"share-linkedin\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-linkedin-790\" class=\"share-linkedin sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=linkedin\" target=\"_blank\" title=\"Click to share on LinkedIn\" ><span>LinkedIn<\/span><\/a><\/li><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-790\" class=\"share-twitter sd-button share-icon\" href=\"http:\/\/www.bytebot.net\/blog\/archives\/2008\/04\/15\/ahead-in-the-cloud-by-verner-vogels?share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\" ><span>Twitter<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_options":[]},"categories":[1],"tags":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4vJD-cK","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":2900,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2014\/04\/11\/korean-mysql-power-user-group","url_meta":{"origin":790,"position":0},"title":"Korean MySQL Power User Group","date":"11\/4\/2014","format":false,"excerpt":"If you are a MySQL power user in Korea, its well worth joining the Korean MySQL Power User Group. This is a group led by senior DBAs at many Korean companies. From what I gather, there is experience there using MySQL, MariaDB, Percona Server and Galera Cluster (many on various\u2026","rel":"","context":"In &quot;MariaDB&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3381,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2017\/08\/05\/tab-sweep-5-august-2017","url_meta":{"origin":790,"position":1},"title":"Tab Sweep &#8211; 5 August 2017","date":"5\/8\/2017","format":false,"excerpt":"Amazon Drive no longer offers unlimited storage, with a thread on Hacker News. This affected me, since I run Arq Backup to Amazon Cloud Drive. What you really want to do is to ensure you're now setting a budget, so that Arq prunes older files. I'm now using less than\u2026","rel":"","context":"In &quot;General&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3491,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2019\/11\/10\/database-tab-sweep","url_meta":{"origin":790,"position":2},"title":"Database Tab Sweep","date":"10\/11\/2019","format":false,"excerpt":"I miss a proper database related newsletter for busy people. There\u2019s so much happening in the space, from tech, to licensing, and even usage. Anyway, quick tab sweep. Paul Vall\u00e9e (of Pythian fame) has been working on Tehama for sometime, and now he gets to do it full time as\u2026","rel":"","context":"In &quot;MongoDB&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1360,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2009\/03\/02\/fathomdb-database-as-a-service-in-the-cloud","url_meta":{"origin":790,"position":3},"title":"FathomDB: Database as a service, in the cloud","date":"2\/3\/2009","format":false,"excerpt":"A lot of people are into the whole cloud computing scenario these days. However, no one has talked about offering DBA-like services in the cloud, all automated, so that startups don't have to get their own DBAs. Enter FathomDB. They are poised to offer databases as a service (maybe they'll\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":534,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2007\/04\/25\/a-storage-engine-for-amazon-s3","url_meta":{"origin":790,"position":4},"title":"A Storage Engine for Amazon S3","date":"25\/4\/2007","format":false,"excerpt":"A Storage Engine for Amazon S3, Mark Atwood It looks mighty interesting, as transfers to Amazon S3 are free. I think it'll work well in America and places where bandwidth rocks, but I don't see this working too well in Australia. Oh how I wish the Internets will improve. Mark\u2026","rel":"","context":"In &quot;MySQL&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3182,"url":"http:\/\/www.bytebot.net\/blog\/archives\/2016\/02\/29\/amazon-rds-updates-february-2016","url_meta":{"origin":790,"position":5},"title":"Amazon RDS updates February 2016","date":"29\/2\/2016","format":false,"excerpt":"I think one of the big announcements that came out from the Amazon Web Services world in October 2015 was the fact that you could spin up instances of MariaDB Server on it. You would get MariaDB Server 10.0.17. As of this writing, you are still getting that (the MySQL\u2026","rel":"","context":"In &quot;MariaDB&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"amp_enabled":true,"_links":{"self":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/790"}],"collection":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/comments?post=790"}],"version-history":[{"count":0,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/posts\/790\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/media?parent=790"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/categories?post=790"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.bytebot.net\/blog\/wp-json\/wp\/v2\/tags?post=790"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}