Archive for the ‘Databases’ Category

Spacewalk, and what we can learn about naming

Monday, June 23rd, 2008

Red Hat releases Spacewalk. It is described as: “the upstream community project from which the Red Hat Network Satellite product is derived“. Congratulations to all whom have worked on it, especially my friends who tired endlessly over it in the past.

Red Hat, is sticking true to its promise, of open sourcing everything they make. Best of all, they recognise Fedora (they always did, since say, Fedora Core 2 or 3), CentOS (a direct “competitor”/rebuild of RHEL), and Scientific Linux (I know of a certain university’s sysadmin who will be blessing Spacewalk, as her life will now be a lot easier).

There have been a few blogs about it… Matt Asay asks about a community (Red Hat traditionally wasn’t good at this, but with Fedora, I believe they’ve learned, and I’m happy to say I think, I helped in the education process). No one however, focused on the technical aspects around Spacewalk/RHN.

Case in point: Oracle is at the heart of it. RHN was designed almost seven years ago, and I’ve heard amazing stories from Gafton, Greg, and Peter. How Gafton found hidden “secrets” inside Oracle to boost performance, and a whole bunch of interesting things, best to talk about over a beer (the irony? When I first met these folk, I couldn’t even legally drink a beer in the US…)

Read the Developer Documentation, note that they use Perl, Python and Java in the current code base (but only Perl and Java is the way forward). There’s a DB Schema available… and I wonder when someone will port this to MySQL?

The Spacewalk FAQ mentions the lack of resources in the past to add an open source database, but would want to do so soon. There’s even help on getting Oracle XE running. The glimmer that there is to be an open source database behind Spacewalk, is what tells me that the MySQL community, that benefit from such a tool (so you’re a DBA and a sysadmin at a fairly largeish installation), should port this to run on MySQL.

What else can we take away from Spacewalk? The excellent positioning. A community project from which the RHN product is derived. This is similar to what Fedora is positioned as: Another striking difference of Fedora is our goal to empower others to pursue their vision of what a free operating system should be like. Fedora now forms the basis for derivative distributions such as Red Hat Enterprise Linux , the One Laptop Per Child XO and Creative Commons’ Live Content DVDs.

Distinctive naming. Helps create a lack of confusion (at the price of an ubiquitous name? Sure, you just have two ubiquitous names now). MySQL Enterprise vs. MySQL Community. They’re both MySQL (don’t even get started on the odd/even numbering scheme…). I dream the day, when we have MySQL Enterprise and Sakila (formerly known as MySQL Community).

Firefox Download Day

Tuesday, June 17th, 2008

Its the Firefox Download Day. That not only means Firefox 3 is out, it also means that they’re trying to set a world record, by getting the most downloads of a software package in 24-hours. There’s a nice world map, similar to the kind you might have seen in presentations by Jonathan Schwartz (ok, I prefer seeing the dots per region, rather than the Firefox one :P).

The pending general availability of MySQL 5.1 was announced in April at the MySQL Conference. While I’ve seen 1,400+ attendees (a pleasant problem for the event organisers, as they scurried to get people into overflow rooms, and herd the crowd during food times) show up at the Tech Days in the Philippines, I’m wondering if we can achieve 3 million downloads (the current Firefox counter) within 24-hours? Database software just isn’t as sexy as a web browser… Thats not to say we cannot aim high.

How would you celebrate the release of MySQL 5.1 GA? Worldwide release parties (ala Ubuntu)? Set an aim for “n-number of downloads” in 24-hours?

P/S: Like live stats? Look at the Mozilla Download Counter. Its live, and very cool

MySQL Rocks: Wen Huang, in Makati City, Philippines

Tuesday, June 17th, 2008

I’m at the Sun Tech Days in beautiful Philippines, and all I can say is the energy is tremendous. I’m hearing there are about 1,400 attendees, and this number might grow tomorrow.

Armed with a video camera, I decided to take a few video snapshots. My first victimguest on my yet to be named videocast is Wen Huang, Product Manager for NetBeans, at Sun Microsystems.

Wen Huang has been a MySQL user since 1999, and had a past life as a web developer in various web shops, some large, some small. One commonality he had at all his jobs though is that they always use MySQL.

He’s an action junkie, preferring to have the latest version of the MySQL database all the time, and can’t wait for MySQL 5.1 when it comes out. Do remember that there exists a NetBeans with Glassfish and MySQL bundle. I’ve also blogged about this before, don’t hesitate to read my review titled NetBeans 6.1 with GlassFish, MySQL bundle.

So there you have it. Go forth, and try the great bundle, as its an all-in-one install of an IDE, an application server, and a database server.

MySQL at the Sun Tech Days, Philippines

Saturday, June 14th, 2008

In what I think must be MySQL’s first time in the Philippines, there will be a presence there next week. Well, its not the first time, but in terms of a community/developer event, I think it might be. The Sun Tech Days is happening from 17-19 June 2008, in the Shangri-La Makati.

Besides MySQL, expect great talks on NetBeans, GlassFish, OpenSolaris, and so much more. I’ll be the guy walking around in the MySQL shirt, so feel free to stop me and ask questions. Its exciting for me, as we’ve not really paid much attention to the Philippines, in terms of community growth (and the Philippines is in the APAC region!).

This isn’t a free event (its 1,000 PHP = ~USD23), and registration should still be available. If you’d like to meet up, and talk MySQL, shoot me an email at colinATmysqlDOTcom or reach me via mobile at +6-012-204-3201. If you’d like to help organise a MySQL Meetup in Manila, do ping me too.

Horizontal Scaling with HiveDB

Wednesday, June 4th, 2008

At the MySQL Conference & Expo 2008, Britt Crawford and Justin McCarthy, both from Cafepress.com, gave us a very interesting talk on scaling with HiveDB. I took a few notes (pasted below), their slides are online (warning: 6.1MB PDF), and if you’re after their abstract its available as well.

I also took a video of them (refer to Slide 12, for the IRC conversation):

The quick notes:

  • OLTP optimised (as it serves cafepress.com)
  • Cannot lock tables, or take it offline
  • Constant response time is more important than low latency (little slower query is ok, just not exponentially slower)
  • Queries run might return wildly sized result sets.
  • There can be growth and usage hotspots. You cannot predict this at all.
  • Partition by key (the set of all partition keys is the partition dimension)
  • Partitioned Hibernate from Google (Hibernate Shards). HiveDB is now married up with shards.
  • Thought about MySQL Proxy to support high availability components, but it was dismissed

mod_auth_mysql patched to work with phpass

Sunday, June 1st, 2008

Do you use mod_auth_mysql, the Apache module that allows authentication of users to happen through a MySQL database?

If so, the nice folk at Automattic (makers of fine blogging software like Wordpress) have released a patched version that works with phpass.

With this, you can now have single sign on (SSO), with authentication against a WordPress blog (or bbPress forum). Note that WordPress (in 2.5 and later), doesn’t use MD5 hashes to store passwords any longer; instead they are salted and hashed with the phpass library. The Automattic folk use this to provide SSO for Trac and Subversion.

Read Barry’s announcement, and grab the patched mod_auth_mysql.

GSoC Updates: Start your engines

Tuesday, May 27th, 2008

MySQL is featured on the Google Open Source Blog
Just after leaving JavaOne, Leslie pinged me on IRC to inform me that the MySQL project was featured on the Google Open Source blog. Go on, read Moments of Inspiration.

In other news from mentors, Colin Charles, former mentor and 2008 organization administrator for MySQL dropped a note to let us know that their Community Bonding period is moving along swimmingly. So well, in fact, that their students are already delivering weekly status reports. Colin mentioned that their student Filippo Bollini had crafted a particularly well written update; it’s worth checking out for mentors wondering what sorts of information to collect from students or for students wondering what kind of details are most useful to their mentors.

Congratulations Filippo. I expect great things from you (as does Brian.)

Start your engines!
Students, and mentors alike, this is the week that the Summer of Code starts! Well, coding anyway. Its very encouraging to see all the weekly reports flow in, and once I catch a breath, I’ll be summarising them for all to see and keep up with how the MySQL SoC students of 2008 are doing.

Getting Started Using NDB on MySQL University

Wednesday, May 7th, 2008

We haven’t had a MySQL University session in a while (a semi-spring break?), but tomorrow’s session (May 8) should be real interesting. MySQL Cluster developer, Stewart Smith, will host a session titled Getting Started Using NDB. It will happen on May 8, at 13:00 UTC.

One of the most common queries I receive is from people wanting to install or get started with NDB usage (ok, strictly speaking, they want to “cluster” MySQL, and I’m happy Stewart is using the word “NDB” which refers to the storage engine). All in all, it should be a great session, so I encourage you to join in the festivities.

Lucky for me, 13:00 UTC equates to 06:00 PST, while I’m in San Francisco. So I should definitely attempt to be there.