I know everyone has already seen this (there's certainly been wide press coverage), but it's worth repeating... Opera 10.5 is out and is the first shipped version with HTML5, <video> and Ogg support out of the box. It's a long time coming, the first Ogg-enabled betas were in 2007.
This brings automatic Ogg support* to all the major browsers except Safari (you have to explicitly install the Ogg QuickTime components to give Safari Ogg support)
*This is cheating a bit as the automatic Silverlight support for IE hasn't actually shipped yet, just been announced.