Was setting up some HTML5 audio on a site today, and noticed that the .ogg file was not playing in Firefox. After a bit of pulling out my hair, I realized that GoDaddy did not have this mime type setup on my server. So, I tried this in my .htaccess file:

AddType audio/ogg .ogg

And viola! HTML5 audio in Firefox.