2.5 Rich Text Editor not appearing

The image dialog isn’t working though. When I click the button I get this: https://skitch.com/litzinger/8183m/new-entry-pages-expressionengine

I suspect most people would prefer <p> tags instead: https://skitch.com/litzinger/81831/new-entry-pages-expressionengine