If you're annoyed by the fancy quotes that WordPress replaces your normal quotes with (i.e. “these quotes” rather than "these regular quotes"), there's an easy way to get rid of them. Just use Semiologic's Unfancy Quote Plugin For WordPress and presto chango, your fancy quotes are gone!

I had found some lower-level hacks to WordPress and some crazy-complex Javascript that fixed this, but none of them were as simple and easy to use as Semiologic's solution.