I've been getting what is probably a memory leak in both multiplayer and singleplayer since 1.3.4. Resetting to 1.3.3 fixes it.
Whenever anyone interacts with blocks or something is crafted, there is a very noticeable fps dip. Don't know what exactly is causing it, but it happens from the moment the world is loaded and persists after restarts etc.