I know I'm incredibly late to this, but I may have the answer to your issue. You mentioned you were using a sleek door, and, well, those are not insulating. They have a big decorative hole, so I think they're more meant for dividing up areas in a room (for example, if you're trying to avoid the game taking a small room as a cellar).