I don't mind the extra hunger for off-hand items, I think that lends a bit of situational awareness and RP option. But right now, the off hand is just a place to hang items. Picking things up and putting them away with that hand is impossible; you basically need to transfer the item to your main hand and then you can use it.
I'd like a shortcut that makes it possible to immediately hang up a lantern that's in my off-hand, or put my tongs away, or deploy a torch. I don't expect to be able to do complex things like hammer with my offhand, or swing a sword, or use most tools, just have a mechanism for putting off-hand items on the wall or in a chest or whatever.