It makes sense that you dont want to accidentally pickup half your house by holding right click, but *when* you're building it, it feels pretty ornery to have to break a misplaced chest, wall, door, etc.
Suggesting each item placed that required breaking to pick back up have a 5 second safety timer where you can RC to pick it right back up before it locks into place.