I like the concept, though I wish it was more difficult. If they added mobs breaking down doors or smashing windows that would be a neat adjustment to defense.
Perhaps adding a specific siege/breacher mob that breaks solid blocks would add a lot more tension.
Or something like a chorister that if killed would decrease the duration of the storm, but would require braving brunt of it outside searching/fighting.