I agree. AFAIK, D's policy is "give a safe default and a back door around it".
+1 to all of that.
If the only issue is performance, I think the best solution is just to Document with a warning against using default constructors in performance critical structs.