Same thing happened to my friend yesterday on Dusk server:
https://www.youtube.com/watch?v=v0SEsdnXqLY&ab_channel=MaxPowers

Really like this idea, and thought similar myself. Another cool idea would be to add phantom footsteps and gunshots in the later stages >:-D

Just commenting here as I hope the issue will be fixed on resolution of this issue:
Unable to pick up a fireplace after dismantling a stone oven.
The fireplace will despawn eventually but it is annoying.

I have had the same issue with oven built inside gnome castle. The issue does not occur when placing the oven by dropping from hands and cooking slots are then useable. The issue seems to occur when placing a stone oven using left mouse.