This is affecting only community servers with specific times for baseraids which de/activate base damage at the beginning and end (which are most of them on PS).

When a fence or watchtower gets destroyed by grenades or gunfire and is ruined you can build it back up as soon as base damage is disabled and it can't be destroyed anymore when base damage is activated again.