I tried to join a server and one of the mods would not download, I got the "download failed" red text and even after restarting, the mod would not download if I tried to download it by joining the server with the mod through the server browser.
The server this happened to me this time one was: DarkGru conflict server (modded)!
Perhaps this is a server config issue? Perhaps it's a workshop issue?