Unfortunately, Steam's offline mode has limitations when connecting to local servers, and without internet, it can be tricky. Using a phone for tethering might be the only workaround in this case, but I agree—it's not ideal. Hopefully, Steam will improve its offline features in the future!