Floating in water should be affected by gear weight. So, for example, the more gear you have, the more you sink underwater.

To float, remove your body armor, like in real-life. Ballistic vests these days have quick release straps that, when pulled, cause the vest to fall off the wearer. These are designed to be used in water, as a ballistic vest can cause a swimmer to sink deeper into the water.