1. Take a combat boots (the one with a knife fitting in).
2. put a combat knife in the boots
3. drag it on hotbar.
4. use hotbar to take knife in hands
5. use any other hotkey, -> knife goes back on a random slot anywhere, but not in your boots.

Same with rifles you have in your backpack,...