Men's hats with a detachable pompom