An infantry battalion did a count on how many days in a year its soldiers spent sleeping away from their homes; this generally implied training or courses and in most cases meant sleeping on the ground under the stars. The average was about 2-3 months, with some MCpls and Sergeants spending 150-170 days of the year away from their home. This was during a year without high readiness training or operational deployments.
You're talking out of your a$$.
I'd also suggest that physical fitness is a part of the job description of someone in the Combat Arms, and no different than a signaller taking his section outside for antenna construction refresher for that same amount of time.