if it's just muscle soreness, push on. Take an occasional extra day off, to let the muscles heal a bit. But, even on off days, do a set or two of each movement to flush the muscles with blood and move the lactic acid out of the muscles. You will get sore. This is the body attempting to adapt to the unknown stressors being placed on it. If the soreness is in the tendons or ligaments, STOP. But, decide whether you are truly sore, or just feeling crow-like.
For those of you who have led sedentary lives until now, the body is particularly unused to the extra exertion, and will get sore fast. That's the bad news. The good news is that you will make tremendous gains in strength and endurance rapidly. Far faster than athletes who do this crap every day. As you demand more effort from the body, it will learn to adapt quicker, making gains harder to achieve, this is called plateauing and is way above the concerns of most of the readers, so I'll just shut the hell up now.