It is never too late to start, whether you took a few decades off from exercising after your early 20s or are entirely new to physical activity at 40 to 50 years old.