Objective To assess the age-associated longitudinal trends in cardiorespiratory fitness (CRF), leisure-time physical activity (PA), and body mass index (BMI) across the lifespan in a cohort of adult women. Methods The sample included 1467 women from the Aerobics Center Longitudinal Study who were 30–79 years old at baseline and had 3–22 health examinations between 1971 and 2006. CRF was quantified by maximal Balke treadmill exercise tests. The total metabolic equivalent-minutes/week of self-reported PA and measured BMI (kg/m2 ) were calculated. Results The overall pattern of CRF decreased over time. After age 60 years, fitness level tended to decline rapidly. Women at age 50 had the highest PA level, which decreased after age 50 and plateaued at age 60. The overall pattern of BMI increased with age. However, after age 60 years the rate of increase in BMI became much slower. Adjusting for smoking, health status, and the individual exposures of CRF, PA and BMI did not influence the observed associations. Women who did not meet current PA recommendation or those who were low fit at baseline had a higher BMI throughout adulthood than their more active or fit peers, but the trajectory of BMI was unassociated with baseline activity or fitness levels. Conclusion We concluded that the age-related longitudinal patterns in physical activity and fitness are not linear. Baseline activity and fitness levels are associated with BMI status during adulthood, but do not affect BMI change trajectory.