I’m going to go out on a limb here, and say that the Confederate flag was always racist, but the people who rightfully had a problem with it only started to gain the power to say or do anything about it during the Civil Rights Era, or (as you aptly point out) when Black men became armed soldiers in an integrated military.

Perhaps it only “recently” became popularly understood to be racist, but it has always actually been racist.