sRGB, Rec709 etc. are not constant luminance colour spaces (i.e. some of the luma information is carried in the chroma signal and vice versa). So you’d expect changing one channel to affect the others.
More recent colour formats like Rec2020, ICtCp, JzAzBz have much better separation.