When you work with a raw file these floating point conversions don’t matter that much, but the OP is about RGB files such as jpegs and tiffs, where those conversions can lead to banding, posterization, etc.
It’s interesting that e.g. Capture One uses “something close to the camera space” – see their description.
They also make some interesting points about the calculations of colour readouts and their reference to colour space.