I have been using colord-kde for years without any such problem. Given that all it does is telling colord in the background what to do and not doing any color transformtions itself I don’t see how any of the described problems could be due to colord-kde. You could try using darktable-cmstest to see what is configured in your system.