Did you reconstruct from the CMFs? How do you spectrally adapt to a display when all you have is xy colourimetry?  It’s approximations all the way down.  I’m well aware of the physical models. I understand your point.  I assure you however, that when you adapt to a scene, that it is not likely because there is some sort of spectral math on SDs happening inside our complex system; it’s psychophysical and as an approximation with existing approaches, it is good enough here.   The CATs work enough ...