I feel a similar way about TN vs IPS, I never had an IPS device before my 'gaming' laptop which is fine for me, but I have to use 'reduce white point' on Iphone / Ipad devices (that I can use as newer ones give me headaches) and this 'dulls' the colors - and makes it a bit dimmer, much like how I percieve a TN screen.
I recently set my usable for me LG ultrawide IPS to 'FPS' mode out of the mode I custom set, I set it a bit dimmer and lowered the R G B levels from 50 to 25ish, the not customisable 'FPS' mode was like seeing color for the first time and my brain isnt used to it and still isnt. Some software (games) are unplayable for me but if I set the monitor back to my custom lower RGB level setting its tolerable for a little longer and overall darker brightness and colour 'intensity' level
I believe the way that light travels through the IPS screen / how IPS presents light and colour being different has an effect on people who are sensitive to these things.
My other theory is that as I had never been exposed to this before im sensitive to it, I had the same TN screen for 11 years, CCFL with PWM but it was fine. I stopped using it last year. I tend to keep hold of tech for a long time I dont change and buy the new 'thing' every year etc so maybe I've missed the gradual exposure to all these new technologies for screens.
I tried to become accustomed to the Macbook screen but sold it after a year as nothing I did helped.
Anyway I now use a LG ultrawide IPS 6bit+FRC and an 8bit Benq TN both are fine on my good devices, but neither are ok when I connect to a 'bad' device.