If it is 100% flicker free that is stable and you turned off VRR everywhere, only the response time of your panel will matter. The panel you have is likely calibrated for a higher refresh rate. Lowering it may cause ghosting, artifacts, and/or terrible motion blurring.
FYI: 120Hz is the exact refresh rate intel graphics automatically turns on VRR.