Whenever I try changing the render distance, change mipmap quality, reload chunks or change dimension, my game crashes with error code 1

Opening the error log I'm greeted with this:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00007ffa8b312d20, pid=6728, tid=4620
Problematic Frame (nvoglv64.dll)

I searched around and I'm getting mixed signals. One says it's Nvidia, one says it's Java and yet another one says it's Minecraft itself.

I can't really play the game when it crashes every time I switch dimensions or change render distance.