Switching it back to native and updating grub with the latest driver worked like charm. Finally my eyes can rest. Thanks so much for that!!!
BOOT_IMAGE=/boot/vmlinuz-6.11.0-13-generic root=UUID=b5c29081-8fed-4c63-987a-be7b40b805bb ro quiet splash acpi_backlight=native crashkernel=2G-4G:320M,4G-32G:512M,32G-64G:1024M,64G-128G:2048M,128G-:4096M vt.handoff=7