I think you're looking at two issues here. One, your GPU has a really small VRAM pool and will probably exhaust it within a few windows. Two, your GPU is likely not supported by the recent Nvidia drivers that majorly improved Wayland (550-series onward). So you're running into an OOM state that doesn't get handled gracefully and results in a crash.

My 3070Ti reports similar memory usage at idle, but even when my VRAM is exhausted I don't get an OOM crash. The only time I'd ever had my GPU OOM panic was with my 1050 Ti on very old Nvidia drivers. You'll probably want a newer GPU for Wayland stuff.