I thought the AR UI in "Rainbow's End"[1] made more sense than hand gestures: with digital clothing, all of our movements become controls. And we each train our inputs according to our own slight tweaks and movements. Also, pretty sure this book was a big impetus for Google, Meta, etc to get started with AR, drones, and self-driving cars.
[1] https://en.wikipedia.org/wiki/Rainbows_End_(Vinge_novel)