I have read about professional VNA users even being puzzled initially by some of the NanoVNA menus and options.
I use top-end VNAs that cost several hundreds of thousands of dollars on daily or weekly basis and I was comfortable with my NanoVNA quickly, though I must admit that the "transform" submenu was somewhat alien to me.
Even just simple resistance (R) will tell ya' more about the SWR reading. Say one has a typical 50-ohm transceiver. The measured antenna SWR is 4:1. Is the resistance closer to 200 ohms or 12.5 ohms?
Kind of makes for a considerable difference if using to a matching transformer for example by at least telling ya' which way to position the ratio.
Reactance (X) is also nice to have IMO. An antenna often is "resonant" at the frequency where X is zero, which can make a routine task like lengthening or shortening an antenna's length a little easier to determine.
Also, yeah, I agree about Smith Charts. I might learn to use them if building complex circuits, but admittedly, I have never bothered seriously with them even despite having a degree in math. I am not sure if seeing Smith Charts makes me think about my old HP-49g graphic calc.... or a slide rule.
In many decades of working in the RF and electronics industries, I can say that, while we sometimes talk qualitatively and non-quantitatively about "standing waves", I can't recall ever being asked for or seen a VSWR value quoted on any of the data I produce or read - we're more concerned about return loss, S11/S22 and the specific impedance presented as R+jX along with where that is on the Smith Chart.
Having said that, you can probably have even the most expensive VNAs produce a VSWR trace, especially older ones; it's available on the menus. On the newer VNAs, you might have to dig into the math functions to have it calculate it for you, because it might not be something readily available on the list of possible traces to display. I'm not 100% sure about that though because I never need to enable a VSWR trace because none of us care about it.

(See above.) My point is that while that measurement is available, nobody in my "realm" is using it, in lieu of more specific measurements, for exactly the type of reasons you list above.
You probably don't need to worry too much about Smith Charts as a hobbyist if you are not building circuits that have to produce a specific match on the inputs and/or outputs.