Are these in order of preference?
Hi,
Not in order, it looks like that is from this article which goes into more detail:
Though the article is a bit old now.
There isn't a single 'best' measure or list for GPUs but generally the H100 GPU is best, followed by A100.
Other than this the GPU's with highest bandwidth tend to perform best.
So in that list you can see A100 is best on bandwidth and also has high fp64 and fp32 performance. RTX4090TI would likely be second best in the list, though given it's slower FP64 performance it would be best to use it for Hybrid/Mixed precision (which is recommended) rather than running in double precision.