Will Nvidia release ARM Graviton servers for the public to buy?

Ampere servers already available from the likes of Gigabyte are functionally equivalent to Graviton 2. Graviton 3 equivalents haven’t yet been announced. The Graviton CPUs are pretty vanilla instantiations of ARM IP.

Ampere Altra exists, Nvidia Grace is coming (mostly for HPC), and the 1U Outpost is there (although it's not just a server and you don't exactly buy it).