If you think NVIDIA is untouchable, remember that 3 years ago nobody believed a Chinese company could make a 4090-class card. Moore Threads claims MTT S4000 already beats A100 on some LLM benchmarks when clustered (take with salt). Still, progress is scary fast.