this post was submitted on 17 Mar 2025
89 points (96.8% liked)

Autonomous Vehicles

85 readers
1 users here now

Autonomous Vehicles is a community dedicated to the news, discussion and exploration of autonomous vehicles and how we as a society, will embrace this futurology today!

founded 9 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 1 week ago (1 children)

In AI land, programmability has proven to be king so far.

Nvidia GPUs are so dominant because everything is prototyped, then deployed, in PyTorch. I think Google TPUs are a good counter example where a big entity throws tons of money at this issue, and even releases some models optimal for their hardware, yet Flax and TPUs themself gain very little traction and are still incompatible with the new architectures that come out every other day because no one has bothered to port them.

FPGAs take this problem and make it an order of magnitude worse. Very few people know how to port and optimize to them... So they don't.

[โ€“] [email protected] 1 points 1 week ago

I really wish I had saved the reference of the guy from Altera explaining why FPGAs simply will not work for models. I don't have a ton of interest in FPGAs in general... It may have been on Lex Friedman.

The FPGA is ultimately anything, and they work for smaller stuff obviously, but there is some specific reason why they do not scale to work with current models. It might have been the way rotations are done in transformers or something like that. The person was on papers I have seen and skimmed on arxiv. Names and details outside of my curiosity do not stick in my abstractive functional thought and memory.