04:34
@Kartman Ah, thanks for pointing out the flaw. I got some idea lately how memory hierarchy works (I think their optimizations would be another pain).
I don't intend to make NVIDIA Chips, most probably I'd work on hardware VHDL code, building that hardware simulator, getting optimized ML-specific drivers, and porting OpenCL, OpenXLA, TensorFlow, PyTorch, and Keras into it (most probably cuDNN library too). The goal is to serve as a good starting point for future projects rather than to replace NVIDIA via paying them out billions of US dollars. I'm well aware NVIDIA chip prototypes are built with like 50-100 billion dollars.
8 hours later…
12:12
If you want to get a taste of high speed systems, get yourself a fpga dev board and go crazy with your vhdl/Verilog and see how much performance you can squeeze out of it. You’ll be nowhere near NVIDIA, but you’ll have a much better understanding of what is involved. You never know, but if you work hard at it, NVIDIA might want to hire you!
1 hour later…
« first day (2 days earlier) ← previous day next day → last day (23 days later) »
Transcript for
May15
May16
May17
Open Source Electronics
Developing an open-source GPU model tailored for ML training e...