↑
Show HN: Hardware-software co-design for MoE models to bypass NCCL bottlenecks
Posted by
PJHkorea
|
3 hours ago |
1 comments
PJHkorea 3 hours ago
Imagine virtual memory, but instead of using your local storage, you’re pooling a whole bunch of network servers into a single address space