bigyabai 16 hours ago > you will need 8 GPUs (each with > 40GB of memory).oh joy karmakaze 14 hours ago Hey a use for the a16z machine[0].[0] https://news.ycombinator.com/item?id=44996892 thot_experiment 7 hours ago that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s
karmakaze 14 hours ago Hey a use for the a16z machine[0].[0] https://news.ycombinator.com/item?id=44996892
https://huggingface.co/xai-org/grok-2
> you will need 8 GPUs (each with > 40GB of memory).
oh joy
Hey a use for the a16z machine[0].
[0] https://news.ycombinator.com/item?id=44996892
that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s