You can now run Kimi K3.1 Pro locally on one 96 GB GPU at 2 tok/s - 40 tok/s prefill

#12
by konstantinnikol - opened

lol, just wait until someone gets it running on a 8GB GPU

Sign up or log in to comment