
So we left with an answer to a question but many more questions to answer, which is good for curious people. If 3.5 tok/sec is not the wall, what is? Are you telling me that on 8GB of VRAM and 24GB of RAM, with disk streaming, you can use…
View original source — Hacker Noon ↗


