Follow
High-Speed Large Language Model Serving on PCs with Consumer-Grade GPUs
https://news.ycombinator.com/item?id=38708585
#hackernews #tech
