llamacpp on JVM, powered by JNA.
For now it's only quantize, but surely it will develop into something more completed and interesting, like a multi-user chat server?
Maybe I should move this project out of playground folder and publish to github.
Follow
I use ksp for code generation, so you don't have to write those ugly hacks for kotlin.
You write something like p1 and got something like p2 and p3 automatically.
