llamacpp on JVM, powered by JNA.

For now it's only quantize, but surely it will develop into something more completed and interesting, like a multi-user chat server?

Maybe I should move this project out of playground folder and publish to github.

Follow

Also, some fun fact: JNA do not support C++, while most people just mix C and C++. Thus the JNA can't handle `bool` in Java. The boolean from Java is 4 bytes, while the bool in C++ is 1 byte. Thus you have to use byte to replace the bool.

Sign in to participate in the conversation
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.