@radareorg @pancake I tried using llama-2-7b-chat-codeCherryPop.Q5_K_M.gguf instead of llama-2-7b-chat-codeCherryPop.ggmlv3.q4_K_M.gguf, it's roughly 700mb bigger, gives similar results but supposedly more accurate ("large, very low quality loss - recommended"). Got it from here:
huggingface.co/TheBloke/llama2

@modrobert ideally models from hugging face should be automatically downloadable from r2ai like it's done by open-interpreter, but i somewhat broke the code while messing with the code. now that i have a better idea of what to do and how i'll bring that back and shrink the current spaguetti code

Follow

@pancake OK, yes, there were some connection errors until I manually entered the full path to the model in main.py. Perhaps a bit off-topic, but do you think it's possible to get that irc (liberchat) <-> telegram bot going again?

@modrobert seems like the link got broken because the bot is not able to join the telegram channel for a reason :? but then i found that libera.chat banned the matrix bridge too matrix.org/blog/2023/08/libera so i guess i'll need to join the irc again and stay around.. or maybe i can bridge the irc with the fediverse

@modrobert fixed the issue with the telegram bot :) so the bridge between irc and telegram is working again, only for the main channel (not the side one). still thinking if i should write the mastodon bridge :D as i prefer open platforms uber ales

Sign in to participate in the conversation
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.