@msprout Some one tried the full 65B model on 8xA100, I don't think I can do it. All I have is a laptop with a RTX 3070 in it, so I'll try it best.

For the environment that let this model to work, the official LLaMA repo should work: here is a fork: https://github.com/shawwn/llama