I had a researcher doing related work argue to me today that the likely per-search energy requirements of GPT3 are between 100 and 1000x that of a Google search, which didn't sound unreasonable given compute. Such energy use, if true, would make it the crypto of search. #xp
Follow
@paul@social.paulkedrosky.com Meta just announced a new model (LLaMA) that they claim achieves GPT3 performance with less than 10% of the parameters. Not sure how this will ultimately play out, but I think it’s way too early to make definitive predictions about the GHG impact of LLMs.
