I've avoided wading into this conversation because I'm not really in the field of machine learning (I kinda was for a bit, but I never really grokked modern language models).
Don't have that much to add. I just want to say, to me, "just" predicting the next word in a sequence doesn't sound like the constrained task it's made out to be. the main thing I and doing in typing this is "predicting the next word in a sequence".
#machinelearning #AI #LLM