You can design an LLM to mimimise memorisation and verbatim copying. OpenAI or Google have not done this. Systems who minimise memorisation by design, perform well in other benchmarks, tend to flop hard at human-oriented exams which are designed to test that a human has spent a lot of time reading the right books
Instead, because “our AI can be a lawyer, it passes the bar exam” is such a boon for marketing, they’ve optimised their systems to do the oppisite, despite the inherent plagiarism risk
@LouisIngenthron Copying unattributed GPLed code into a proprietary project will absolutely get you fired.