Wondering if anyone out there is using LLMs are a proposal heuristic in NAS. Would seem fruitful (e.g. after fine-tuning on NeurIPS). Add in reinforcement learning for bonus points. It's not quite recursive self-improvement since re-architecting and retraining the LLM would be a slow, expensive, and human-in-the-loop step.