This makes so many excellent points. My current workplace is suffering from AI-creep in a big way. We are a service company who under-prioritizes and under-funds writing documentation. Service documentation is everything, but it's not "sexy". So it doesn't get the attention it needs. So they hired a PM who got the idea to google if you can feed PDFs to GPT and get back something like a custom ChatGPT (yes, of course this exists) - and now that's our formal plan for documentation. No concern of GIGO, just the confidence that our previously poorly-funded PDFs going in will magically come out with more intelligence.