Make the case against fine-tuning for a team that wants to.

It can degrade other tasks; it needs data, expertise, serving and maintenance as new base models arrive. Often prompt experiments weren't systematic. The book's cautionary tale: BloombergGPT, about 1.3M A100 hours, was outperformed on financial benchmarks by GPT-4-0314, released the same month.