The only solution I can think of is to get AI implemented upstream in the planning phases so that it results in specs for spec-driven development. Your boss will be able to directly contribute without bothering anyone, but he will also think developers are obsolete. You need to warn him about the dangers of vibe-coded shit, but either way there's no positive scenario these days.