I would generally go with github pages if I had a completely static website.

Never served static html from caddy directly, I have a separate application server behind caddy 99.9% of the time (which may or may not serve static html)