Kudos to them for publishing this. Yes, yes, all the usual caveats of these were juniors, small sample size, etc, etc. But this is result is hardly surprising. It's just funny the juxtaposition of their CEO at Davos saying software engineering as a career might be over in a year, then they publish a study that shows worse understanding and doesn't even show a speedup.