One approach could be information theoretical. We could for instance try to quantify intelligence mathematically via von Neumann entropy on the linear maps present within the transformer architecture.