I don't think AI traders will ever become as common as people think because then it'll just take away all the delta.

Evaluating is a big problem again altogether as you mentioned.

PS: For context, I did paper trade one alpha for 7 days then decided not to run it just because I did it as a hobby.