imo it will be the transmission speed between brain and computer

imagine how much more productive you would be, if you could get your thoughts (AND the relevant context) into the agents FAST

however, tbf, this is not a problem to be solved in the next 1-2 years