2 pointsby kirtivr5 hours ago1 comment
  • kirtivr5 hours ago
    Some super relevant benchmarks like Humanity's Last Exam, Long context reasoning (MRCR 128K-256K) are not included.

    Overall this seems to be a strong agent-oriented model. What are the benchmarks that most closely track model coding performance in the real world?