1 pointby peter_d_sherman2 hours ago1 comment
  • peter_d_shermanan hour ago
    >"On a single GPU, this model delivers up to 5x higher throughput for agentic tasks compared to other open models in its size category.

    [Scatter plot comparing Artificial Analysis Intelligence Index scores and output speed for open-weight models with 100K input tokens. Nemotron 3.5 Super VL exceeds 600 output tokens per second; the chart marks a 5x speed comparison with Inkling Small.]

    Figure 1. Nemotron 3.5 Super VL delivers over 600 TPS on Artificial Analysis Intelligence Index agentic tasks on the Baseten endpoint"

    This ~5x improvement is definitely a step forward!