Search Capability Leaderboard
Nemotron 3 Ultra 550B
NVIDIAOpen weights
Evaluated
#44 in Search Intelligence
Search Intelligence Score
53.0
+37.7 lift from search
050100
- Lift from search
- +37.7
- 15.3 without search
- Cost per 1K tasks
- $113
- Below the median score of 64.4, so not ranked on cost
Accuracy by benchmark
Accuracy on each eval, with search (solid) and without (light).
- DSQA71.0 vs 27.9
- HLE34.0 vs 10.0
- WISER54.0 vs 8.0
Cost per 1K tasks
How the cost splits between model inference, search calls, and page extraction.
- Inference
- $100
- 89%
- Search
- $6.67
- 6%
- Extract
- $5.75
- 5%
Compared with
Other models from the same provider alongside models that score closest.
- Nem 3 Ultra53.0Cost $113 · Lift +37.7
- Nem 3.5 Super VL59.1Cost $93.9 · Lift +42.2
- Nem 3.5 Ltng37.9Cost $12.1 · Lift +28.0
- MiniMax M352.6Cost $41.1 · Lift +29.5
- GLM-5.254.3Cost $66.6 · Lift +35.9
| Model | Score | Lift | Cost per 1K tasks |
|---|---|---|---|
| Nemotron 3 Ultra 550B | 53.0 | +37.7 | $113 |
| Nem 3.5 Super VLNemotron 3.5 Super VL | 59.1 | +42.2 | $93.9 |
| Nem 3.5 LtngNemotron 3.5 Lightning | 37.9 | +28.0 | $12.1 |
| MiniMax M3MiniMax M3 | 52.6 | +29.5 | $41.1 |
| GLM-5.2GLM-5.2 | 54.3 | +35.9 | $66.6 |
Search Intelligence Score averages accuracy on DSQA, HLE, and WISER with equal weight; cost is averaged the same way, with cost shown per 1,000 tasks. Evaluated . Leaderboard last updated . Full methodology.
# Nemotron 3 Ultra 550B · Search Capability Leaderboard
- Search Intelligence Score: 53.0 (#44 in Search Intelligence)
- Without search: 15.3 · Lift from search +37.7
- Cost per 1K tasks: $113 (below the median score of 64.4, so not ranked on cost)
- Evaluated:
- Lab: NVIDIA · Weights: Open weights · Model id: nvidia/nemotron-3-ultra-550b-a55b
## Accuracy by benchmark
| Suite | With search | Without search |
|---|---|---|
| DSQA | 71.0 | 27.9 |
| HLE | 34.0 | 10.0 |
| WISER | 54.0 | 8.0 |
## Compared with
| Model | Score | Lift | Cost per 1K tasks |
|---|---|---|---|
| Nemotron 3 Ultra 550B | 53.0 | +37.7 | $113 |
| Nemotron 3.5 Super VL | 59.1 | +42.2 | $93.9 |
| Nemotron 3.5 Lightning | 37.9 | +28.0 | $12.1 |
| MiniMax M3 | 52.6 | +29.5 | $41.1 |
| GLM-5.2 | 54.3 | +35.9 | $66.6 |
Leaderboard last updated . Methodology: /leaderboard#methodology