Search Intelligence Score
35.0
+29.0 lift from search
050100
- Lift from search
- +29.0
- 6.0 without search
- Cost per 1K tasks
- $17.1
- Below the median score of 51.2, so not ranked on cost
- Time per task
- 169s
- Search plus inference time to complete one task
Accuracy by benchmark
Accuracy on each eval, with search (solid) and without (light).
- DSQA37.0 vs 5.0
- HLE33.0 vs 11.0
- WISER35.0 vs 2.0
Cost per 1K tasks
How the cost splits between model inference, search calls, and page extraction.
- Inference
- $10.7
- 62%
- Search
- $4.32
- 25%
- Extract
- $2.15
- 13%
InferenceSearchExtract
Compared with
Other models from the same provider alongside models that score closest.
| Model | Score | Lift | Cost per 1K tasks | Time per task |
|---|---|---|---|---|
| Nemotron 3.5 Lightning | 35.0 | +29.0 | $17.1 | 169s |
| Nem 3 UltraNemotron 3 Ultra 550B | 42.7 | +26.3 | $155 | 109s |
| Laguna S 2.1Laguna S 2.1 | 33.0 | +27.0 | $28.3 | 364s |
| DS Flash 0731DeepSeek V4 Flash (0731) | 43.7 | +21.0 | $9.45 | 88.0s |
| MiMo v2.5MiMo v2.5 | 45.0 | +32.3 | $26.2 | 203s |
Search Intelligence Score averages accuracy on DSQA, HLE, and WISER with equal weight; cost and time are averaged the same way, with cost shown per 1,000 tasks. Latest update September 14, 2026. Full methodology.
# Nemotron 3.5 Lightning · Search Capability Leaderboard
- Search Intelligence Score: 35.0 (#23 in Search Intelligence)
- Without search: 6.0 · Lift from search +29.0
- Cost per 1K tasks: $17.1 (below the median score of 51.2, so not ranked on cost)
- Time per task: 169s
- Lab: NVIDIA · Model id: nvidia/nemotron-3.5-lightning
## Accuracy by benchmark
| Suite | With search | Without search |
|---|---|---|
| DSQA | 37.0 | 5.0 |
| HLE | 33.0 | 11.0 |
| WISER | 35.0 | 2.0 |
## Compared with
| Model | Score | Lift | Cost per 1K tasks | Time per task |
|---|---|---|---|---|
| Nemotron 3.5 Lightning | 35.0 | +29.0 | $17.1 | 169s |
| Nemotron 3 Ultra 550B | 42.7 | +26.3 | $155 | 109s |
| Laguna S 2.1 | 33.0 | +27.0 | $28.3 | 364s |
| DeepSeek V4 Flash (0731) | 43.7 | +21.0 | $9.45 | 88.0s |
| MiMo v2.5 | 45.0 | +32.3 | $26.2 | 203s |
Latest update September 14, 2026. Methodology: /leaderboard#methodology