Search Capability Leaderboard
Ember-1
Fireworks AIClosed
Evaluated
#20 in Search Intelligence / #18 in Search Efficiency
Search Intelligence Score
67.9
+38.0 lift from search
050100
- Lift from search
- +38.0
- 29.9 without search
- Cost per 1K tasks
- $335
- #18 in Search Efficiency
Accuracy by benchmark
Accuracy on each eval, with search (solid) and without (light).
- DSQA86.7 vs 44.9
- HLE50.0 vs 33.0
- WISER67.0 vs 12.0
Cost per 1K tasks
How the cost splits between model inference, search calls, and page extraction.
- Inference
- $318
- 95%
- Search
- $5.47
- 2%
- Extract
- $11.9
- 4%
Compared with
Other models from the same provider alongside models that score closest.
- Ember-167.9Cost $335 / Lift +38.0
- Auto (max)67.7Cost $116 / Lift +30.0
- GPT-5.6 Sol67.7Cost $269 / Lift +26.3
- Muse Spark Open67.2Cost $171 / Lift +31.8
- Pareto 26.1068.6Cost $116 / Lift +33.8
| Model | Score | Lift | Cost per 1K tasks |
|---|---|---|---|
| Ember-1 | 67.9 | +38.0 | $335 |
| Auto (max)OpenRouter Auto (max) | 67.7 | +30.0 | $116 |
| GPT-5.6 SolGPT-5.6 Sol | 67.7 | +26.3 | $269 |
| Muse Spark OpenMuse Spark Open | 67.2 | +31.8 | $171 |
| Pareto 26.10Pareto 26.10 | 68.6 | +33.8 | $116 |
Search Intelligence Score averages accuracy on DSQA, HLE, and WISER with equal weight; cost is averaged the same way, with cost shown per 1,000 tasks. Evaluated . Leaderboard last updated . Full methodology.
# Ember-1 / Search Capability Leaderboard
- Search Intelligence Score: 67.9 (#20 in Search Intelligence)
- Without search: 29.9 / Lift from search +38.0
- Cost per 1K tasks: $335 (#18 in Search Efficiency)
- Evaluated:
- Lab: Fireworks AI / Weights: Closed / Model id: fireworks/ember-1
## Accuracy by benchmark
| Suite | With search | Without search |
|---|---|---|
| DSQA | 86.7 | 44.9 |
| HLE | 50.0 | 33.0 |
| WISER | 67.0 | 12.0 |
## Compared with
| Model | Score | Lift | Cost per 1K tasks |
|---|---|---|---|
| Ember-1 | 67.9 | +38.0 | $335 |
| OpenRouter Auto (max) | 67.7 | +30.0 | $116 |
| GPT-5.6 Sol | 67.7 | +26.3 | $269 |
| Muse Spark Open | 67.2 | +31.8 | $171 |
| Pareto 26.10 | 68.6 | +33.8 | $116 |
Leaderboard last updated . Methodology: /leaderboard#methodology