A good fit for
- → Evaluating Grok on repository tasks
- → Long-running code and office workflows
- → Comparing harness behavior with the API
Know the limits
- → Published scores do not predict your repository's pass rate.
- → Fast variants have different pricing.
- → Tools and availability depend on the product surface.
Your first useful workflow
Choose one task
Freeze a repository and define an independently testable outcome.
Record the configuration
Save model, effort, harness version and allowed tools.
Review the result
Measure correctness, intervention and total run cost.
The practical take
Evaluate the full harness and model combination, not just the release's benchmark table.
Sources & evidence
Capabilities above are summarized from these official documents. Workflow suggestions are editorial guidance, not a claim of measured product superiority.