Zero of fourteen models named Comprehensive.io first on the direct prompt; zero named Mercer Total Remuneration Survey. Comprehensive.io was named by ten of the fourteen models and Mercer Total Remuneration Survey by fourteen and Comprehensive.io carries 10 labels and Mercer Total Remuneration Survey 33, so the shares are not directly comparable.
Named in three categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the compensation benchmarking data page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“starting with free tools like Pave's free tier, Comprehensive.io, or the BLS is recommended” Claude Haiku 4.5 · budget prompt · first choice
“use Pave, Comprehensive.io, or Ravio (free tiers) for deeper, role‑specific insights” GLM 4.7 FlashX · budget prompt · first choice
“Pave Market Data Lite (free) or Comprehensive.io (free)” DeepSeek V4 Flash · budget prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid: Traditional survey providers like Mercer, Korn Ferry, or Willis Towers Watson” GLM 4.7 FlashX · paraphrase prompt · hard negative
“You typically want to avoid enterprise-level firms (like Mercer or Willis Towers Watson)” Qwen 3.7 Flash · budget prompt · hard negative
“"Why you should avoid traditional providers (Mercer, Radford, Willis Towers Watson)"” Muse Glimmer 30B · negative prompt · hard negative
“The best compensation survey data for a mid-sized B2B company would be provided by companies like Mercer and Payscale, which are comprehensive for mid-to-large-sized companies.” Llama 4 Maverick · paraphrase prompt · first choice
“Mercer and WTW, by contrast, collect employer-submitted, verified payroll data directly from HR information systems (HRIS)... considered the definitive "source of truth"” Gemini 3.5 Flash · comparative prompt · first choice
“The global leader in human capital and compensation benchmarking... widely considered the gold standard for salary, benefits” Qwen 3.7 Flash · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.