Nine of twelve models named Payscale first on the direct prompt; zero named Mercer. Payscale was named by twelve of the twelve models and Mercer by ten and both carry 28 labels, so the shares below are directly comparable.
Named in three categories this edition.
Named in four categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the compensation benchmarking data page.
Across every category in the September 2026 Edition, Payscale and Mercer were named in the same answer sixty-two times, of the 221 answers naming Payscale and the 109 naming Mercer. In those answers Mercer took the first choice eight times and Payscale eleven.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of four in this category shown.
“Avoid crowdsourced data (like Glassdoor or basic Payscale) as your primary source; it is often outdated or contains inflated self-reported figures.” Gemini 3.5 Flash · scale prompt · soft negative
“I'd suggest starting with Payscale or CompAnalyst as they offer the best balance of cost, data quality, and relevance to B2B roles” MiniMax M2.5 · paraphrase prompt · first choice
“OR Payscale (if you are traditional B2B/professional services) to establish your baseline corporate job architecture and salary bands” Gemini 3.5 Flash · paraphrase prompt · first choice
“I'd suggest starting with Payscale/CompAnalyst as it's specifically mentioned as ideal for broad US mid-market companies” MiniMax M2.5 · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid over-investing in Mercer/WTW unless you have global complexity” Kimi K2 · paraphrase prompt · hard negative
“Avoid traditional surveys (Mercer/Radford: $10k+/year) unless scaling.” Grok 4.1 Fast · budget prompt · hard negative
“high-end, legacy enterprise surveys like Mercer, Radford (Aon), or Willis Towers Watson (WTW)—which can easily cost $20,000 to $40,000+ annually—are generally out of reach” Gemini 3.5 Flash · budget prompt · soft negative
“Buy one major survey (like Robert Half or Mercer) to ensure you are paying within the 25th–75th percentiles” Qwen 3.7 Flash · paraphrase prompt · first choice
“The strongest fit from the results is Mercer or Salary.com/Compdata for broad benchmarking” Perplexity Sonar · paraphrase prompt · first choice
“Especially strong in pay and total rewards benchmarking, plus HR strategy.” GPT-5.4 mini · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.