Zero of fourteen models named Gusto first on the direct prompt; one named Paylocity. Both were named by all fourteen models and Gusto carries 49 labels and Paylocity 31, so the shares are not directly comparable.
Named in twenty-four categories this edition.
Named in twenty categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the payroll software page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. One of one in this category shown.
“Small US business with <500 employees, no HR department: Start with Gusto for simplicity and transparency.” GLM 4.7 FlashX · comparative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of four in this category shown.
“Be cautious with these payroll platforms... Paylocity: Frequent complaints about poor customer service, glitchy platform” Grok 4.1 Fast · negative prompt · hard negative
“Paylocity - Some users have reported subpar customer support and technical issues with the platform.” Llama 4 Maverick · negative prompt · hard negative
“Unresponsive customer support ... Glitchy software that's difficult to navigate” DeepSeek V4 Flash · negative prompt · hard negative
“Paylocity: Highly rated for its balance of flexibility, HR tools, and ease of use in the mid-market space.” Qwen 3.7 Flash · scale prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.