Two of fourteen models named PlanSource first on the direct prompt; zero named Namely. PlanSource was named by twelve of the fourteen models and Namely by ten and PlanSource carries 31 labels and Namely 14, so the shares are not directly comparable.
Named in three categories this edition.
Named in thirteen categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the benefits administration page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“the product "seems designed to trip up customers and make it difficult to cancel"” GLM 4.7 FlashX · negative prompt · hard negative
“Primary Concern: Complexity and "black box" support.” Qwen 3.7 Flash · negative prompt · hard negative
“bswift/PlanSource (enterprise) get similar scalability complaints but fewer public reviews” Grok 4.1 Fast · negative prompt · soft negative
“Best for a dedicated benefits administration platform → PlanSource – built around enrollment automation and carrier connectivity” GLM 4.7 FlashX · direct prompt · first choice
“"Best for a dedicated benefits administration platform: PlanSource, built around enrollment automation and carrier connectivity."” Muse Glimmer 30B · direct prompt · first choice
“### 1. PlanSource — Best for dedicated benefits-only platform” GLM 4.7 FlashX · paraphrase prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of four in this category shown.
“PlanSource & Namely ... force users to spend excessive time troubleshooting reporting errors” Qwen 3.7 Flash · negative prompt · hard negative
“Namely is repeatedly called out as a mid-size fit when you want benefits enrollment tied to HR records and payroll deductions.” Muse Glimmer 30B · paraphrase prompt · first choice
“Request demos from ADP, Gusto, and Namely (most frequently recommended for your size)” MiniMax M2.5 · paraphrase prompt · first choice
“Namely – Best Overall for Mid-Sized Companies” Kimi K2 · paraphrase prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.