Six of twelve models named HackerRank first on the direct prompt; one named Codility. Both were named by all twelve models and HackerRank carries 57 labels and Codility 44, so the shares are not directly comparable.
Named in four categories this edition.
Named in three categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the technical hiring assessments page.
Across every category in the September 2026 Edition, HackerRank and Codility were named in the same answer 163 times, of the 233 answers naming HackerRank and the 186 naming Codility. In those answers Codility took the first choice seven times and HackerRank thirty-four.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“Users frequently complain about "overage fees." ... Googleable Questions: ... default assessments are often easily searchable online.” GLM 4.7 FlashX · negative prompt · hard negative
“buggy UI/UX ... High drop-off rates and "horrible experience" sentiments” Grok 4.1 Fast · negative prompt · hard negative
“Why we recommend avoiding HackerRank or Codility (for now)” Gemini 3.5 Flash · paraphrase prompt · hard negative
“Qualified (free) and HackerRank Starter ($99/mo) offer the best balance of cost, reliability, and candidate familiarity” DeepSeek V4 Flash · budget prompt · first choice
“Best for: End-to-end enterprise technical hiring. ... broadest platform and largest general hiring workflow” GPT-5.4 mini · comparative prompt · first choice
“the best *default* choice is usually HackerRank if your priority is technical hiring at scale” Perplexity Sonar · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of five in this category shown.
“it is often described as "quite pricey" ... Codility has had issues with "test integrity," where questions and answers are not sufficiently hidden from recruiters” GLM 4.7 FlashX · negative prompt · hard negative
“Opaque scoring: Candidates and reviewers criticize edge-case scoring and lack of transparency” MiniMax M2.5 · negative prompt · hard negative
“Why we recommend avoiding HackerRank or Codility (for now)” Gemini 3.5 Flash · paraphrase prompt · hard negative
“Codility offers the best balance of capability, reputation, and price” Kimi K2 · direct prompt · first choice
“Often ranked as the best overall, especially for enterprise use.” Mistral Small · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.