Two of twelve models named CodeSignal first on the direct prompt; one named Codility. Both were named by all twelve models and CodeSignal carries 41 labels and Codility 44, so the shares are not directly comparable.
Named in three categories this edition.
Named in three categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the technical hiring assessments page.
Across every category in the September 2026 Edition, CodeSignal and Codility were named in the same answer 100 times, of the 141 answers naming CodeSignal and the 186 naming Codility. In those answers Codility took the first choice seven times and CodeSignal twelve.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“It punishes deliberate, methodical thinking... a poor score on one application can actively destroy your chances with other companies” DeepSeek V4 Flash · negative prompt · hard negative
“CodeSignal's scoring algorithm incorporates "speed" heavily ... can unfairly penalize candidates who are careful but methodical.” GLM 4.7 FlashX · negative prompt · soft negative
“Expensive compared to alternatives ... Assessments have been reported as "flawed" with technical issues” Kimi K2 · negative prompt · soft negative
“(or CodeSignal if you like the "certified engineer" benchmark). Both integrate with most ATS platforms” MiniMax M2.5 · paraphrase prompt · first choice
“Best for: All-around use, standardized pre-screening at scale, live technical interviews” DeepSeek V4 Flash · comparative prompt · first choice
“Popular ones like CoderPad or CodeSignal have better reps for collaborative/live coding.” Grok 4.1 Fast · negative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of five in this category shown.
“it is often described as "quite pricey" ... Codility has had issues with "test integrity," where questions and answers are not sufficiently hidden from recruiters” GLM 4.7 FlashX · negative prompt · hard negative
“Opaque scoring: Candidates and reviewers criticize edge-case scoring and lack of transparency” MiniMax M2.5 · negative prompt · hard negative
“Why we recommend avoiding HackerRank or Codility (for now)” Gemini 3.5 Flash · paraphrase prompt · hard negative
“Codility offers the best balance of capability, reputation, and price” Kimi K2 · direct prompt · first choice
“Often ranked as the best overall, especially for enterprise use.” Mistral Small · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.