HR AI Index
September 2026 Edition · The permanent record of this edition. The unqualified address always carries the latest edition.
Index Talent acquisition September 2026 Edition

Technical hiring assessments

Asked as “coding assessment platform”, and as “technical interview tool”, on behalf of a mid-market B2B company. 39 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Contested
28% of first choices, contested.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01HackerRank28%21%57accepted challenger
02CoderPad21%0%40accepted challenger
03Coderbyte13%8%13accepted challenger
04CodeSignal10%10%41accepted challenger
05TestGorilla5%16%31accepted challenger
06Codility5%32%44criticized challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.

Recommended versus criticized

Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.

Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative40%
Key
01HackerRank28%
02CoderPad21%
03Coderbyte13%
04CodeSignal10%
05TestGorilla5%
06Codility5%

02What they warned about

Seven of twelve models held their first choice under the paraphrase. GPT-5.4 mini, Mistral Small, Qwen 3.7 Flash, Kimi K2 and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Codility
32%
14 of 44 labels negative · 7 of 12 models · 3 hard negative
“it is often described as "quite pricey" ... Codility has had issues with "test integrity," where questions and answers are not sufficiently hidden from recruiters” GLM 4.7 FlashX, negative prompt
HackerRank
21%
12 of 57 labels negative · 7 of 12 models · 3 hard negative
“Users frequently complain about "overage fees." ... **Googleable Questions:** ... default assessments are often easily searchable online.” GLM 4.7 FlashX, negative prompt
TestGorilla
16%
5 of 31 labels negative · 4 of 12 models · 4 hard negative
“**Billing issues**: Multiple reviews mention unethical business practices, with charges continuing after cancellation” MiniMax M2.5, negative prompt
CodeSignal
10%
4 of 41 labels negative · 4 of 12 models · 1 hard negative
“It punishes deliberate, methodical thinking... a poor score on one application can actively destroy your chances with other companies” DeepSeek V4 Flash, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

62 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 6 of those lists are Google grounding redirects that name no site and are left out of the counts. 832 links across 149 sites, every framing counted. Ranked by the number of answers carrying the site or page.

vendor site · HackerRank35 answers · 77 citations · 10 models
vendor site · Codility33 answers · 41 citations · 10 models
vendor site · CodeSignal29 answers · 43 citations · 9 models
vendor site · Select Software Reviews24 answers · 25 citations · 9 models
vendor site · CodeSubmit23 answers · 26 citations · 8 models
vendor site · Goodfit17 answers · 17 citations · 8 models
vendor site · TestGorilla16 answers · 24 citations · 8 models
vendor site · TestTrick16 answers · 24 citations · 10 models
vendor site · CoderPad16 answers · 19 citations · 9 models
15 answers · 17 citations · 7 models
vendor site · InCruiter15 answers · 15 citations · 9 models
vendor site · Intervue13 answers · 15 citations · 6 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best coding assessment platform for a mid-market B2B company?”Paraphrase“Which technical interview tool would you recommend to a mid-sized B2B company?”Comparative“What are the top technical assessment platforms and how do they differ?”Budget-constrained“What is the best coding assessment platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a coding assessment platform. What should we look at?”Negative“Which technical assessment platforms should I avoid or be cautious about?”
Claude Haiku 4.5no first choiceno first choiceHeldGlider.ai
One alternativeMercer | Mettl
Coderbyte, TestGorilla
Two alternativesHackerEarth, TestDome
no first choicenothing named
GPT-5.4 miniHackerRank
Three alternativesCodeSignal, CoderPad, Codility
CodeSignal GrowChanged
Two alternativesCoderPad, HackerRank
HackerRank
Five alternativesCodeSignal, CoderPad, Codility, DevSkiller, TestDome
TestGorilla
One alternativeCodeSignal Build
against: Codility, HackerRank
no first choiceagainst: Codility, HackerRank
Gemini 3.5 FlashCoderPad
Three alternativesCodeSignal, HackerEarth, TestGorilla
against: HackerRank
CoderPadHeld
Two alternativesCodeSubmit, Woven
against: Codility, HackerRank
CoderPad
Four alternativesCodeSignal, HackerRank, Karat, Woven
Coderbyte, TestDome
Four alternativesAdaface, CoderPad, Playcode, TestGorilla
no first choiceagainst: CodeSignal, Codility, Glider.ai, HackerRank, Karat
Perplexity SonarHackerRank
Four alternativesCodeSignal, CoderPad, Coderbyte, Goodfit
HackerRankHeld
Two alternativesByteboard, CoderPad
no first choiceCoderbyte
One alternativeTestDome
against: HackerRank, Playcode, VS Code Live Share
no first choicenothing named
Grok 4.1 FastHackerRank
Two alternativesCodeSignal, Coderbyte
against: DevSkiller, LeetCode
HackerRankHeld
Three alternativesCodeSignal, CoderPad, Codility
against: LeetCode
HackerRank
Four alternativesCodeSignal, CoderPad, Codility, DevSkiller
Coderbyte
Three alternativesPlaycode, TestGorilla, VS Code Live Share
against: Codility, HackerRank
no first choiceagainst: Codility, Glider.ai, HackerRank, SkillCheck, TestGorilla, iMocha
Mistral SmallHackerRank
Two alternativesAugment Code, Coderbyte
CoderPadChanged
One alternativeHackerRank
Codility
Seven alternativesCodeSignal, CoderPad, HackerRank, Karat, WeCP, Woven, iMocha
no first choiceno first choiceagainst: LeetCode
DeepSeek V4 FlashCodeSignal
Three alternativesCodility, HackerRank, TestGorilla
CodeSignalHeld
One alternativeCoderPad
CodeSignal, HackerRank
Three alternativesCoderPad, Codility, TestGorilla
HackerRank, Qualified
Two alternativesCodeSubmit, CoderPad
against: TestGorilla
no first choiceagainst: CodeSignal, Codility, Glider.ai, HackerRank, TestGorilla
Llama 4 Maverickno first choice
Five alternativesCodeSignal, CoderPad, Coderbyte, Goodfit, HackerRank
no first choiceHeldno first choicePlaycode
One alternativeVS Code Live Share
no first choicenothing named
Qwen 3.7 FlashHackerRank
Three alternativesCodeSignal, TestDome, Vervoe
CoderPadChanged
Two alternativesCodeSignal, HackerRank
no first choiceCoderPad
Two alternativesDataLemur, HackerRank
no first choiceagainst: Coderbyte, SkillCheck, TestGorilla
Kimi K2Codility
Four alternativesCodeSignal, Coderbyte, HackerRank, TestGorilla
CoderPadChanged
Two alternativesCodeSignal, HackerRank
Codility, HackerRank
Six alternativesCodeSignal, CoderPad, DevSkiller, Karat, TestGorilla, Woven
CoderPad
Three alternativesCodeSignal, HackerRank, TestGorilla
against: Codility
no first choiceagainst: CodeSignal, Codility, HackerRank, LeetCode
GLM 4.7 FlashXHackerRank
One alternativeCodeSignal
against: Codility
HackerRankHeld
Two alternativesCodeSignal, CoderPad
against: Codility
no first choice
Nine alternativesCodeSignal, CodeSubmit, Codility, DevSkiller, HackerRank, Karat, Kodiva, TestGorilla, Woven
TestDome
One alternativeTestGorilla
against: Codility, HackerRank
no first choiceagainst: CodeSignal, Codility, HackerRank
MiniMax M2.5CodeSignal
Three alternativesAugment Code, HackerRank, TestGorilla
CodeSignal, HackerRankChanged
One alternativeCodility
no first choice
Six alternativesAdaface, Codility, HackerRank, Karat, TestGorilla, Unstop
Coderbyte, TestDome
Two alternativesCodeSignal Build, Playcode
CoderPad, Codility, HackerRank Projectsagainst: Codility, TestGorilla
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 20:05no04 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 21:11yes35 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 21:54yes1144 s
Direct recommendationPerplexity Sonarsonar2026-09-17 19:09yes206 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 20:43yes2718 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 19:56yes55 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-09-17 19:09yes2249 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 18:47yes54 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 17:58no028 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 18:47yes1248 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 21:03yes2856 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 19:47yes516 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 21:47no04 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 18:03yes45 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 20:03yes819 s
ParaphrasePerplexity Sonarsonar2026-09-17 21:35yes185 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 18:46yes4318 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 19:48yes54 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 19:45yes1616 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 19:25yes53 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 20:29yes1468 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 18:57yes1842 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 20:33yes1437 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 19:28no035 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 20:58yes99 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 18:32yes59 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 21:57yes1846 s
ComparativePerplexity Sonarsonar2026-09-17 18:37yes207 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 18:35yes2513 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 18:47yes1010 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 21:11yes1015 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 18:21yes53 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 20:59yes1025 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 19:23yes1430 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 17:54yes24113 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 21:47yes2033 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 21:23yes97 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 18:14yes37 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 20:06yes1523 s
Budget constrainedPerplexity Sonarsonar2026-09-17 20:44yes204 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 19:04yes3818 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 18:45yes54 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 18:12yes3041 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 19:34yes52 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 20:17no033 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 19:39yes2434 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 18:59yes2121 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 20:55yes914 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 18:20no09 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 20:53no08 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 19:54yes1326 s
Scale constrainedPerplexity Sonarsonar2026-09-17 19:02yes2013 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 19:03yes1311 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 20:38no08 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 21:21yes1921 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 18:13yes53 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 20:35no029 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 20:44yes1433 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 19:23yes923 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 20:23yes515 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 20:05no04 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 18:40yes38 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 22:03yes2151 s
Negative framingPerplexity Sonarsonar2026-09-17 21:22yes206 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 18:37yes4215 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 21:20yes55 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 19:10yes2442 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 21:23yes53 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 19:29yes528 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 21:30yes2529 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 20:20yes28115 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 19:03yes1018 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
Code Assess AI
CodePen
CodeSignal Grow
CodeSignal Projects
CoderPad Projects
CodinGame
DataLemur
Interviewing.io
Kodiva
Discontinued, still offered
No shut-down product was recommended here.
← Recruitment marketingVideo interviewing →