Technical hiring assessments
Asked as “coding assessment platform”, and as “technical interview tool”, on behalf of a mid-market B2B company. 58 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
17%
Contested · CodeSignal 16%
17HackerRank16CodeSignal10CoderPad57others
17% of first choices, contested.
Since September 2026▼−12Since September 2026: 28% → 16%, −12 points. Inside the 13-point floor: within noise. Read over the models both editions asked.HackerRank held the lead, −12 points on 28%, inside the 13-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Coderbyte22%Contested↗new leaderNew leader since September 2026: Coderbyte (23%) replaces CoderPad (26% then, 15% now), 8 points clear, inside the 13-point floor.Standing →Mid-market
HackerRank17%Contested▼−12Since September 2026: 28% → 16%, −12 points. Inside the 13-point floor: within noise. Read over the models both editions asked.This pageEnterpriseHackerRank51%Clear leader▲+7Since September 2026: 42% → 49%, +7 points. Inside the 13-point floor: within noise. Read over the models both editions asked.Standing →
Coderbyte22%Contested↗new leaderNew leader since September 2026: Coderbyte (23%) replaces CoderPad (26% then, 15% now), 8 points clear, inside the 13-point floor.Standing →Mid-marketHackerRank17%Contested▼−12Since September 2026: 28% → 16%, −12 points. Inside the 13-point floor: within noise. Read over the models both editions asked.This pageEnterpriseHackerRank51%Clear leader▲+7Since September 2026: 42% → 49%, +7 points. Inside the 13-point floor: within noise. Read over the models both editions asked.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01HackerRank17%22%64accepted challenger▼−12Since September 2026: 28% → 16%, −12 points. Inside the 13-point floor: within noise. Read over the models both editions asked.28% → 16%
HackerRank17%22%64accepted challenger▼−12Since September 2026: 28% → 16%, −12 points. Inside the 13-point floor: within noise. Read over the models both editions asked.28% → 16%02
CodeSignal16%17%58accepted challenger▲+6Since September 2026: 10% → 16%, +6 points. Inside the 13-point floor: within noise. Read over the models both editions asked.10% → 16%
CodeSignal16%17%58accepted challenger▲+6Since September 2026: 10% → 16%, +6 points. Inside the 13-point floor: within noise. Read over the models both editions asked.10% → 16%03
CoderPad10%6%52accepted challenger▼−10Since September 2026: 21% → 10%, −10 points. Inside the 13-point floor: within noise. Read over the models both editions asked.21% → 10%
CoderPad10%6%52accepted challenger▼−10Since September 2026: 21% → 10%, −10 points. Inside the 13-point floor: within noise. Read over the models both editions asked.21% → 10%04Coderbyte10%9%22accepted challenger▼−3Since September 2026: 13% → 10%, −3 points. Inside the 13-point floor: within noise. Read over the models both editions asked.13% → 10%
Coderbyte10%9%22accepted challenger▼−3Since September 2026: 13% → 10%, −3 points. Inside the 13-point floor: within noise. Read over the models both editions asked.13% → 10%05
TestGorilla10%32%28criticized challenger▲+5Since September 2026: 5% → 10%, +5 points. Inside the 13-point floor: within noise. Read over the models both editions asked.5% → 10%
TestGorilla10%32%28criticized challenger▲+5Since September 2026: 5% → 10%, +5 points. Inside the 13-point floor: within noise. Read over the models both editions asked.5% → 10%06
Codility9%25%53accepted challenger▲+5Since September 2026: 5% → 10%, +5 points. Inside the 13-point floor: within noise. Read over the models both editions asked.5% → 10%
Codility9%25%53accepted challenger▲+5Since September 2026: 5% → 10%, +5 points. Inside the 13-point floor: within noise. Read over the models both editions asked.5% → 10%07
HackerEarth7%13%15accepted challenger▲+8Since September 2026: 0% → 8%, +8 points. Inside the 13-point floor: within noise. Read over the models both editions asked.0% → 8%
HackerEarth7%13%15accepted challenger▲+8Since September 2026: 0% → 8%, +8 points. Inside the 13-point floor: within noise. Read over the models both editions asked.0% → 8%08
DevSkiller2%0%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 13-point floor: within noise. Read over the models both editions asked.0% → 0%
DevSkiller2%0%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 13-point floor: within noise. Read over the models both editions asked.0% → 0%Show the one product at 0%, ordered by negative rate
09
Karat0%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 13-point floor: within noise. Read over the models both editions asked.0% → 0%
Karat0%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 13-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 13 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All twenty-eight head-to-head pages: the top eight products, each against each
HackerRank vs TestGorillaHackerRank vs CodilityHackerRank vs HackerEarthHackerRank vs DevSkillerCodeSignal vs CoderPadCodeSignal vs CoderbyteCodeSignal vs TestGorillaCodeSignal vs CodilityCodeSignal vs HackerEarthCodeSignal vs DevSkillerCoderPad vs CoderbyteCoderPad vs TestGorillaCoderPad vs CodilityCoderPad vs HackerEarthCoderPad vs DevSkillerCoderbyte vs TestGorillaCoderbyte vs CodilityCoderbyte vs HackerEarthCoderbyte vs DevSkillerTestGorilla vs CodilityTestGorilla vs HackerEarthTestGorilla vs DevSkillerCodility vs HackerEarthCodility vs DevSkillerHackerEarth vs DevSkiller
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
010203040506070809Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative30%
Key
01HackerRank17%
HackerRank17%02CodeSignal16%
CodeSignal16%03CoderPad10%
CoderPad10%04Coderbyte10%
Coderbyte10%05TestGorilla10%
TestGorilla10%06Codility9%
Codility9%07HackerEarth7%
HackerEarth7%08DevSkiller2%
DevSkiller2%09Karat0%
Karat0%What they warned about
Three of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5, GPT-6 Luna and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
HackerRank22%
14 of 64 labels negative · 13 of 14 models · 5 hard negative
“**LeetCode-style algorithm challenge platforms** (e.g., HackerRank, Codility, CodeSignal): While widely used, these are often criticized for not reflecting real-world job tasks” Mistral Small, negative prompt
Codility25%
13 of 53 labels negative · 10 of 14 models · 5 hard negative
“Avoid if budget is the main constraint... Codility tends to start higher and is more enterprise-oriented” GPT-5.4 mini, budget prompt
CodeSignal17%
10 of 58 labels negative · 8 of 14 models · 4 hard negative
“**Avoid enterprise-only platforms** like CodeSignal, which require contacting sales and have no transparent pricing” DeepSeek V4 Flash, budget prompt
TestGorilla32%
9 of 28 labels negative · 6 of 14 models
“**TestGorilla-style general testing platforms** when your need is deep technical screening, because they are broader assessment suites rather than specialized developer tools.” Perplexity Sonar, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
76 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1035 links across 190 sites, every framing counted. Ranked by the number of answers carrying the site or page. 10 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · HackerRank48 answers · 112 citations · 14 models
vendor site · Codility35 answers · 50 citations · 13 models
32 answers · 36 citations · 10 models
vendor site · G226 answers · 42 citations · 12 models
vendor site · CodeSignal25 answers · 37 citations · 10 models
vendor site · TestGorilla23 answers · 37 citations · 11 models
vendor site · Adaface23 answers · 27 citations · 11 models
vendor site · CoderPad22 answers · 26 citations · 9 models
vendor site · TestTrick18 answers · 19 citations · 9 models
vendor site · Intervue17 answers · 23 citations · 10 models
vendor site · Fueler17 answers · 19 citations · 10 models
vendor site · Testlify17 answers · 17 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
32 answers · 12 models
27 answers · 11 models
27 answers · 10 models
18 answers · 10 models
17 answers · 7 models
16 answers · 10 models
15 answers · 9 models
13 answers · 7 models
12 answers · 9 models
12 answers · 8 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best coding assessment platform”, “coding assessment platform”, “technical assessment platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| HackerRank hackerrank.com | 17% | 248 | 33,100 | 1,116 | 58,699 | 22 | 4 | |
| CodeSignal codesignal.com | 16% | 173 | 14,800 | 548 | 152,420 | $5,323 | 23 | 9 |
| CoderPad coderpad.io | 10% | 133 | 18,100 | 269 | 34,657 | 9 | 2 | |
| Coderbyte coderbyte.com | 10% | 82 | 2,400 | 60 | 2,019 | 93 | ||
| TestGorilla testgorilla.com | 10% | 253 | 4,400 | 170 | 58,548 | $462 | 76 | |
| Codility codility.com | 9% | 199 | 3,600 | 114 | 3,042 | $108 | 3 | |
| HackerEarth hackerearth.com HackerEarth 7%, HackerEarth Assessments 2% | 9% | 40 | 1,300 | 48 | 47,481 | 0 | 8 | |
| TestDome testdome.com | 7% | 39 | 880 | 22 | 34,709 | 0 | ||
| Goodfit goodfit.so | 3% | 8 | ||||||
| DevSkiller devskiller.com | 2% | 19 | 140 | 2 | 48 |
Google's top ten for the three searches hold 20 sites; 3 of them are among the sites the models cited here (coderpad.io, codesignal.com, hackerrank.com). The first result for “best coding assessment platform” is algocademy.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best coding assessment platform for a mid-market B2B company?”Paraphrase“Which technical interview tool would you recommend to a mid-sized B2B company?”Comparative“What are the top technical assessment platforms and how do they differ?”Budget-constrained“What is the best coding assessment platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a coding assessment platform. What should we look at?”Negative“Which technical assessment platforms should I avoid or be cautious about?”
Claude Haiku 4.5HackerEarth, TestGorillano first choiceChangedHackerRankCoderbyteno first choiceagainst: CodeSignal, CoderPad, Codility, HackerRank
One alternative
CodeSignalFour alternatives
CodeSignal, CoderPad, Codility, TestGorillaThree alternatives
CoderPad, Codility, TestGorillaGPT-5.4 miniHackerRankagainst: Mercer | MettlHackerRankHeldHackerRankagainst: TestGorillaCoderbyteagainst: Codility, HackerRankno first choicenothing named
Two alternatives
CodeSignal, CodilityTwo alternatives
CoderPad, KaratThree alternatives
CodeSignal, CoderPad, CodilityTwo alternatives
CodeSignal Build, TestGorillaGemini 3.5 FlashCoderPad, Wovenagainst: Byteboard, KaratCoderPadChangedCodility, HackerRankagainst: TestGorillaTestDomeagainst: TestGorillaCodeSignal, CoderPadagainst: CodeSignal, Glider.ai, HackerRank, HireVue, Karat, TestDome
One alternative
CodeSignalThree alternatives
Byteboard, CodeSignal, WovenFour alternatives
CodeSignal, CoderPad, Coderbyte, KaratTwo alternatives
CodeSubmit, CoderbyteTwo alternatives
Codility, HackerRankPerplexity SonarCodeSignalagainst: CodilityCodeSignalHeldHackerRankHackerRank, TestGorillaagainst: Playcode, VS Code Live Shareno first choiceagainst: TestGorilla
Two alternatives
Coderbyte, DevSkillerThree alternatives
HireVue, Lever, Spark HireFour alternatives
CodeSignal, CoderPad, Codility, TestlifyOne alternative
HackerEarthGrok 4.1 FastHackerRankHackerRankHeldagainst: Codility, LeetCodeHackerRankagainst: HackerEarth, LeetCodeCoderbyteagainst: Codility, HackerRankHackerRankagainst: CodeSignal, Coderbyte, Codility, HackerRank
Four alternatives
CodeSignal, CoderPad, Coderbyte, CodilityTwo alternatives
CodeSignal, CoderPadSix alternatives
CodeSignal, CoderPad, Codility, DevSkiller, TestGorilla, TestlifyTwo alternatives
CoderScreen, LeetCodeFour alternatives
CodeSignal, CoderPad, Codility, HackerEarthMistral SmallGoodfitCodility, HackerRankChangedno first choiceHackerEarthno first choiceagainst: AbilityScreen, CodeSignal, Codility, HackerRank, TestGorilla
One alternative
HackerRankOne alternative
TalviewTwo alternatives
Playcode, VS Code Live ShareDeepSeek V4 FlashCodilityCoderPadChangedHackerRankagainst: HireVue, LeetCodeHackerEarth Assessments, TestGorillaagainst: CodeSignal, CoderbyteCodility, HackerRankagainst: CodeSignal, Codility, HackerRank, HireVue, Workday
Two alternatives
CodeSignal, HackerRankTwo alternatives
HackerRank, KaratThree alternatives
CodeSignal, CoderPad, CodilityThree alternatives
CoderPad, Criteria Corp, TestDomeThree alternatives
CodeSignal, CoderPad, QualifiedLlama 4 MaverickGoodfitIntervueChangedno first choiceHackerEarthno first choiceagainst: HackerEarth, HackerRank
Three alternatives
CodeSignal, Coderbyte, HackerRankThree alternatives
AI Interviewer, Braintrust AIR, HireVueTwo alternatives
Playcode, VS Code Live ShareQwen 3.7 FlashCodeSignalCoderPadChangedno first choiceCodeSignal, TestDomeno first choiceagainst: Codility, HackerRank, LeetCode, TestDome, eSkill, iMocha
Four alternatives
CoderPad, Codility, TestGorilla, VoomerFive alternatives
CodeSignal, DataCamp, HackerRank, TestDome, VoomFour alternatives
CoderPad, Goodfit, HackerRank Community, VervoeKimi K2Coderbyteagainst: CodilityCodeSignalChangedHackerRankagainst: TestGorillaCoderbyte, TestDomeagainst: CodeSignal, TestGorillano first choiceagainst: CodeSignal, Codility, HackerRank, TestGorilla
Two alternatives
HackerRank, TestGorillaThree alternatives
CoderPad, Coderbyte, HackerRankFour alternatives
CodeSignal, CoderPad, Codility, iMochaGLM 4.7 FlashXCodility, TestGorillaCodeSignalChangedCoderPad, HackerRank, TestGorillaTests4Geeksagainst: Criteria Corp, LeetCodeno first choiceagainst: CodeSignal, CoderPad, HackerRank, TestGorilla
Three alternatives
CodeSignal, Coderbyte, HackerRankThree alternatives
HackerRank, Hirevire, KaratThree alternatives
CodeSignal, Codility, DevSkillerFour alternatives
CodeSignal, Goodfit, Playcode, VS Code Live ShareMiniMax M2.5CodilityCodeSignalChangedHackerRankHackerEarth, TestGorillano first choiceagainst: CodeSignal, CoderPad, Codility, HackerRank
Three alternatives
AssessHub, CoderPad, HackerRankThree alternatives
CoderPad, Codility, HackerRankFour alternatives
CodeSignal, CoderPad, Codility, TestTrickThree alternatives
CoderPad, Codility, HackerRankGPT-6 LunaCodeSignal Hire GrowCoderPadChangedHackerRankCoderbyteno first choiceagainst: HackerRank, HireVue
Two alternatives
CoderPad, HackerRankTwo alternatives
CodeSignal, HackerRankFour alternatives
CodeSignal, CoderPad, Codility, QualifiedTwo alternatives
CodeSignal, CoderScreenMuse Glimmer 30BCodeSignal, DevSkiller, HackerRankHackerRankChangedCodeSignal, Codility, HackerRankTestDome, TestGorillano first choiceagainst: Codility, HackerRank, HireVue, Pymetrics
One alternative
CodilityTwo alternatives
CoderPad, CodilityThree alternatives
CoderPad, Mercer | Mettl, TestGorillaThree alternatives
Adaface, Coderbyte, LeetCodeBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:18 | yes | 19 | 11 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:24 | yes | 4 | 6 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 12:18 | yes | 18 | 63 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 10:59 | yes | 19 | 3 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:05 | yes | 23 | 8 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:42 | yes | 5 | 23 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:39 | yes | 25 | 36 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:24 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:19 | no | 0 | 27 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 07:39 | yes | 20 | 23 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:47 | yes | 23 | 38 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 07:54 | yes | 9 | 14 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:23 | yes | 3 | 14 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:41 | yes | 14 | 17 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:19 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:58 | yes | 3 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:06 | yes | 8 | 24 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 10:16 | yes | 20 | 4 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 07:45 | yes | 24 | 7 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:35 | yes | 5 | 2 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:24 | yes | 23 | 30 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:24 | yes | 5 | 4 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:35 | no | 0 | 28 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:00 | yes | 15 | 16 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:57 | yes | 24 | 27 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:02 | yes | 10 | 33 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:32 | yes | 4 | 13 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:44 | yes | 15 | 20 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:27 | yes | 9 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:37 | yes | 9 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:24 | yes | 19 | 29 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 09:17 | yes | 19 | 4 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:13 | yes | 23 | 11 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:51 | yes | 7 | 6 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:12 | yes | 22 | 40 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:27 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:01 | yes | 5 | 18 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:39 | yes | 14 | 26 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:57 | yes | 24 | 39 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:21 | yes | 10 | 17 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:27 | yes | 6 | 25 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:48 | yes | 14 | 26 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:24 | yes | 10 | 7 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:07 | yes | 5 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:25 | yes | 14 | 21 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 08:26 | yes | 19 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:41 | yes | 22 | 17 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:07 | yes | 5 | 3 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:13 | yes | 22 | 20 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:35 | yes | 6 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:48 | yes | 12 | 56 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:47 | yes | 12 | 22 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:25 | yes | 8 | 19 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:11 | yes | 5 | 11 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:35 | yes | 3 | 18 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:10 | yes | 13 | 18 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:02 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:01 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:49 | yes | 12 | 27 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 11:11 | yes | 19 | 5 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:52 | no | 0 | 10 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:54 | no | 0 | 6 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:49 | yes | 19 | 39 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:54 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:54 | no | 0 | 32 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:01 | yes | 14 | 21 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:10 | yes | 14 | 24 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 07:57 | yes | 5 | 23 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:40 | yes | 3 | 16 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 07:51 | yes | 15 | 36 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:15 | yes | 19 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:30 | yes | 6 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:42 | yes | 26 | 27 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 08:13 | yes | 19 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:50 | yes | 23 | 14 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:21 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:32 | yes | 25 | 29 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:57 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:26 | yes | 23 | 32 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:12 | yes | 25 | 25 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:48 | yes | 25 | 34 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:18 | yes | 15 | 25 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:21 | yes | 3 | 32 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:43 | yes | 25 | 44 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
AssessCode
AssessHub
CodeSignal Hire Grow
Codewars
Codio
Devocean
Edabit
Exercism
HackerRank Community
HireRiff
Kodiva
Kodiva.ai
LeetCode Groups
LeetCode for Employers
LeetCode for Enterprise
Mimo
Murekaba
Tests4Geeks
Voom
Voomer
Discontinued, still offered
No shut-down product was recommended here.