Protocol Audit: Validity Screen for ADHD Accommodation Documentation
A service that checks ADHD test results for universities to ensure the evidence provided is valid.
A third-party audit service that re-scores the test tables inside ADHD accommodation documentation (Stroop, Trail Making, Verbal Fluency, WAIS-IV results) and flags files where two or more embedded validity indicators fail, so universities and exam bodies can request better evidence before granting extended time or other accommodations.
Concept
A documentation-audit service for the gatekeepers who grant ADHD accommodations. Universities, licensing bodies, and testing agencies receive evaluation reports supporting requests for extended exam time or workplace accommodations; today they rely almost entirely on the evaluating clinician's attestation. The service re-scores the score tables routinely included in those reports (Stroop Color and Word Test, Trail Making Test, Verbal Fluency Test, and WAIS-IV figures), computes the six embedded validity indicators, applies the validated fail-any-two-of-six rule, and returns a short memo: "documentation consistent with credible performance" or "two or more validity indicators failed — request supplementary validity evidence before finalizing the accommodation." The wedge: gatekeepers get an objective, standardized screen without employing a neuropsychologist and without asking the examinee to sit any new test; a flag triggers a request for more information, never an automatic denial.
Why now
- The new study supplies a cleanly packaged decision rule fit for this use: across 585 adult ADHD referrals, six embedded indicators from four routinely administered tests classified valid versus invalid performance at AUC .86, and failing any two of the six achieved ≥90% specificity with ~60% sensitivity — meaning fewer than one in ten credible performers would be flagged, the operating characteristic a gatekeeper needs to apply the screen fairly and defensibly.
- Adult ADHD accommodation and stimulant documentation volume has grown sharply with telehealth assessment, and gatekeepers currently have no standardized way to check it; the demonstrated rule is computable from scores already printed in the reports they receive, so the audit requires no new testing of any examinee.
- The paper's stated limitation — multivariate EVI models explain at most 36% of variance in validity status, and chaining indicators helps only to an extent — is built into the service design: results are framed as a screen prompting further documentation, not a determination of malingering.
Written by GLM · 11 Oct 2026
AI assessment
A highly focused B2B audit service that leverages a specific, high-specificity decision rule to help institutional gatekeepers verify ADHD documentation without requiring new testing.
- Evidence strength 5/5
- The idea is directly derived from a large-scale study (n=585) providing a specific, computable decision rule (fail-any-two-of-six) with high specificity (≥90%), supported by multiple corroborating papers on WAIS-IV and other embedded indicators.
- Market pull 4/5
- High-stakes testing bodies (ETS, College Board, LSAC) and universities have a strong incentive to prevent fraud and ensure the integrity of accommodations, especially given the rise in telehealth assessments.
- Novelty & moat 2/5
- The idea is nearly identical to the 'Two-Fail Flag' existing idea in the catalog, differing primarily in its framing as a third-party audit service rather than just software.
- Feasibility 5/5
- The MVP is extremely simple: a manual or semi-automated calculator that takes existing table data and applies a fixed mathematical rule to generate a memo.
- Wedge clarity 5/5
- The wedge is exceptionally sharp: a specific screen for a specific set of tests to solve a specific problem (documentation validity) for a specific set of buyers (gatekeepers).
- Simplicity / focus 5/5
- The product is a single, focused utility—an audit screen—avoiding the 'platform' trap by sticking to one clear value proposition.
Scored by Gemma 4 · 12 Oct 2026. Rated against a fixed rubric (evidence, market, novelty, feasibility, wedge, simplicity), relative to the closest ideas already in the catalog. A prior estimate to compare ideas before real-world signal arrives.
Persona discussion
AI personas trained on real people's expertise debate this idea as it evolves.
View the discussion →Act on this idea
Ideas only matter if someone runs with them. Your message goes straight to the founder's inbox — nothing is stored on our servers.
Business analysis
The framework reveals a strong product-market fit driven by the surge in telehealth ADHD assessments and a clear technological path using existing data. However, it exposes significant legal and social risks regarding racial bias in neuropsychological norms and the potential for litigation if the screen is perceived as a tool for denying disability rights.
Political2
Economic3
Social3
Technological3
Environmental1
Legal3
The viability of this service depends heavily on legal and social factors, specifically disability law, accessibility regulations, and the ethical implications of flagging medical documentation. · Generated 2026-10-12 by Gemma 4AI-generatedFull PESTEL Analysis →
Who benefits
- Law School Admission Council (LSAC)organization
LSAC reviews thousands of LSAT accommodation requests supported by ADHD documentation; an objective embedded-validity screen gives it a standardized, defensible basis for requesting supplementary evidence before granting extended time.
- Educational Testing Service (ETS)organization
Reviews accommodation requests for exams such as the GRE; a numeric DCT verification standard and a missing-validity-measure flag make ADHD documentation review more consistent and defensible.
- SALT Center, University of Arizonaorganization
Provides support services to ADHD students and reviews documentation to allocate resources; an audit flag for failed or missing validity checks helps target scarce support where it is warranted.
- National Board of Medical Examiners (NBME)organization
Handles USMLE accommodation requests; verified standalone validity evidence protects the integrity of high-stakes licensing accommodations.
AHEAD sets the documentation standards used by US college disability offices; it could adopt the fail-two-of-six rule as a recommended validity check in its guidance, giving member offices a concrete, evidence-based threshold.
- National Conference of Bar Examinersorganization
Bar examinees routinely request extended time based on adult ADHD evaluations; a validity audit of submitted score tables gives bar administrators a consistent, documented review step across jurisdictions.
- The College Boardorganization
Administers SAT accommodations; an auditable validity standard reduces inconsistent approvals across reviewers and documentation sources.
This office reviews hundreds of ADHD documentation packets each year with limited clinical staff; the audit service reduces sole reliance on clinician attestation and standardizes decisions across reviewers.
The professional association for higher-education disability service providers; a documented audit rubric for ADHD files gives members a uniform, defensible review standard.
Research it builds on
- Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) processing speed scores as measures of noncredible responding: The third generation of embedded performance validity indicators.László A. Erdődi, Christopher A. Abeare, Jonathan D. Lichtenstein et al. · 2016 · 126 citationsAll ideas from this paper →
- Cross-validating the Dot Counting Test Among an Adult ADHD Clinical Sample and Analyzing the Effect of ADHD Subtype and Comorbid PsychopathologyDayna A. Abramson, Daniel J. White, Tasha Rhoads et al. · 2021 · 43 citationsAll ideas from this paper →
- Multivariate examination of embedded indicators of performance validity for ADHD evaluations: A targeted approachJohn‐Christopher A. Finley, Julia M. Brooks, Amanda N. Nili et al. · 2023 · 43 citationsAll ideas from this paper →
- Stronger Together: The Wechsler Adult Intelligence Scale—Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain InjuryLászló A. Erdődi, Christopher A. Abeare · 2019 · 38 citationsAll ideas from this paper →
- Comparing embedded performance validity indicators within the WAIS-IV Letter-Number sequencing subtest to Reliable Digit Span among adults referred for evaluation of attention-deficit/hyperactivity disorderJohn‐Christopher A. Finley, Violeta J. Rodriguez, Brian M. Cerny et al. · 2024 · 16 citationsAll ideas from this paper →
- A Direct Comparison of 10 WAIS-IV Digit Span Embedded Validity Indicators among a Mixed Neuropsychiatric Sample with Varying Degrees of Cognitive ImpairmentZachary J. Resch, Brian M. Cerny, Gabriel P. Ovsiew et al. · 2022 · 12 citationsAll ideas from this paper →
- The Recognition Memory Test Examination of ethnic differences and norm validitySid E. O’Bryant · 2003 · 8 citationsAll ideas from this paper →
- The Recognition Memory Test Examination of ethnic differences and norm validitySid E. O’Bryant, Robin C. Hilsabeck, Robert J. McCaffrey et al. · 2003 · 6 citationsAll ideas from this paper →
- Identifying Factors that Increase False-Positive Rates on Embedded Performance Validity Testing in ADHD EvaluationsJohn‐Christopher A. Finley, Logan M. Tufty, Steven A. Abalos et al. · 2024 · 4 citationsAll ideas from this paper →
- Assessment of cultural bias on the PdPVTS across gender and racial/ethnic groups.Robert J. McCaffrey, Cecil R. Reynolds, Julie K. Lynch et al. · 2022 · 4 citationsAll ideas from this paper →