Research paperWorking paperARR-2026-3CE622KFZ49A5BKA · v1 · 2026-11-01

Technological Design and Durable Independent Learning

Lluis Eriksson

Citable version that has not completed AIRR screening. Not peer reviewed. Screening record

Abstract

Access to technology can improve performance during practice without producing competence that persists when assistance is removed. This article examines a more specific hypothesis than the general superiority of technology: instructional designs that preserve independent attempts while supporting feedback, retrieval and subsequent application may increase durable independent learning within a fixed study period. A critical narrative synthesis of thirteen research publications, supplemented by two contextual sources on El Salvador, brings together research on learning, computer tutoring, generative artificial intelligence and chess. Findings include benefits, null effects and harms. They do not establish a universal technological advantage or isolate technology as the cause of historical improvements in chess. The proposed framework distinguishes the organization of practice from the cognitive operations learners are intended to acquire. It operationalizes an observable attempt, feedback and reapplication cycle without treating cycle frequency as evidence of learning by itself. A proposed four-arm randomized trial compares active print study, fixed digital practice, constrained adaptive digital practice and direct access to solutions, with common core blocks protecting scheduled syllabus coverage. The primary outcome is unaided performance on novel chess positions four weeks after training. Improved assisted performance without a delayed advantage would not establish durable learning. The contribution is a falsifiable research framework and a proposed protocol, rather than a new empirical finding or a registered study.

Preview PDF on this page v1

Uses your browser's PDF viewer. Open the PDF directly if a preview is unavailable.

Reference this work

Cite this paper

v1 · 2026-11-01

Lluis Eriksson (2026). Technological Design and Durable Independent Learning. AIRR.SCIENCE, ARR-2026-3CE622KFZ49A5BKA, v1. https://airr.science/papers/ARR-2026-3CE622KFZ49A5BKA/versions/v1/ Research preprint; ARR-2026-3CE622KFZ49A5BKA v1. Not peer reviewed by AIRR. Working paper; not admitted to the AIRR accepted collection.

Use this version link to cite the manuscript you read. A Working paper label means the version has not completed AIRR screening. AIRR screening is not journal peer review. Import BibTeX, RIS or CSL JSON into your reference manager to apply a citation style.

Version history

The paper identifier remains stable. Each version has its own immutable release, timestamp and version identifier.

  • v1 · source snapshot available · viewing

Verification record

Frontier-model screening
Not assessed
Source integrity
Pass
Bibliographic integrity
Partial
Reproducibility
Partial
Lean 4
Not applicable

Recorded under ARR-VERIFY-1.0. AIRR verification and screening are not peer review.

AI assistance statement

Codex assisted research, drafting, translation and revision. Internal gpt-6-astra and gpt-6.1-sol helped specify provisional appendices and reviewed this exact PDF in separate fresh contexts without drafting history or other reports; both declare involved_in_manuscript. Their unchanged reports recommend minor revision, scores 3.2 and 3.3 on the AIRR Millennium scale, with zero unresolved material objections. This is not independent human review, validation of the proposed trial or editorial acceptance. Original parent-PDF reviews included Gemini 4 Argon and are not treated as assessments of these changed bytes. No original participant data were collected. No specific funding or additional relevant financial ties; author operates AIRR.

Frontier-model screening

Status: not_assessed. Any listed reports correspond to this exact version under ARR-SCREEN-1.0; no absent assessment is represented as a pass.

    Longitudinal frontier-model record

    Model assessments and review context

    Read the scale and limits
    3.25 / 10.00Acceptable
    Distinct models
    2
    Range
    3.20–3.30
    Method
    bounded capability-weighted mean · exact version only

    Limited evidence · 0/2 benchmark matches. This is an evidence description, not a probability of correctness.

    Fresh blinded review context not documented for every model; Mathematical benchmark not applied to this subject; Adverse reports or unresolved objections require editorial disposition

    Score calculation and evidence

    Unweighted mean: 3.25. Policy: AIRR-RATING-1.0. Method and limits.

    ModelOriginal scoreWeightBasis
    OpenAI · gpt-6.1-sol3.301.000Benchmark outside declared mathematical scope
    OpenAI (Codex internal) · gpt-6-astra3.201.000Benchmark outside declared mathematical scope

    Download the calculation snapshot

    OpenAI (Codex internal) · gpt-6-astra · involved in manuscript · review context: unknown3.20

    Preserved intake report, displayed with its original protocol, date and findings. Read the native report. Native file SHA-256: 324d73d0ba3064fe82399ba5f84ebb577b2455965be3796f670dd5408976866f.

    Recommendation: Minor Revision · Material objections: 0

    This exact 19-page artifact is a cautious narrative synthesis and research proposal, not an executed trial. I read all pages, verified the SHA-256, recomputed the normal-approximation sample size and precision figures, checked both illustrative positions by legal-move enumeration, and performed targeted online source checks. I found no unresolved material objection invalidating its limited central claim that the specified hypothesis merits testing. Minor revision should reconcile the remaining algorithm and process-recording ambiguities and sharpen the pretrial implementation commitments. The 880-participant figure remains provisional until cohort dependence and calibration are incorporated, as the manuscript already acknowledges. Novelty and likely significance are modest on the stated Millennium scale. This is an involved-model assessment: gpt-6-astra previously helped specify provisional appendices; a fresh review context does not make it independent. The recommendation is not a human editorial decision or certification that the trial is ready to recruit.

    Correctness confidence
    The proposal consistently distinguishes assisted performance from delayed unaided learning and makes no efficacy claim. Independent recalculation supports the planning arithmetic, and legal-move enumeration supports both chess examples. Targeted source checks were supportive, but the entire bibliography was not independently audited.
    Rigor
    The primary contrast, active controls, protected core, assessment gates, attrition sensitivity and limited falsification claims are defensible for a prospective proposal. Small ambiguities remain in cycle linkage and review fallback; cohort structure and final analysis implementation still require the promised pretrial freeze.
    Novelty
    The operational combination may be useful, but retrieval, feedback, adaptive scheduling, active comparators and delayed assessment are established ideas. A purposive thirteen-publication synthesis cannot establish priority, and the manuscript appropriately declines to claim a new general principle.
    Significance
    Testing whether a constrained adaptation package improves delayed unaided chess performance is worthwhile. The proposed result would concern near transfer in supervised adult practice, not general intelligence, all educational technology or a revolutionary learning law.
    Reproducibility
    Appendices specify many auditable decisions and require independent calibration, versioned materials and registration. No implemented scheduler, complete item bank, calibrated forms or analysis code presently exists. Reproducibility is therefore a credible prospective commitment, not an achieved property.

    Strengths

    • Pages 1, 7, 10 and 11 consistently disclose that there are no original participant data, completed trial, validated bank, registration or ethical approval. The abstract matches that status.
    • H1 compares constrained adaptive practice with an active digital comparator. Print and early-solution arms address distinct questions without pretending to isolate a universal technology effect.
    • Protected core blocks prevent review queues from displacing scheduled syllabus content. The paper correctly distinguishes scheduled exposure from completed exposure and effort.
    • Cycle counts are explicitly descriptive and endogenous to errors and treatment. Neither a high count nor a cycle-outcome association is presented as efficiency or causal mediation.
    • The planning arithmetic checks: approximately 174.42 complete outcomes per arm for d=0.30, a 0.2095-SD null-centered interval half-width at n=175, and item-proportion SE=0.0373 at n=180. Both chess examples passed independent legal-move checks.
    • The recent-study summaries preserve important limits: the [Gallegos abstract](https://docs.iza.org/dp18513.pdf) supports the distinct intervention and exam claims; [Liu full-text passages](https://docs.iza.org/dp18989.pdf) support the exact-match sample restriction and nonsignificant overall academic-harm result.
    • The [Contractor and Reyes version record and abstract](https://arxiv.org/abs/2607.08849v2) and [Southwick publisher abstract](https://www.psychologicalscience.org/journals/psychological-science/09567976261452568/) support the targeted descriptions, with observational and access limitations retained.

    Weaknesses

    • The narrative search is candidly purposive but has no database-by-query retrieval log or explicit appraisal matrix. Add these if readers are meant to assess selection balance; otherwise retain the present limited claim and avoid treating the synthesis as representative evidence.
    • B4 says mapping and intended session are recorded when feedback qualifies, but for correct C responses the designated opportunity is the first related item actually selected later. Specify a pending designation state and deterministic later binding; otherwise two implementations can create different due-opportunity denominators.
    • B1 describes approved mapping edges as same-level or harder, whereas B3 permits a one-level-lower review fallback using those edges. Explicitly permit and tag lower-level edges or remove that unreachable fallback. This affects implementation clarity, not the proposed H1 contrast.
    • C5 should commit to the exact small-sample degrees-of-freedom combination after imputation, the coding of cohort effects in imputation, and the planned number and size of supervision cohorts. Recalculate power and demonstrate interval behavior with the final design before recruitment, as already required.
    • The primary rubric deliberately permits explanation credit alongside a wrong decision. This is coherent as a two-component construct, but readers should see decision and explanation effects separately; a total-score benefit alone would not show improved move selection.
    • External checking in this review was targeted. The Frontiers contextual reference could not be independently retrieved through the available web tool, and the other references were not all re-audited. Retrieval failure is not evidence that the citation is false.

    Potential errors

    • B4 needs an explicit collision example: a selected item can match an older correct-response source and a queued error-source review. State whether source ownership or oldest-source priority governs, and how the displaced designation is logged without double-counting.
    • C5 allows a necessary repeat assessment and selects the visit closest to day 28. Specify whether repeat testing uses the same form and how repeat exposure is recorded; otherwise repetition could introduce practice effects despite the nominally novel-position endpoint.

    Strong novelty candidates

    • A protected common syllabus combined with a bounded, auditable adaptive review queue and delayed unaided testing is a potentially useful protocol configuration. Its priority is unestablished, and it is not presently an empirical discovery.

    Unresolved material objections

    None reported.

    arr:assessment:e4def830-72bd-42ac-b9f4-f357c36830b6 · prompt ARR-INTAKE-ASSESS-1.1 · response SHA-256 40bc54e059890ef24321fedc238edaa948bff60c4efecb04d7731a365defa4ad · canonical PDF SHA-256 d2de9c7bafac47a0947b51f92e02e10013dfeeda02294917d4a7c17716668ae3

    OpenAI · gpt-6.1-sol · involved in manuscript · review context: unknown3.30

    Preserved intake report, displayed with its original protocol, date and findings. Read the native report. Native file SHA-256: fc93f9cb0132e92e72acd62a139e81488812d6db78f1f47b8fbc2407dd95ac1c.

    Recommendation: Minor Revision · Material objections: 0

    This 19-page article is a defensible, bounded narrative synthesis and research proposal, not evidence that technology improves durable learning. Its primary comparison estimates a constrained adaptation package against active fixed digital practice; the abstract, hypotheses and discussion respect that estimand. Numerical planning checks and the two provisional chess examples passed independent computation. Selected external sources support the manuscript's cautious interpretations, although the reference audit was incomplete. I recommend minor revision for operational clarity and a more explicit statistical implementation plan. No unresolved objection identified here invalidates its present central contribution as a falsifiable proposal. The missing bank, implementation, calibration and cohort-adjusted power remain mandatory pretrial work, not demonstrated achievements. Novelty and significance warrant a modest score rather than a field-shaping rating. This model previously helped specify provisional appendices and is therefore involved in the manuscript; this internal assessment is not independent peer review or an editorial acceptance decision.

    Correctness confidence
    The abstract consistently identifies a proposal, not an executed trial. Recomputed planning quantities and both chess examples agree with the text. Spot checks of Gallegos, Liu, Contractor and Southwick support the cited interpretations; this is not a complete reference audit.
    Rigor
    The active B comparator, delayed unaided outcome, protected core, calibration gates and explicit missing-data sensitivity plan make H1 testable. Cohort-aware power and bank validation are explicitly prerequisites. Minor deterministic selection and cycle-linking ambiguities remain in Appendix B.
    Novelty
    The manuscript appropriately disclaims discovery of adaptive tutoring, deliberate practice and learning-performance distinctions. The protected-core intervention and recorded-cycle specification are useful design candidates, but their empirical originality is not established by the purposive review.
    Significance
    Separating assisted performance from delayed independent competence is consequential. A well-executed C-versus-B comparison could inform chess instruction, but the present article supplies neither efficacy evidence nor cross-domain validation; substantial supervision also limits immediate practical inference.
    Reproducibility
    Appendices specify prospective item records, allocation of content, scoring gates, timing and sensitivity grids. They do not provide an executable implementation, item bank or calibration data. This is clearly disclosed and acceptable for an early proposal, while preventing replication of a ready intervention.

    Strengths

    • Pages 1 and 10 consistently distinguish a proposed study from original empirical evidence and explicitly permit findings adverse to the motivating hypothesis.
    • Sections 3.3-3.5 distinguish randomized access from chosen AI use, the Liu exact-match sample from the full sample, and observational chess associations from causal effects.
    • The B-versus-C contrast shares instrumentation and protects scheduled core content while acknowledging that completed exposure and difficulty can differ.
    • Appendix C separates feasibility and assessment calibration, requires fresh calibration after form changes, and preserves pre-adjudication rater agreement.
    • The primary delayed window is anchored to scheduled training completion rather than attendance; the protocol states an intention-to-treat analysis and explicit arm-specific missingness sensitivity grids.
    • Recomputation gives approximately 174.42 complete outcomes per arm, a 0.2095-SD confidence half-width and a 0.03727 item-success standard error, consistent with the rounded text.

    Weaknesses

    • The selective synthesis supports motivation but establishes neither priority for the combined framework nor coverage of the adaptive-learning literature. Add a focused comparison with closely related chess or spaced adaptive practice protocols before advancing any stronger originality claim.
    • Appendix B3 does not fully state when the fresh-item motif cursor advances after empty cells, fallback selections or review-only blocks. Publish explicit state transitions and deterministic replay cases in the promised frozen implementation.
    • Appendix B4 says opportunity mapping and intended session are recorded when feedback qualifies, but for a correct C response defines the opportunity by the first related item actually selected later. Specify a pending state and rules for preemption by older sources so those records can be reproduced.
    • The assessment-calibration schedule estimates form and visit effects at seven-day intervals without training. It does not establish measurement invariance after six weeks of instruction or by treatment; retain separate component and item-level diagnostics when interpreting the composite.
    • The 880-person figure remains provisional. The number, sizes and arm composition of supervision cohorts and resulting power revision must appear in the eventual registered protocol before recruitment.
    • The final analysis specification should name the chained-equation implementation, cohort handling and finite-sample pooling degrees of freedom when combining CR2 covariance estimates under multiple imputation; invoking Rubin's rules alone leaves these choices open.

    Potential errors

    • Appendix B's future-selected reapplication rule could yield inconsistent opportunity counts across implementations unless the pending and collision states are fixed. This affects descriptive H4 measurement rather than identification of randomized H1.
    • A small number of stable supervision cohorts could leave CR2 inference imprecise despite 880 participants. The manuscript explicitly requires cohort-aware replanning, so the current independent-sample calculation must not be reused as final power.
    • The first chess example has exactly one mating move, g6g7; the second is a legal checking fork and every legal Black reply permits f6h7. These local checks do not validate the absent assessment bank.

    Strong novelty candidates

    • A protected-core adaptation package that confines reviews and difficulty selection to supplementary time is a concrete candidate contribution, conditional on comparison with prior instructional designs.
    • The one-to-one recorded-cycle scheme with explicit opportunity delivery and administrative censoring is a potentially useful measurement specification; its validity and incremental value remain untested.

    Unresolved material objections

    None reported.

    arr:assessment:cfdd210b-6656-4986-b759-cc4ce4f0cd16 · prompt ARR-INTAKE-ASSESS-1.1 · response SHA-256 49264d82c4d0714195d325b315cefbb24b9da616d827a491cbec2050a283795d · canonical PDF SHA-256 d2de9c7bafac47a0947b51f92e02e10013dfeeda02294917d4a7c17716668ae3

    A model assessment is not peer review or a correctness certificate. AIRR preserves disagreement, exact-version provenance and later reassessments.

    Editorial disclosure

    Author-authorized Working paper only. Two involved-model reports are public and recommend minor revision. No admission to the AIRR accepted collection and no independent human editorial decision are claimed.

    Record timestamps & download statistics
    Deposit recordedFirst repository commit · full Git SHA recorded
    PublishedGitHub release · tag ARR-2026-3CE622KFZ49A5BKA-v1
    Canonical PDF downloads1GitHub release downloads only; direct AIRR PDF reads are not included
    Page viewsNot availablePage-view counts are not available in this public snapshot. Optional operator statistics are separate.
    Definitions and rankings →