Back to Educatian

Education Data x Analysis Guide Matrix

A practical onboarding guide for mapping educational technology and learning-sciences data to defensible analyses, claim verbs, research genres, and reviewer checks before the first model is run.

Data first Method families Claim boundaries Reviewer-ready

Evidence-to-claim map

Data type
Analysis family
Claim boundary
Trace logs
LMS events, attempts, dwell time
Dashboards
prediction
process mining
Behavior patterns, not direct cognition
Discourse
chat, posts, talk turns
Coding
NLP
network models
Interaction quality requires theory
Sensors
gaze, posture, physiology
Fusion
time series
classification
Proxy signals need validation
Intervention
condition, fidelity, outcomes
RCT/QED
ITS
SCED
Effect claims depend on design
01 - Topic identity

This is a data-to-claim guide, not a statistics menu

Educational data are produced by platforms, tasks, learners, teachers, sensors, institutions, and researchers. The same dataset can support a descriptive claim, a process claim, a measurement claim, or a prediction claim, but not all at once and not without different evidence burdens.

Core rule: choose the analysis after identifying the data type, unit of analysis, construct target, claim verb, and validity burden.
Reader job

Name the data type and decide what kind of claim it can support.

Guide job

Map data sources to method families and reviewer-safe claim language.

Output

A defensible analysis plan, not just a list of popular techniques.

Boundary: the page does not teach every method. It helps a new researcher avoid pairing the wrong method, data source, and claim.
02 - Video primers

Watch the field before choosing a method

These videos fit the guide's central topic: how educational data become learning analytics, educational data mining, and learning-sciences evidence. Use them as conceptual anchors before moving into the matrix.

Learning analytics in a nutshell

A SoLAR primer that frames learning analytics as data about learners and learning, interpreted for teaching and learning action. Best before using the matrix because it clarifies the field-level purpose.

Open on YouTube
Educational data mining

A practical EDM overview focused on how logs and platform data can be analyzed to understand learning behavior, prediction, and improvement. Pair it with the trace, sequence, and prediction rows.

Open on YouTube
Learning analytics and learning science

A SoLAR LASI panel connecting analytics with learning-sciences questions. This is the best fit for remembering that data analysis must preserve theory, context, and learning mechanisms.

Open on YouTube
How to use these: watch for the difference between data availability, analytic technique, and defensible learning claim. The matrix below turns that distinction into a planning tool.
03 - Interactive matrix

Choose a data type, claim verb, and analysis family

The selector gives a first-pass diagnosis. It does not approve a study; it tells you what to inspect before writing the method section.

Survey and self-report data

Bounded
Raw forms
Unit of analysis
Good for showing
Fit check
Common overclaim
Research genre
04 - Data type atlas

Twelve data families cover most education and learning-sciences projects

05 - Analysis families

Methods preserve different parts of the phenomenon

Descriptive

Summaries, dashboards, distributions, heatmaps, and temporal plots. Best for pattern visibility.

Predictive

Supervised models with leakage-free validation, calibration, and subgroup checks.

Measurement

Reliability, IRT/Rasch, cognitive diagnosis, validity arguments, and evidence-centered design.

Temporal

Sequence mining, TNA, ONA, process mining, Markov models, and HMMs.

Text and discourse

Qualitative coding, NLP, embeddings, discourse moves, argumentation, and LLM-assisted coding with validation.

Network

Social networks, two-mode networks, epistemic networks, centrality, community detection, and group structure.

Multimodal

Synchronization, feature extraction, early/late fusion, alignment, and triangulation across streams.

Causal/evaluative

RCT, QED, RD, ITS, SCED, DiD, and causal models only when the design carries the claim.

Mixed methods

Joint displays, explanatory sequential, convergent integration, and meta-inferences.

06 - Research genres

Data type often points to the paper genre

Dashboard paperTrace logs plus design/actionability. Strong when the contribution is feedback, sensemaking, or decision support.
Prediction paperEarly signals, later outcomes, validation, leakage checks, calibration, and fairness.
Process paperOrdered actions, phases, transitions, trajectories, or state changes over time.
Measurement paperConstruct definition, indicator logic, reliability, validity, and population fit.
Discourse paperTurns, talk, writing, uptake, argumentation, knowledge building, and coding transparency.
Multimodal paperSensor, video, audio, screen, and log streams aligned to learning processes.
Intervention paperDesign, comparison, fidelity, outcomes, and causal assumptions.
Mixed-methods paperMultiple data sources that actually inform one another through an integration design.
07 - Visualization studio

Make the matrix explorable, not just readable

These are lightweight visualization patterns that can turn a methods guide into a more playful research-planning tool. Each pattern keeps the same discipline: the visual must reveal a data-to-method-to-claim relationship, not decorate it.

Evidence river

Best for
Interaction
Reviewer value
Watch out

Design rule: readers should be able to click a data source and immediately see which methods and claims become safer or riskier.

08 - Reviewer risk clinic

Common objections by claim type

If your claim is about engagement

Do not treat clicks, dwell time, facial expression, or log volume as direct engagement without a construct argument and triangulation or validation evidence.

If your claim is predictive

Show held-out validation or honest cross-validation, outcome timing, leakage checks, calibration, and subgroup performance.

If your claim is causal

Name the design feature that supports causal interpretation: randomization, quasi-experimental equivalence, regression discontinuity, interrupted time series, single-case design, or another credible strategy.

If your claim is about collaboration

Counts of posts, replies, or centrality do not automatically indicate collaboration quality. Tie definitions and discourse meaning must be visible.

If your claim integrates multiple sources

Multiple data streams do not automatically triangulate. State exactly where logs, text, video, sensors, surveys, or outcomes inform one another.

09 - Worked examples

Five quick mappings

LMS logsUse descriptive dashboards or prediction only after event definitions, missing actions, and outcome timing are clear.
Chat discourseUse discourse coding, NLP, or network models, but keep turn meaning and group context in the interpretation.
Game telemetryUse process mining, stealth assessment, or sequence models when event design links actions to evidence claims.
Video-coded teamsUse interaction analysis, multimodal coding, or TNA when episodes, boundaries, and coder agreement are documented.
Survey plus outcomeUse association or measurement models, not causal language, unless the design supports intervention effects.
10 - Claude Code / Codex tutorial

Build this guide through a research conversation with an AI coding agent

The fastest workflow is not to ask for a finished webpage in one sentence. Treat Claude Code or Codex as a research assistant, editor, designer, and publisher, but keep the evidence rules explicit at every step.

01 Scope

Ask the agent to define the audience, data families, claim verbs, and reviewer risks before writing UI code.

02 Research

Have it collect primary references and remove any citation it cannot verify.

03 Build

Request an English GitHub Pages page with interactive selectors, visual ideas, downloads, and thumbnail metadata.

04 Verify

Make the agent test JavaScript, inspect the rendered DOM, commit, push, and report the public URL.

Start with the research brief

You
Claude Code / Codex
Output Check Next prompt
Working rule: keep asking the agent to separate observed data, inferred constructs, analysis families, and claim language. That one constraint prevents most weak methods sections.
11 - Agent-ready

Prompt an AI assistant to build the matrix before analysis

You are helping me map an educational dataset to defensible analysis options. Available data: <files, variables, row units, IDs, timestamps, text/video/sensor sources, conditions, outcomes, context> Candidate goal: <what I hope to learn or publish> Create a matrix with: data type, raw forms, unit of analysis, what the data can show, fitting analysis families, supported claim verbs, common overclaim, minimum validity checks, example research genre, and extra evidence needed for stronger claims. Do not invent missing data. Separate observed behavior from inferred constructs. If a claim is not supported, say so directly and suggest safer wording.
12 - Downloads

Starter files for teams and agents

13 - References

Foundational and checked sources

Show references