Educational Value of Multiple Representations

Ainsworth (2008) for STEM & Computational Thinking

  • Core Theoretical Anchor: Functional Taxonomy of Multiple Representations (DeFT)
  • Instructional Focus: Cognitive architectures, computational affordances, and pedagogical sequencing

Epistemic Foundation: The Double-Edged Sword

  • Ainsworth's Thesis: Interacting with multiple representations (diagrams, dynamic graphs, equations, simulations) brings unique cognitive benefits when learning complex scientific concepts.
  • The Cognitive Paradox: Learners frequently fail to exploit these advantages; inappropriate combinations can completely inhibit learning.
  • Expertise Gap: Novices lack the integrated schemas that allow domain experts to translate effortlessly across representational boundaries.

Multiple representations are powerful tools but like all powerful tools they need careful handling if learners are to use them successfully. (Ainsworth, 2008)

Updating the Technological Substrate

  • Early-2000s Case Studies in the Text:
    • SMV-Chem (2000): Synchronized macro-video, particulate models, and rate equations.
    • Connected Chemistry & DEMIST (2001-2005): Multi-window simulation tools.
    • SimQuest & PAKMA (2002-2003): Kinematic authoring packages and vector overlays.
  • Modern Computational Equivalents:
    • PhET Interactive Simulations: HTML5 environments dynamically coupling macro-states and micro-interactions.
    • NetLogo / Agent-Based Modeling: Visualizing decentralized agent behaviors alongside aggregate phase plots and time series.
    • Jupyter Notebooks / Python Scripts: Integrating executable code, symbolic math (SymPy), and dynamic data visualizations (Matplotlib).

The Functional Taxonomy: Three Core Roles

  1. Complementary Roles
  • Complementary Information
  • Complementary Computational Processes
  1. Constraining Interpretation
  • Constraining by Familiarity
  • Constraining by Inherent Properties (Depiction vs. Description)
  1. Constructing Deeper Understanding
  • Abstraction
  • Extension
  • Relational Understanding

1. Complementary Roles: Information & Processing

  • Complementary Information:
    • Different representations convey different aspects of a system.
    • Kinematics Example: Mass remains static (scalar readout), while velocity and position evolve over time (persistent Cartesian graphs).
  • Complementary Processes (Larkin & Simon, 1987):
    • Informational equivalence does not mean computational equivalence.
    • Tables optimize single-value read-offs and discrete pattern lookups.
    • Line graphs optimize perceptual detection of rates of change via slope.
    • Equations compactly define quantitative relationships but require step-by-step symbolic manipulation.

Computational Thinking: Data Structure Efficiency

  • Representational Choice as Algorithmic Optimization:
    • In computer science, selecting an array, hash table, or graph structure dictates execution efficiency.
    • In pedagogy, selecting an equation, visual table, or line plot dictates cognitive processing efficiency.
    • A continuous line graph yields an instantaneous visual slope check.
    • An algebraic equation requires systematic symbol resolution.

Task 1: Computational Audit

  • Open a PhET simulation (e.g., Gas Properties or Energy Skate Park).
  • Catalog every distinct representation present.
  • Determine whether each representation supports perceptual read-off, pattern matching, or formal algebraic derivation.

2. Constraining Interpretation

  • Guiding Interpretation with a Supporting Representation:
    • Unfamiliar or abstract representations risk misinterpretation; a familiar format constrains possible inferences.
  • Constraining by Familiarity:
    • Kinematics Misconception: Students frequently read a flat, horizontal line on a velocity-time graph as "the vehicle is at rest."
    • Juxtaposing an animation of a vehicle moving at steady speed alongside the graph immediately constrains the interpretation: horizontal line means constant velocity.
  • Constraining by Inherent Properties:
    • Descriptions (Text/Equations): Symbolic and under-specified regarding physical details.
    • Depictions (Animations/Graphics): Iconic and physically specific; they must commit to spatial orientation, color, and velocity.

The Risk of Depictive Representations

  • The Seductive Detail Trap:
    • Iconic depictions force the inclusion of incidental properties (e.g., color of a motorcycle, road surface, background trees).
    • Learners may infer spurious rules (e.g., assuming Newton's laws apply only to vehicles on paved surfaces).
  • Activating Faulty Intuitions:
    • Visualizing a road and roadside objects may cue naive everyday physics (such as inherent friction), confusing learners when ideal kinematic models neglect drag.

Discussion Question 1: Scaffolding and Fading

  • Once a learner grasps how to read a velocity-time graph using an animation as a constraint, should the animation be removed?
  • Why might keeping a constraining depiction visible become cognitively disadvantageous for advancing students?

3. Constructing Deeper Understanding

  • Abstraction:
    • Synthesizing domain invariants across varying contexts (e.g., modeling Newton's laws across carts, gliders, and celestial bodies demonstrates that fundamental principles are not context-bound).
  • Extension:
    • Transferring existing representational literacy to an unfamiliar representation (e.g., applying familiar slope reasoning from velocity-time graphs to thermodynamic pressure-volume diagrams).
  • Relational Understanding:
    • Building explicit mappings between representations without fundamentally changing internal schemas (e.g., connecting the derivative of a position-time graph directly to the height of a velocity-time graph).

Core Cognitive Obstacles Identified by Ainsworth

  • Representational Syntax:
    • Learners struggle with coordinate planes, labels, units, and axes conventions.
  • Graph-as-Picture Misconception:
    • Interpreting Cartesian curves as spatial trajectories (e.g., choosing a hill-shaped velocity graph to describe a bicycle traveling over an actual hill).
  • Over-Generalized and Over-Selective Operators:
    • Assuming that calculating "area under the line" yields velocity across any graph type.
    • Believing formulas apply only when a plotted line passes directly through the coordinate origin.
  • Context Over-Reliance:
    • Inability to detach the mathematical relationship from the simulation surface interface.

The Empirical Reality of Cross-Representational Translation

  • Tabachneck et al. (1994): Students studying economics failed to integrate information between coordinate line graphs and explanatory text.
  • Yerushalmy (1991): Following three months of intensive software instruction, only 12% of students gave answers integrating both visual and algebraic models.
  • Ainsworth, Bibby, & Wood (2002): Pairing mathematical formulas with pictorial diagrams led to poorer outcomes than using either system independently.
  • Seufert (2003): Translation scaffolds help only intermediate learners; low-knowledge students face cognitive overload, while high-knowledge students bypass them.

Dynamic Linking: Computational Promise vs. Empirical Reality

  • The Theoretical Assumption of Dyna-linking:
    • Automatically updating coupled windows when a learner interacts with one representation should reduce working memory load by offloading translation tasks to the computer.
  • Ainsworth's Counter-Finding:
    • Empirical support is surprisingly thin (e.g., van der Meij & de Jong, 2006, found no measurable benefit in physics simulations).
    • Automated linking can make students passive observers: when the machine handles every translation step, students do not form internal cognitive bridges.

Discussion Question 2: Algorithmic Automation

  • In real-time data collection labs (such as ultrasonic motion sensors plotting velocity curves live), does automated plotting build conceptual understanding, or does it bypass the cognitive translation students need to master?

Five Design Heuristics

  1. Minimize Total Representations: Employ the absolute minimum number required. Reject extraneous visual elements.
  2. Assess Learner Prior Knowledge: Intermediate learners need translation scaffolds; novices are overwhelmed by them; experts find them redundant.
  3. Sequence Incrementally: Never introduce several unfamiliar representational formats simultaneously. Anchor qualitative reasoning before introducing formal quantitative structures.
  4. Enforce Coherence and Common Syntax: Use matching coordinate scales, consistent color keys (e.g., green always indicates velocity), and uniform labels.
  5. Target Specific Pedagogical Roles: Decide whether the combination is intended to complement, constrain, or construct understanding, and design scaffolding accordingly.

Pedagogical Synthesis

  • Multiple representations are cognitive engines, not multimedia window dressing.
  • Adding more diagrams or charts without explicit instructional bridges increases cognitive load and causes fragmentation.
  • Computational thinking in science education relies on representational fluency: breaking a phenomenon down into variables, selecting optimal data views, and translating across symbolic and computational models.

Beginners using powerful tools do not achieve the same results as experts... We must consider how the learning environment is embedded within deliberate social and instructional contexts. (Ainsworth, 2008)