Automated Scoring System for the AAPPL Spanish Presentational Writing Component

On September 15, 2023, ACTFL and LTI implemented a machine scoring system for AAPPL Spanish Presentational Writing (PW) tests, which is used in conjunction with ACTFL-certified human raters to score all Spanish PW submissions. This integration of machine scoring alongside human raters means that every Spanish PW test now receives a machine score combined with a score provided by at least one certified human rater to provide a final score.

The machine scoring system, similarly to the human raters, assesses the AAPPL PW responses based on several parameters, as described in the ACTFL Performance Descriptors, including functions (global tasks the learner can perform in the language), context/content (situations and topics the learner can comprehend and discuss), text type (comprehension and production capabilities for performing functions), and comprehensibility (accuracy and vocabulary use).

LTI's machine scoring system is a culmination of nearly ten years of dedicated research and development and has undergone rigorous training using rating data from ACTFL-certified AAPPL raters. Extensive research, conducted by Dr. Erik Voss of Teachers College Columbia University, has validated the accuracy of machine scoring compared to human raters over multiple years of administration.

For more information, please contact aapplhelp@languagetesting.com.