{"id":1606,"date":"2022-06-09T16:18:45","date_gmt":"2022-06-09T16:18:45","guid":{"rendered":"https:\/\/www.languagetesting.com\/blog\/?p=1606"},"modified":"2023-10-30T12:38:06","modified_gmt":"2023-10-30T12:38:06","slug":"we-did-the-test-now-what-part-1-looking-at-yearly-performance-over-time","status":"publish","type":"post","link":"https:\/\/www.languagetesting.com\/blog\/we-did-the-test-now-what-part-1-looking-at-yearly-performance-over-time\/","title":{"rendered":"We did the test. Now what?  Part 1: Looking at yearly performance over time"},"content":{"rendered":"<p><img fetchpriority=\"high\" decoding=\"async\" class=\"wp-image-1607 alignleft\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/shutterstock_735904294-300x200.jpg\" alt=\"two teenage girls doing school work\" width=\"363\" height=\"242\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/shutterstock_735904294-300x200.jpg 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/shutterstock_735904294-768x512.jpg 768w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/shutterstock_735904294-1024x683.jpg 1024w\" sizes=\"(max-width: 363px) 100vw, 363px\" \/><\/p>\n<p>We love to use the <a href=\"https:\/\/www.languagetesting.com\/aappl-central\" target=\"_blank\" rel=\"noopener\">AAPPL<\/a> test for our students to earn the <a href=\"https:\/\/sealofbiliteracy.org\/\" target=\"_blank\" rel=\"noopener\">Seal of Biliteracy<\/a>, but to refine our program and to recognize growth as well as achievement, we have explored the data reporting tools that the LTI Client Site has to offer. In this article, I will discuss a few of the ways that you can use this data as evidence to differentiate instruction, change curricular focus, and even to supplement your teacher evaluation rating. While some of the data analysis can be done directly within the LTI Client Site, you can also export student data to do a deeper dive using a spreadsheet.<\/p>\n<p>One of the key ways that you can use the data is for longitudinal comparison of your students\u2019 performance versus their own prior performance; you can also look at performance in your current year and previous years. Below I will demonstrate a few examples of how you can do this, as well as a breakdown of what our thought process around this information has looked like for our district specifically.<\/p>\n<p><strong>Refine Your Year Over Year Performance<\/strong><\/p>\n<p>For this example, I will produce tables for each of the four years that we have given the Spanish-language AAPPL, with a comparison of juniors and seniors. (We test during Seal of Biliteracy eligibility, which in Ohio is within 15 months of graduation.) Then I will repeat this for myself as a teacher and compare my students\u2019 results to our school\u2019s overall results.<\/p>\n<ol>\n<li>From the Main Menu, click<strong> AAPPL School Report<\/strong>.<\/li>\n<li>Select your date range,<strong> Language<\/strong>,<strong> Teacher<\/strong>, and<\/li>\n<li>\u00a0the value that you wish to <strong>Compare By <\/strong>followed by your selected parameters<strong>.<\/strong><\/li>\n<li>Click <strong>Apply Filters <\/strong>to see your data.<\/li>\n<\/ol>\n<p><img decoding=\"async\" class=\"wp-image-1608 aligncenter\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-1-300x206.png\" alt=\"using the Client Site\" width=\"403\" height=\"277\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-1-300x206.png 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-1.png 718w\" sizes=\"(max-width: 403px) 100vw, 403px\" \/><\/p>\n<p><strong>Digging in: Performance by Grade Over Years <\/strong><\/p>\n<p>Taking the filters I just set, I\u2019ll first look at performance by grade, starting in 2019. The following images show AAPPL Data for Spanish students in grades 11 and 12 by year, starting in 2019.<\/p>\n<figure id=\"attachment_1609\" aria-describedby=\"caption-attachment-1609\" style=\"width: 395px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\" wp-image-1609\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-2-300x231.png\" alt=\"Spanish Students: Performance by Grade 2019\" width=\"395\" height=\"304\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-2-300x231.png 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-2.png 519w\" sizes=\"(max-width: 395px) 100vw, 395px\" \/><figcaption id=\"caption-attachment-1609\" class=\"wp-caption-text\">Figure 1. Spanish Students: Performance by Grade 2019<\/figcaption><\/figure>\n<p>In Figure 1, you can see that the 11<sup>th<\/sup> and 12<sup>th<\/sup> graders are hovering in the intermediate range, with the exception of the ILS where the 11<sup>th<\/sup> graders had a notably lower average rating.<\/p>\n<figure id=\"attachment_1610\" aria-describedby=\"caption-attachment-1610\" style=\"width: 395px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-1610\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-3-300x262.png\" alt=\"Spanish Students: Performance by Grade 2020\" width=\"395\" height=\"345\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-3-300x262.png 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-3.png 514w\" sizes=\"(max-width: 395px) 100vw, 395px\" \/><figcaption id=\"caption-attachment-1610\" class=\"wp-caption-text\">Figure 2. Spanish Students: Performance by Grade 2020<\/figcaption><\/figure>\n<p>A year later, in 2020 (Figure 2), I see that the grade 11 students are achieving a higher average rating on the ILS than the previous year, now nearing I3 instead of N3. I also see that, overall, both 11<sup>th<\/sup> and 12<sup>th<\/sup> graders are achieving higher ratings than the previous year.<\/p>\n<figure id=\"attachment_1611\" aria-describedby=\"caption-attachment-1611\" style=\"width: 393px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-1611\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-4-300x241.png\" alt=\"Spanish Students: Performance by Grade 2021\" width=\"393\" height=\"316\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-4-300x241.png 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-4.png 517w\" sizes=\"(max-width: 393px) 100vw, 393px\" \/><figcaption id=\"caption-attachment-1611\" class=\"wp-caption-text\">Figure 3. Spanish Students: Performance by Grade 2021<\/figcaption><\/figure>\n<p>In 2021 (Figure 3), I can see lower average scores across the board and can consider what was different in this academic year from previous years.<\/p>\n<figure id=\"attachment_1612\" aria-describedby=\"caption-attachment-1612\" style=\"width: 383px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-1612\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-5-300x229.png\" alt=\"\" width=\"383\" height=\"292\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-5-300x229.png 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-5.png 538w\" sizes=\"(max-width: 383px) 100vw, 383px\" \/><figcaption id=\"caption-attachment-1612\" class=\"wp-caption-text\">Figure 4. Spanish Students: Performance by Grade 2022 (to date; some tests are still in progress)<\/figcaption><\/figure>\n<p>I again see evidence of lower average scores across the board in 2022 (Figure 4).<\/p>\n<figure id=\"attachment_1613\" aria-describedby=\"caption-attachment-1613\" style=\"width: 380px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-1613\" src=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-6-300x255.png\" alt=\"Spanish Students: Performance by Grade (Combined 2019-2022)\" width=\"380\" height=\"323\" srcset=\"https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-6-300x255.png 300w, https:\/\/www.languagetesting.com\/blog\/wp-content\/uploads\/2022\/06\/reporting-blog1-6.png 546w\" sizes=\"(max-width: 380px) 100vw, 380px\" \/><figcaption id=\"caption-attachment-1613\" class=\"wp-caption-text\">Figure 5. Spanish Students: Performance by Grade (Combined 2019-2022)<\/figcaption><\/figure>\n<p>Figure 5 shows combined scores for all three years and allows me to get an overall snapshot of my 11<sup>th<\/sup> and 12 grade students over a period of time. I can compare this combined score over 3 years to any individual year, and I\u2019ve now created my own norm-referenced internal benchmark.<\/p>\n<p>This simple example of looking at students by grade over a series of years gives a glimpse into how useful longitudinal reporting can be. In my next post, I\u2019ll dig into some analysis as I do a year over year comparison using the longitudinal data.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We love to use the AAPPL test for our students to earn the Seal of Biliteracy, but to refine our program and to recognize growth as well as achievement, we have explored the data reporting tools that the LTI Client Site has to offer. In this article, I will discuss a few of the ways [&hellip;]<\/p>\n","protected":false},"author":22,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[183],"tags":[80,273,241,274,230],"class_list":["post-1606","post","type-post","status-publish","format-standard","hentry","category-academic","tag-aappl","tag-aappl-reports","tag-aappl-results","tag-longitudinal-reports","tag-seal-of-biliteracy"],"acf":[],"aioseo_notices":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/1606","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/comments?post=1606"}],"version-history":[{"count":2,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/1606\/revisions"}],"predecessor-version":[{"id":2812,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/1606\/revisions\/2812"}],"wp:attachment":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/media?parent=1606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/categories?post=1606"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/tags?post=1606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}