{"id":1515,"date":"2022-04-18T19:00:17","date_gmt":"2022-04-18T19:00:17","guid":{"rendered":"https:\/\/www.languagetesting.com\/blog\/?p=1515"},"modified":"2024-03-18T16:57:38","modified_gmt":"2024-03-18T16:57:38","slug":"what-should-the-standard-be-for-language-assessments","status":"publish","type":"post","link":"https:\/\/www.languagetesting.com\/blog\/what-should-the-standard-be-for-language-assessments\/","title":{"rendered":"What should the standard be for language assessments?<\/small>"},"content":{"rendered":"

\"a<\/p>\n

Do companies need a language testing assessment partner, or can they develop and administer their own assessments in-house? What are the repercussions to attempting a homegrown assessment? If a company does choose to hire a language assessment partner, how would that company know they are choosing the right vendor? At Language Testing International (LTI), these are common questions we address with our clients. However, instead of taking our word for it, let\u2019s hear from someone who actually has to make these decisions and who has chosen to work with LTI.<\/p>\n

On a recent episode of LTIs \u201cLanguage Is Your Superpower<\/a>\u201d podcast, special guest, Vinay Patel, PhD, discussed what he and his team at AT&T look for when choosing a language testing partner, and offered advice from his experience as to what companies may want to avoid.<\/p>\n

To start, Vinay mentioned a common pitfall that many companies run into, which is to try to develop and administer language assessments in-house. \u201cFor somebody that doesn\u2019t have the background,\u201d Vinay explained, to determine \u201cin what actually is proficient and what\u2019s not proficient, if they\u2019re not using standardized criteria, you could really be getting yourself into quite a bit of trouble. You could be assessing things that seem like they\u2019re assessing language, but it could be full of bias. So really, the advice that I would give is to be careful with homegrown assessments. Really, if you\u2019re trying to measure language proficiency, do your research. So, go online, see what language proficiency is, how it\u2019s defined, what\u2019s required within your company, all that kind of stuff. There\u2019s a lot of things to look at here before you just dive in and make homegrown assessments.\u201d<\/p>\n

Vinay continues to say that \u201cthe good thing about some vendors is that they\u2019ve done that work. It\u2019s their bread and butter. They use standard measures of what proficiency is. They\u2019ve done a lot of the research on the back end with different languages. So, it [working with a language testing provider] might be a lot easier than trying to develop something in-house.\u201d<\/p>\n

At AT&T, Vinay outsources their language assessments, but explains that not all vendors are operating at the same level of experience. He goes on to detail what he looks for when helping to choose AT&T\u2019s language assessment partners. \u201cFirst and foremost, I want to make sure that the tests they are using or have developed are reliable and valid. I want to make sure that data has been collected on how good they are at doing what they are supposed to be doing. So, really, they have to be demonstrated. The second step would be that there needs to be room for validating these assessments locally. So, I\u2019d want data from the people that are applying at this company and see how the test functions, and monitor that as we move along.\u201d<\/p>\n

Another factor in selecting a language proficiency testing provider is the cost. \u201cThe other thing that is something to consider is cost,\u201d Vinay says. \u201cYou want to make sure that the test ultimately is providing utility. So, if the costs are right where they are supposed to be and you are getting enough juice for the squeeze, that\u2019s something that I would consider when choosing an assessment partner.\u201d<\/p>\n

Vinay concluded with the third criteria he looks for: \u201cTime-to-hired is a very important metric. We want to make sure that our candidate experience is as positive as possible. I want to make sure that the scores are turned around quickly, so the amount of time it takes for us to know if a candidate is qualified or not qualified in a particular language has to be fairly quick.\u201d<\/p>\n

Additionally, Vinay mentions the employee benefit and experience, which is detailed in \u201cthe way that the candidate interacts with it and walks away from the assessment. I would want data around that; if they viewed it as a positive experience or if they viewed it as something that was unfair and not job-related.\u201d<\/p>\n

As the exclusive licensee of ACTFL, Language Testing International<\/a> (LTI) works very closely with and administers ACTFL assessments. We know first-hand that it requires years and years of research, subject matter expertise, norming tests, and confirming they are valid and reliable. Having served over 5 million test-takers over the last 30 years, we know it\u2019s not an easy process, but ultimately is an extremely important process to continue to try and get right. It is important not just for the companies who hire us as their language assessment partner, like AT&T, but also for the experience of the job candidates and employees who are taking those assessments.<\/p>\n","protected":false},"excerpt":{"rendered":"

Do companies need a language testing assessment partner, or can they develop and administer their own assessments in-house? What are the repercussions to attempting a homegrown assessment? If a company does choose to hire a language assessment partner, how would that company know they are choosing the right vendor? At Language Testing International (LTI), these […]<\/p>\n","protected":false},"author":27,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2,195],"tags":[269,158,268,31],"class_list":["post-1515","post","type-post","status-publish","format-standard","hentry","category-commercial","category-language-proficient","tag-i-o-psychology","tag-language-certification","tag-language-proficiency-assessments","tag-multilingual-employees"],"acf":[],"aioseo_notices":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/1515","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/users\/27"}],"replies":[{"embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/comments?post=1515"}],"version-history":[{"count":5,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/1515\/revisions"}],"predecessor-version":[{"id":3353,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/posts\/1515\/revisions\/3353"}],"wp:attachment":[{"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/media?parent=1515"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/categories?post=1515"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.languagetesting.com\/blog\/wp-json\/wp\/v2\/tags?post=1515"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}