Interested in the Top 5 Testing Industry Trends for 2025? See the post by Leslie Thomas, Ph.D. on Trend #2: Using Generative AI to Expedite Test Development
Chief Psychometric Officer | Passionate about improving lives through credentialing
2025 Trends in Assessment: Trend #2 – Using Generative AI to Expedite Test Development (and not just item generation…) In 2024, much of the emphasis was on using Generative AI to create exam items (i.e., test questions). In fact, a number of Test Sponsors have reported increases in efficiency (i.e., the amount of time required to create an acceptable item) of 50-60%, which is impressive. But in 2025, the role of Generative AI in assessment is set to expand far beyond that. Here’s how: 🔍 Job Task Analysis (JTA) Generative AI can analyze publicly available job data to generate an initial list of tasks, knowledge, and skills for most job roles. It can also help Test Sponsors update existing JTAs, by suggesting missing tasks, knowledge, and skills. 📊 Test Blueprint Creation By analyzing training materials and other resources, Generative AI can identify potential topics. 🧩 Item Coding and Classification Generative AI can classify test items by cognitive complexity, reading level, and alignment with specific test objectives or topics. ✏️ Item Review Beyond grammar and spelling checks, Generative AI can help enforce style guidelines, ensure consistency in voice and tone, help detect bias (race, gender), and identify redundant or enemy items; thereby streamlining very time-consuming processes. Moreover, Generative AI isn’t limited to just new test development. Some of the applications above can be used on existing item banks. For instance, Generative AI can be used to recategorize (i.e., map) your existing items to an updated test blueprint to identify gaps in content coverage. ⚠️ Important Reminder Generative AI outputs should always be reviewed by subject matter experts to catch inaccuracies and mitigate potential biases. While AI can accelerate processes, human oversight ensures quality and fairness. Generative AI is reshaping exam development—are you ready to embrace the change? #AssessmentTrends2025 #GenerativeAI #TestDevelopment #Innovation