How can you measure the impact of problem-solving skills on student outcomes?

2 Choose appropriate assessment methods

Assessing problem-solving skills is dependent on the nature, complexity, and domain of the problem, as well as the learning goals and outcomes of the course or program. To measure these skills, performance-based tasks are a common method; they involve case studies, simulations, scenarios, projects, or portfolios that require students to apply their problem-solving skills in a specific context. Rubrics are also beneficial; they are scoring guides that describe the criteria and levels of performance for a given task or outcome. Self- and peer-assessments are also useful; they involve students in assessing their own or their peers' problem-solving skills, using rubrics, checklists, or surveys. All of these methods can help students develop metacognitive and reflective skills, as well as awareness of their problem-solving strategies and outcomes. They can also foster collaboration and communication among students, providing feedback and improvement opportunities.

3 Use valid and reliable tools

In order to accurately measure the impact of problem-solving skills on student outcomes, valid and reliable tools must be used to capture and quantify the problem-solving process and performance, as well as the learning and career outcomes. Tests are standardized or customized instruments that measure students' problem-solving skills, knowledge, or abilities in a specific domain or context. They can be administered online or offline and provide objective and comparable data on students' problem-solving skills, as well as their achievement and progress. Surveys are questionnaires that measure students' perceptions, attitudes, or behaviors related to problem-solving skills, learning outcomes, or career outcomes. They can be administered online or offline and provide subjective and qualitative data on students' problem-solving skills, as well as their satisfaction, motivation, confidence, or employability. Analytics are data-driven methods that use software or platforms to collect, analyze, and visualize data from tests, surveys, assignments, portfolios, or online activities. This provides comprehensive and actionable insights on students' problem-solving skills, as well as their performance, engagement, or outcomes.

4 Compare and contrast results

To measure the impact of problem-solving skills on student outcomes, you need to compare and contrast the results from different methods and tools, as well as from different groups, cohorts, or time periods. This can help you identify patterns, trends, gaps, or correlations between problem-solving skills and student outcomes, as well as the factors that influence them. To do this effectively, you can use descriptive statistics to summarize and present the data in a simple way with measures such as mean, median, mode, range, standard deviation, or frequency. Additionally, inferential statistics provide analytical techniques to test hypotheses or draw conclusions about the data. Lastly, visual representations illustrate the data in a more appealing and accessible way through tables, charts, graphs, or dashboards.

5 Communicate and apply findings

To measure the impact of problem-solving skills on student outcomes, it is essential to communicate and apply the findings to stakeholders such as students, faculty, administrators, or employers. This can help share and disseminate the results, as well as inform and improve teaching and learning practices, policies, or strategies. To do this, reports can be used to summarize and synthesize the results in a formal and structured way. Presentations can be used to highlight and explain the results in an informal and interactive way. Finally, actions can be taken to implement and evaluate the results in a concrete and measurable way. Ultimately, these steps will help you communicate and apply findings effectively.