Perhaps the most interesting findings of the Mapworks research are some consistent differences between students who participated in Mapworks by taking the Transition Survey (termed participation rate), and students who did not participate in Mapworks initiated by their taking the survey.
More specifically, students who took the Transition Survey had better scores that were statistically significant than those who did not take the survey for every data point calculated. Data points calculated were:
- High school (HS) GPA
- High School Rank (HSR)
- American College Testing (ACT) Composite score
- Fall and spring midterm grades (fewer midterms is better)
- Fall and spring semester GPA
- Fall cumulative GPA
- 1st Fall-to-1st spring retention percentage
- 1st Spring- to-2nd fall retention percentage
- Fall-to-fall retention (or graduation) for 2 years, 3 years, 4 years, 5 years, and 6 years.
Because students who did not participate in Mapworks had significantly lower ability measures and lower academic performance, it led us to attempt to look at characteristics of the group.
- For every year a higher proportion of on-campus students than off-campus students participated in the Transition Survey. Incentives might explain some of the difference, but how much is not known. The efforts to increase off-campus participation can be noted by the over three-fold increase in off-campus student participation (from 14.7% in 2008 to 50.4% in 2014). Comparatively on-campus participation increased approximately 11% from 2008 to 2014. In spite of the disparate increases in on- and off-campus participation, students who participated in the survey continued to do better than non-participants. Each year we looked at a number of student characteristics to determine other possible explanations.