Student Success Ratings Methodology
Using the most recent institutional data reported in IPEDS, we examined four-year public and not-for-profit institutions with complete data for 2006 to 2016. The data available for first-year retention and six-year graduation always refers to the first-time, full-time, degree-seeking freshmen cohort.
Eduventures’ Student Success Ratings address one publicly measurable aspect of student success: persistence to graduation. Eduventures student success Framework defines four interrelated aspects of Student Success: persistence to graduation, student academic achievement, holistic student success, and career readiness. Persistence to graduation is the important external marker of student success, though we must be careful to consider how the other three aspects of student success that are less accessible in public data also play a role.
We developed a linear regression model using the most recent year of data (2016). In this model, the dependent variable was a Student Success Score. As the sum of first-year retention and six-year graduation rates, this combined index could range between 0 and 200.
The linear regression was developed by examining the influence of demographic, academic, social, and financial variables available in IPEDS on the overall Student Success Score.
From the model we developed two metrics. The first is the absolute difference between the predicted and actual Student Success Scores. This metric penalizes institutions that do not have much room for improvement and gives a scoring advantage to those that have more room for improvement. To adjust for this, we developed the second metric, the percentage of an institution’s over- or under-performance given the potential for improvement.
We also looked at two very straightforward metrics to measure institutional trends:
- Absolute change in first-year retention rate between 2006 and 2016
- Absolute change in six-year graduation rate between 2006 and 2016
To ensure that our analysis compared similar institutions, the normalized all metrics solely within the context of common institutional categories. These categories are based on institutional control and Carnegie Basic Classifications:
- Public Research/Doctoral
- Public Master’s
- Public Baccalaureate
- Private Research/Doctoral
- Private Master’s
- Private Baccalaureate
Within each of the six institutional categories, each of the four scores (predicted vs. actual, performance vs. room for improvement, retention trend, and graduation trend) were converted to normalized scales (0 to 100). The final score weighted each of the four metrics equally to also produce a normalized score that ranges between 0 and 100.
Because Eduventures’ Student Success Score only compares reasonably alike institutions, a private master’s-level institution’s score is not comparable to a public master’s-level institution’s score.
Don’t See Your Institution?
If you do not see your institution in the rankings, it may be for one of two reasons:
- It had incomplete information throughout the time frame
- It is identified in a specialist Carnegie Basic Classification (e.g., health professions, special focus, tribal college)
If you are an Eduventures member, we can run the analysis for you if you provide the complete information. Contact us to get started!
Smart higher education institutions are constantly retooling their academic portfolios to capture evolving student interests, meet future workforce needs, and get a jump on the next big degree program. As a research partner to many of them, new and unique programs that pop up close to home are bound to catch our attention.read more
The annual migration of ed-tech venture capitalists, start-up executives, innovators, and educators descended on San Diego last week for the ASU-GSV conference–now in its 10th year addressing the most pressing challenges facing education. As the Varsity Blues admissions scandal and NCAA basketball tournament scrolled by on every TV, there was a particularly palpable sense that the pace of change in higher education needs to accelerate.read more
©2019 ACT® | NRCCUA®