Skip to content
  • Research

    Focus Areas

    • Dual Enrollment
    • Developmental Education
    • Guided Pathways
    • Advising & Student Supports
    • Teaching & Learning
    • Transfer
    • College to Career
    • Dual Enrollment
    • Developmental Education
    • Guided Pathways
    • Advising & Student Supports
    • Teaching & Learning
    • Transfer
    • College to Career

    Publications Library

    CCRC’s complete collection of publications

    Presentations

    Webinars and conference presentations with CCRC researchers

    Guided Pathways Workshops

    Materials from our do-it-yourself workshop series

    Policy Resources

    Our collection of federal policy briefs and fact sheets

  • About Us
    • About CCRC
    • CCRC Staff
    • Research Affiliates
    • Advisory Board
    • Biennial Report
    • Employment
    • Contact
    • About CCRC
    • CCRC Staff
    • Research Affiliates
    • Advisory Board
    • Biennial Report
    • Employment
    • Contact
  • News
    • CCRC in the News
    • Opinion
    • Press Releases
    • CCRC in the News
    • Opinion
    • Press Releases
  • Community College FAQs
  • Blog
  • Pandemic Recovery
  • Overview
  • Important Dates
  • FAQs
  • Overview
  • Important Dates
  • FAQs
  • Overview
  • Important Dates
  • FAQs

Should Colleges Invest in Machine Learning? Comparing the Predictive Powers of Early Momentum Metrics and Machine Learning for Community College Credential Completion

By Takeshi Yanagiura

Among community college leaders and others interested in reforms to improve student success, there is growing interest in adopting machine learning techniques to predict credential completion. However, machine learning algorithms are often complex and are not readily accessible to practitioners, for whom a simpler set of near-term measures may serve as sufficient predictors.

This study compares the out-of-sample predictive power of early momentum metrics—13 near-term success measures suggested by the literature—with that of metrics from machine-learning-based models that employ approximately 500 predictors for community college credential completion. Using transcript data from approximately 50,000 students at more than 30 community colleges in two states, the author finds that the early momentum metrics that were modeled by logistic regression accurately predict completion for approximately 80% of students. This classification performance is comparable to that of the machine-learning-based models. The early momentum metrics even outperform the machine-learning-based models in probability estimation. These findings suggest that early momentum metrics are useful predictors for credential completion and that the marginal gain from using a machine-learning-based model over early momentum metrics is typically small.

Download Links

Download CCRC Working Paper No. 118
April 2020

Related Publications

July 2019

Early Momentum Metrics: Leading Indicators for Community College Improvement

February 2017

Early Momentum Metrics: Why They Matter for College Improvement

Additional Resources

For more policy briefs and fact sheets, visit CCRC’s Policy Resources page.

  • Our Research
  • About Us
  • Publications
  • News
  • Community College FAQs
  • Blog
  • Pandemic Recovery
  • Our Research
  • About Us
  • Publications
  • News
  • Community College FAQs
  • Blog
  • Pandemic Recovery

Community College Research Center, Teachers College, Columbia University
Box 174 | 525 West 120th Street, New York, NY 10027

  • 212.678.3091
  • ccrc@columbia.edu

© 2025. All rights reserved.

Facebook-f Twitter Linkedin Youtube Instagram
Join our mailing list
  • Our Research
    • Focus Areas
    • Publications Library
    • Presentations
    • Guided Pathways Workshops
    • Policy Resources
  • About Us
    • CCRC Staff
    • Research Affiliates
    • Advisory Board
    • Biennial Report
    • Employment
    • Contact
  • News
  • Community College FAQs
  • Blog
  • Pandemic Recovery
  • Our Research
    • Focus Areas
    • Publications Library
    • Presentations
    • Guided Pathways Workshops
    • Policy Resources
  • About Us
    • CCRC Staff
    • Research Affiliates
    • Advisory Board
    • Biennial Report
    • Employment
    • Contact
  • News
  • Community College FAQs
  • Blog
  • Pandemic Recovery