What do you need to know?
Here’s what you need to know about the current version of the COMBANK Level 1 Assessment score prediction model and how to use and interpret its predictions when considering whether you are prepared to sit for the real-world COMLEX-USA® Level 1 standardized exam.
| #1 The COMBANK Level 1 Assessment’s score prediction model was most recently updated on February 1, 2025, for all mock assessments completed on or after this date. |
| #2 The COMBANK Level 1 Assessment’s Individual Assessment Summary Report provides students with a probability, or likelihood, of passing their real-world COMLEX-USA® Level 1 standardized exam based on their mock assessment score. Please note that students who completed a COMBANK Level 1 Assessment before February 1, 2025, will be shown a predicted outcome of “Pass” or “Fail” using a previous version of the score prediction model. |
| #3 For the most accurate predictions, treat the mock assessment as seriously as you would the actual exam. This means that you should take the assessment under conditions that most closely mimic the real-world exam. Since the prediction is based on how you performed when you completed the mock assessment, the results can fluctuate. If feasible, complete the assessment as close as possible in time to when you will sit for the actual exam. Also, if time permits, review your results and compare them to your study plan. In addition to reviewing your strengths and weaknesses, reflect on your studying and testing behaviors that may impact your performance. |
| #4 A prediction is not fate; it is an indicator for how you may do on the real-world exam given your performance on the mock assessment at the time of testing. In addition to the prediction, it is important to consider your preparedness to sit for the real-world exam in conjunction with other measures of test readiness. |
What predictions does the score prediction model provide you?
When you complete TrueLearn’s TrueLearn’s COMBANK Level 1 Assessment, you are provided with an Individual Assessment Summary Report that shows a score prediction for how you may perform on their real-world exam. This prediction is represented as a probability, or likelihood, of passing. This probability is a percentage that ranges from 0 percent to 100 percent.
Please note that students who completed a COMBANK Level 1 Mock Assessment before February 1, 2025, will be shown a predicted outcome of “Pass” or “Fail” using a previous version of the score prediction model.
| TrueLearn’s COMBANK Level 1 Assessment is the most predictive when the assessment is administered as close as possible in time to when you will sit for the actual COMLEX-USA® Level 1 standardized exam and under conditions that most closely mimic the real-world exam. You should take the mock assessment in a proctored or controlled setting and complete it in one sitting to simulate a similar experience to the real exam. The more representative of the real-world standardized exam the test-taking experience is when completing the mock assessment, the more predictive and accurate the mock assessment will be of your performance on the actual exam. |
How should you use and interpret the model’s predictions?
When using the model’s prediction to identify whether you are prepared to sit for the actual exam, there are several important factors to keep in mind.
- The mock assessment is most predictive of your real-world performance on the actual COMLEX-USA® Level 1 standardized exam when the assessment is taken as close as possible in time to when you will sit for the actual exam and under conditions that are representative of the actual exam.
- The prediction about your performance on the actual COMLEX-USA® Level 1 exam is just that – a prediction. It is not fate, and the prediction may be wrong. There are many factors that influence the predicted outcome, such as how you felt when you took the mock assessment and the mock assessment’s method of delivery (and how its delivery differed from the real exam). Additionally, no predictive model is perfect, and all predictions are associated with some error. Remember to consult with your faculty advisor and consider other measures of test readiness, in addition to the prediction, when deciding on whether you are prepared to sit for the actual exam.
- Do not forget to consider all of the other performance metrics provided by the individual assessment summary report. The prediction for whether you may pass or fail the real-world exam is only one data point. For example, carefully review how you performed on different topic categories and identify competencies where you are weak and require more study. Also, consider how you felt while taking the mock assessment. Did you feel confident as you completed the assessment? Were you surprised or unsure of its content? Use this self-reflection as an opportunity to identify areas for improvement.
Why did we develop a new predictive model?
TrueLearn is committed to providing a world-class product that prepares students to become strong life-long learners inside and outside of the classroom. A key part of our data-centric approach is to communicate comparative benchmarks for students to use to gauge their preparedness. It is critical for their preparation that students know where they stand and how they will perform, and TrueLearn’s COMBANK Level 1 Assessment provides a benchmark for students (and faculty) to use to assess their likely real-world performance on the actual COMLEX-USA® Level 1 standardized exam.
The score prediction model for TrueLearn’s COMBANK Level 1 Assessment was developed by leveraging historical performance data comparing students’ scores on the mock assessment to their actual performance on the real-world standardized exam.
Internal testing found that the updated model more accurately predicts how students will perform on the actual exam compared to the previous approach used for score prediction. This increased accuracy will help students better determine their level of preparedness to sit for the real-world exam.
How was the model developed and how does it perform?
The new model for the COMBANK Level 1 Assessment was developed using a predictive modeling approach. Data for a sample of students that completed TrueLearn’s COMBANK Level 1 Assessment and sat for the actual standardized exam were used to train the predictive model. The data included the students’ percentage correct score on the COMBANK Level 1 Assessment and the most recent score on the actual standardized exam taken after completing the mock assessment. Several additional performance metrics are also used by the model.
The model was trained and validated using a best-in-class 10-fold cross-validation modeling approach. Several different linear and non-linear models were investigated and the final model selected demonstrated the best performance on several key validation metrics, including out-of-sample (OOS) R-squared (R2) and correlation (r) between students’ actual scores on the real-world COMLEX-USA Level 1 exam and the model’s predicted scores for how students may perform on the actual exam.
How will the model be maintained and improved over time?
TrueLearn is committed to providing a world-class learning and exam preparation resource and we consider the predictive models that we develop as being a key feature of that product. We conduct quarterly reviews of the COMBANK Level 1 Assessment’s score prediction model’s performance to identify deficiencies and ensure it continues to provide accurate predictions. Additionally, we continually strive to enhance and improve the model by leveraging new and additional data and experimenting with different modeling approaches.
| Help us improve the accuracy of the model’s predictions! The most important ingredient for building accurate predictive models is data. You can help us improve the accuracy of the COMBANK Level 1 Assessment’s score prediction model by encouraging your students to share their score reports with TrueLearn after they sit for the real-world COMLEX-USA® Level 1 standardized exam. Students can upload their score reports directly in their account settings. |
If you have any questions about the COMBANK Level 1 Assessment’s score prediction model, please reach out to the TrueLearn Customer Support team.
*COMLEX-USA® Level 1is a trademark of the National Board of Osteopathic Medical Examiners® (NBOME®). This content is not endorsed or approved by NBOME.