adaptive testing?

[general / off-topic?]

how does ronan reverse engineer collegeboards routing and scoring algorithm, or is there a fixed proportion of correct answers in baseline m1 that guarantees hard m2 (e.g 85%+ of m1 questions are correct so you route them to hard m2), or is there a proprietary custom tuned algorithm

are my scores inflated, and does the algorithm reward guessing or other similar strategies

also your api is down i think (getquestionexplanation returns 404)

edit: fixed word choice

3

2 Comments

Checking sign-in…
ronan19/08/2026

It’s not necessarily a reverse-engineering process. The algorithm is well known and anyone within the field of psychometry understands how it works. I have worked and researched for the past year about related topic so implementation is just a breeze. Simply just working with a bunch of data, then calibration. Ronan SAT has a lot of participants especially when taking parts in an Adaptive test so we can mirror that accuracy. As for the accuracy of the model, its literally the same algorithm. I can’t claim that it will be 100% what you expect on test day but its pretty much quite close to +_ 30 pts of difference due to the sheer difference in size. But as I work thru more optimisations algorithm, maybe in the future we will have better accuracy for smaller cohorts ¯⁠\⁠_⁠(⁠ツ⁠)⁠_⁠/⁠¯

@ronan actually goated response, massive respect for the dev team

yes i just completed their august adaptive test with a 1540 (6 wrong answers in m2 btw), i was wondering if this was inflated or not (i think my real score would be 1500-1510)