I think I know when I'm being disingenuous, thank you very much, and that was not it. Mistaken, perhaps, but not disingenuous.
Even so:
> In any case, even small effects can be unfair. Let’s assume the effects of short-term coaching are really just a 20- or 30-point jump in students’ scores. That means they ought to be irrelevant to college admissions officers. Briggs found otherwise, however. Analyzing a 2008 survey conducted by the National Association for College Admission Counseling, he noted that one-third of respondents described a jump from 750 to 770 on the math portion of the SAT as having a significant effect on a student’s chances of admissions, and this was true among counselors at more and less selective schools alike. Even a minor score improvement for a high-achieving student, then—and one that falls within the standard measurement error for the test—can make a real difference.
Test prep, even if it's as rudimentary as taking the test multiple times (thus, being able to afford to take the test multiple times), is an advantage that matters.
In extremely competitive situations, the slightest edge matter. Arguably test prep is less of an edge than spending a summer on some community project would be but even a relatively small point jump is an edge for someone on the bubble. And, of course, elite schools have become hyper-competitive. I have very few illusions that I would have the school choice I had when I went to college--especially given that that about an eighth of my class went to the school in question.
The real problem [edit: with scores] here is that scores are reported on a 200-800 scale. If they were reported in terms of standard deviation from the mean, then those 20-40 point differences wouldn't matter to admissions officers. As it is, a 30 point difference looks significant, even though it's only around 0.15 SD.
I'd hope that admissions officers are sophisticated enough to know that. Having said, there's some band in which you're basically flipping coins given overall criteria so you flip coins based on statistically insignificant numbers rather than complete random number generators.
Even so:
> In any case, even small effects can be unfair. Let’s assume the effects of short-term coaching are really just a 20- or 30-point jump in students’ scores. That means they ought to be irrelevant to college admissions officers. Briggs found otherwise, however. Analyzing a 2008 survey conducted by the National Association for College Admission Counseling, he noted that one-third of respondents described a jump from 750 to 770 on the math portion of the SAT as having a significant effect on a student’s chances of admissions, and this was true among counselors at more and less selective schools alike. Even a minor score improvement for a high-achieving student, then—and one that falls within the standard measurement error for the test—can make a real difference.
https://slate.com/technology/2019/04/sat-prep-courses-do-the...
Test prep, even if it's as rudimentary as taking the test multiple times (thus, being able to afford to take the test multiple times), is an advantage that matters.