The Myths of Standardized Tests: Why They Don’t Tell You What You Think They Do

The Big Picture

  • The information the public needs to have about its schools is far broader and more complex than any set of test scores. Policies are about evaluation not about accountability. This book is devoted to demonstrating the shortcomings of the measuring stick of standardized testing. In order for a test to provide accurate evidence to judge the caliber of instruction, it must be able to distinguish between students who have been well taught and students who have not. Suitable tests must be instructionally sensitive. Tests being used are not. They rely on items closely linked to socioeconomic status and inherited aptitudes to spread out the scores. As such they tend to measure what students bring to school, rather than what they are taught once they get there.

The Tests Are Too Narrow

  • Standardized tests depend on the idea that a small portion of a student’s behavior fairly represents the whole range of possible behavior. To draw valid inferences from a test, it must cover more than a small part of the content domain. If you have a large number of students, overall outcomes on different versions of a test should even out. But any one student can go from proficient on one version to needing remediation on another. Items are chosen to spread out the scores of the test takers. Time limits spread out scores even more. Life isn’t like a quiz show. As students can only sit and focus for so long, the tests can only deal with a small fraction of the domain. Some topics have to be skipped. Timed tests also produce test anxiety. Beware of timed tests.

Tests Don’t Measure Achievement Adequately

  • Measurement of student achievement is too complex for current social science methods. We still use them to make decisions that impact students and schools. They don’t measure goals schools pursue like creativity, critical thinking, motivation, persistence, empathy, leadership, courage, compassion, honesty, and curiosity. Students with high scores may be shallow thinkers. If the only tool you have is a hammer, everything looks like a nail. They were created to measure the performance of populations not schools, teachers, or individuals. Important items that all students should know are left out at the expense of items that half of the students will miss. There are too many standards to use criterion-referenced tests.

The Tests Aren’t Objective

  • By objective we mean based on observable phenomena and not influenced by emotion or personal prejudice. A look at how the tests are made, however, reveals a good deal of subjective human judgement from the people who write, edit, and assemble the test items. Setting the standards also requires judgement that occurs in a political and social context. Achievement levels are, first and foremost, policy statements. The only truly objective part is the scoring. Test scores are not clean, crisp numbers but fuzzy ranges that extend above and below the score, and 5% of the time the true score isn’t even in the fuzzy range. Since numbers confer a sense of fairness and impartiality, they are used to justify decisions that impact students’ lives.
Share this:
Share this page via Email Share this page via Stumble Upon Share this page via Digg this Share this page via Facebook Share this page via Twitter Share this page via Google Plus     If you like the summary, buy the book
Pages: 1 2 3 4

Tags: , , , , ,

17 Responses to “The Myths of Standardized Tests: Why They Don’t Tell You What You Think They Do

  1. Dr. Don says:

    Every educator, administrator, government bureaucrat, and union leader should be required to read this book, and then tested on it in the same manner that our children are tested today. Better yet, this should probably be a seminar topic for required academic continuing education. Chart 14, “New Ideas for Genuine Accountability” brushes the surface and wets our appetite on a new direction and sounds like it could be the basis for Harris, Smith, and Harris’s next book.

  2. […] Doug Green has an excellent summary of the myths and negative consequences of standardized testingbased on a book on his site: […]

  3. Archangelo says:

    Standardized tests aren’t really meant to measure student achievement, but to provide an excuse to dump teachers.

  4. SEO says:

    Fantastic submit, very informative. I’m wondering why the opposite experts of this sector do not understand this. You should proceed your writing. I am confident, you’ve a huge readers’ base already!|What’s Taking place i am new to this, I stumbled upon this I’ve found It absolutely helpful and it has helped me out loads. I hope to contribute & assist other customers like its aided me. Good job.

  5. It’s a pity you don’t have a donate button! I’d certainly donate to this excellent blog! I guess for now i’ll settle for bookmarking and adding your RSS feed to my Google account.

    I look forward to fresh updates and will talk about this website with my Facebook
    group. Chat soon!

  6. We are a bunch of volunteers and starting a new scheme in our community. Your site offered us with useful info to work on. You have done a formidable activity and our entire community will probably be grateful to you.

  7. Having read this I thought it was very enlightening. I appreciate you
    finding the time and energy to put this short article together.

    I once again find myself spending a significant amount of time blth reading
    and leaving comments. But so what, it was still worthwhile!

  8. Je ѕuis arrivé sur ce blοg par hasard : je ne lе regrette pas du tot !!!

    Also visit my web ѕіte;

  9. This will get you traffic to your site and make money.
    A VPN creates an encrypted connection to a third-party server, and all your Internet traffic is routed through
    that server. It’s probably some mix of the two, so I have to give
    him props for not going too far in either direction.

  10. Hey! This is kind of off topic but I need some guidance from an established blog.

    Is it difficult to set up your own blog?
    I’m not very techincal but I can figure things out pretty
    quick. I’m thinking about setting up my own but I’m not sure
    where to begin. Do you have any tips or suggestions?

  11. My blog is a WordPress blog that I paid a guy at Gorges.US to modify.
    You can, however, go to and create your own for free.
    I hope you like my work and please share with your network.

  12. Emil says:

    Excellent blog post. I definitely love this site. Thanks!

  13. Wow, marvelous blog layout! How long have you been blogging for?

    you made blogging look easy. The overall look of your site is fantastic,
    let alone the content!

    Here is my web page: legal adviser

  14. visite site says:

    Nice blog here! Also your site loads up very fast! What host are you using? Can I get your affiliate link to your host? I wish my website loaded up as quickly as yours lol|

  15. Taylor says:

    Hmm is anyone else encountering problems with
    the images on this blog loading? I’m trying to find out if its a problem
    on my end or if it’s the blog. Any responses would be greatly appreciated.

    Check out my blog post … lawyer search by name (Taylor)

  16. Taylor: What kind of problems are you having? Dr. Doug

  17. It’s Gorges in Ithaca, NY. You can click through to them with the icon at the bottom right of any page.

Leave a Reply