I'm going to pick Pennsylvania because a) that's the state I'm most familiar with and b) they make a lot of information available on their website, a poorly laid out website for sure, but you can usually find what you're looking for if you poke around long enough.
Pennsylvania does not release actual test questions from its PSSA test; however, they offer the next best thing -- lots of sample questions from each test. Good enough for our purposes. Here are representative problems (pdf) for the upcoming 2006-2007 tests for 5th and 8th grades and from the 2005-2006 exams for 11th grade. (all in pdf form.). The tests are given at the end of March.
|5th Grade||5th Grade|
|8th Grade||8th Grade|
|11th Grade||11th Grade|
Before you look at the tests, let me tell you what it means to be proficient. To be "proficient" on the tests here's the percentage of questions that the students would have to answer correctly.
These proficiency percentages were calculated from the cut scaled scores given on p. 117 and the raw score to scaled score conversion tables given in appendix II-9 of this monster 2005 technical report (pdf).
So in math, a student could get 1 out of every three problems wrong and still be proficient. In reading, the student could get one out of every four problems wrong and still be proficient.
Here's a few more notes before you jump into the sample questions. In the math portion, students are permitted to use calculators on all but a tiny fraction of calculation questions on the fifth and eighth grade exams. In addition, a formula sheet and ruler are provided, as indicated in the scoring sampler.
Now go ahead and take a look at the sample problems.
In math, you'll see that many of the problems at each grade level are simplistic. Many of the problems can be solved easily by plugging the multiple choice answers into the calculator. Few, if any problems, require multiple steps to answer. Few of the problems contained in each test are at grade level; many questions test skills that should have been taught years before. Manipulation of fractions, a critical skill needed for success in algebra, is barely tested at all.
In reading, the passages are about at grade level (using the lexile calculator); however, the comprehension questions are simplistic, frequently requiring that the student find the requested fact in the text.
Here are the disaggreagated scores from the 2005-2006 PSSA exams. The table shows the percentage of students who scored at or above the proficient level. Math scores are given first followed by reading scores (math/reading).
Here's another basis of comparison.
Here's the placement test given for the middle of fouth grade for Singapore Math. Compare the questions to the 5th grade math PSSA questions.
Here's the placement test given for the middle of sixth grade for Singapore Math. Compare the questions to the 8th grade math PSSA questions.
Here's the placement test given for the second year of algebra (8th grade) for Singapore Math. Compare the questions to the 11th grade math PSSA questions.
Singapore is tops in the world for math achievement. One reason for that achievement is the rigorous Singapore Math curriculum the country uses. Another reason is that Singapore is full of brainy northeast asians. That's why I selected the placement tests that were one to three years behind the PSSA tests, giving less brainy U.S. students an extra one to three years to catch-up.
Here's the post test for Connecting Math Concepts (CMC) level F, a fifth grade math program. The curriculum has been extensively field tested so that almost every student, including the ones with IEP, who has completed the six years in the probram will be able to answer at least 80% of the post test questions correctly. Compare the questions on the post test to the PSSA questions. Now look at the high percentages of black,hispanic, low SES, and IEP students who are not proficient in Pennsylvania (the 11th grade IEP students are performing at the chance level, i.e., randomly filling in the bubbkles will yield the same score). Now ask yourself why less than 2% of schools use CMC or a math program like it.
The comments section is open.