Skip to content.

Bloggers > PrivateWebHome > WebLog > OurBestStudents > OurBestStudentsLogPage
Click here to find the comments for this topic






Over a year ago I began wondering whether the universal belief that we have good schools for affluent kids and lousy schools for disadvantaged kids was actually true. One of Jenny D's posts had got me thinking:

...schools serve rich white kids well. They do. Best example is TIMMS data. The highest scoring kids in the U.S. score as well as the highest scoring kids anywhere in the world. [ed.: see below] Our best and brightest are as good as the best and brightest anywhere. We are indeed producing scholars. They tend to be white and affluent, according to the statistics. They go to public and private schools.

[ed.: This is an exaggeration. The only U.S. students who score on par with the rest of the world's math students are those who take AP Calculus, which is 5% of the population.]



I no longer believe this for a number of reasons, the most significant being the fact that SAT verbal scores declined in the 1970s and never recovered. Once I learned that verbal scores are the center of the universe, that settled it.


SATmathscores.gif

Ticket to Nowhere
by Paul E. Peterson


Tuesday night's school board meeting raised a version of the rich school/poor school question, namely: how do our middle school students compare to middle-school students in other countries?

Does France have a middle-school slump?

I don't know. I don't think so, but I don't know.

Do our kids, rich and poor, have a middle grades slump because it's natural to have a middle school slump?

Or do they have a middle school slump because our middle schools are inferior to middle schools elsewhere?

Middle school performance has lagged so consistently -- in wealthy suburbs and poor cities, in New York and around the nation -- that many educators, policy experts and even parents just shrug. The middle grades have long been viewed as the Bermuda Triangle of education. A common explanation is that there is simply no cure for puberty.

4th-Grade Successes to 8th-Grade Disappointments: Tests' Meaning Questioned ($)
By DAVID M. HERSZENHORN
Published: May 26, 2005

Certainly this familiar chart implies that if 11 to 13-year olds in other countries do stumble in the middle grades, they don't come to a full stop the way our kids seem to:

ednext20023_10fig1.gif

source:
The Seeds of Growth
by Eric Hanushek



at the school board meeting

At the Board meeting we learned that:

  • Irvington 4th graders (in 2005-2006) ranked 4th in the state, out of 40, on the ELA

  • Irvington 8th graders (in 2005-2006) ranked 14th in the state, out of 40

  • 43% of Irvington fourth graders in 2001-2002 scored a 4; 42% scored a 3, 13% scored a 2%; 1% scored 1
    UPDATE: in fact, this figure — the figure for school year 2001-02 — was not presented to us at the Board meeting.
    I had to look it up.

  • 16.7% of the 8th graders in 2005-2006 scored a 4; 61.1% scored a 3; 22.2% scored 2s & 1s


Those last two figures are for the same class of kids. 43% get 4s when they're in 4th grade; 4 years later, in 8th, we're down to 16.7% scoring 4.

This was easily explained away by our Assistant Superintendent for Curriculum, Ralph Napolitano:

  • a couple of ELA teachers took sudden leaves, so lots of last year's 8th graders were taught by substitutes

  • 18 new students moved into the district, 14 of whom were "receiving services" (mostly 504C or "building support"), and dragged our scores down (total class size: approximately150)

  • you really can't compare one year's kids to any other year's kids anyway because "the scaling might be different" (not a direct quote, unfortunately, but close)

There were no dissenters from this view (from all 3 of these views, I should say), although a couple of board members did ask questions which, if the point had been pressed, could have been probing. No probing occurred, however.

Under questioning, Ralph's presentation of self was masterful. When a Board member asked whether other districts include high-end special needs kids in their stats he lowered his voice a bit, assumed an intimate and confiding tone that cast a spell on the room, and said, "Well, you know, I think these days [meaningful look] they'd probably be in some serious trouble if they didn't include their special needs students in their data. But they didn't always..." and he trailed off.

The effect of this was to divert the room from a possible consideration of whether 14 kids receiving services can cause a 50% decline in 4s* to a general recognition of the virtue displayed by our Irvington administrators, who can be counted upon to tell the truth when other lesser school districts are fudging their numbers. Or used to fudge their numbers, as the case may be.

The question of how many 504C students moved into districts that didn't experience a 50% decline didn't come up.


We moved on.

All of the Board members had read newspaper accounts of the middle school slump. That fact alone earns the framers of NCLB my eternal gratitude. Until this moment, neither journalists nor parents nor parent school board members had any idea that U.S. kids experience a steady decline in scores after 4th or 5th grade. Journalists, if not parents, knew that 8th graders score worse than 4th graders, but they'd never looked at scores showing a steady year-by-year drop. Seeing it that way makes it seem worse, somehow, more inexorable and "systemic":

Meanwhile I am struck by one thing—the (unintended?) result of the federal mandate under No Child Left Behind to test students in every grade, three through eight.

The decline in performance as students age just leaps off the page. No matter whether the school is in a wealthy suburban community or an urban neighborhood full of transients and immigrants, the trend is the same. The only difference is how drastic the drop.

Ever since the state began standardized testing, districts have been struggling to come up with ways to stop the decline in performance from fourth grade to eighth grade. Heck, everyone’s struggled to figure out WHY there’s a decline.

One year, Education Commissioner Richard Mills played the blame game, urging parents to rise up against the middle schools which were clearly failing to do their jobs adequately. He has stopped being so pointed. But he still rails against the decline.

“The problem is literacy in the middle grades,” Mills said in a press release this morning. “These results demand improvement in curriculum, instruction, and professional development.”

So how come sixth, seventh and eighth-graders are struggling with literacy in middle school, yet the region’s high schoolers manage to pass the English Regents exam in much higher proportions? Take a look at any district’s Regent results in our interactive database.

Is there that much remediation going on in high school? Are the tests the problem? Are the kids just refusing to work hard in middle school?

Inquiring minds want to know.


This passage comes to us from "the education team at The Journal News," which has started a new education blog.

The reason the steady decline in scores leaps off the page, btw, is that the state Department of Education put out press releases saying so.

So we turned to the question of a middle school slump in Irvington.

It seems to be the consensus view of the administration and the Board (the Board president, at least) that there isn't one. Irvington students do fine until 8th grade, when they experience a sudden drop.

I wasn't following the presentation as closely as I could have by then; Ralph may have cited consistently high TONYSS scores in Grades 5, 6, & 7 over the years, although I didn't hear him if he did.

The TONYSS situation is a big mess anyway as far as I'm concerned. The TONYSS (Test of New York State Standards) is a privately created and marketed test NY schools used to administer in off-years (grades 5, 6, & 7). We parents were never given any comparison data whatsoever; the scales weren't explained; no sample questions were available, etc. The TONYSS are a complete mystery to me and everyone I know.

So even if he did cite off-year TONYSS scores, it wouldn't have cleared anything up for me.

The 8th grade test, Ralph said, was for some reason "more difficult" than any of the other tests & thus tells us nothing of value about our schools or our kids. We know this because, as he said, "Look at the Regents [exit] scores. They're very high. Everyone goes down in 8th grade. In 11th grade they're back." That last is a direct quote. “In 11th grade they’re back.”

"I can attest to that," the board president said, breaking in. His kids' scores had gone down in the 8th grade and then bounced back in the 11th. It is a universal phenomenon; it happens to everyone.

"The 8th grade test is unnecessarily difficult," Ralph agreed.

And that was that.

When the audience was finally allowed to ask questions one parent said, "Shouldn't the state be looking at itself? Shouldn't the state be asking itself why it's giving kids a test this difficult that isn't in line with the other tests?"

Ralph was mild and forebearing. He had nothing bad to say about the state, or the tests, or the 504C kids who moved into the district and depressed our scores. It was left to the audience to work up a case of indignation against the state and its outlier test. Which I suppose we did.



the bounce

Ralph being the fellow who told the PTSA president that "parents" were complaining about my Singapore math class as he closed it down, I think I'll just go ahead and say that a great deal of his presentation strikes me as nonsense on stilts.

Especially the bit about the bouncing scores.

Scores do not bounce.

Reading scores in particular do not bounce.

The Regents' test, which determines whether a student does or does not earn a diploma, is not comparable to the 8th grade test, which prior to NCLB determined nothing.

It is extremely difficult politically to impose tough exit exams, as Ed learned when he worked on exit exams in history/social studies in CA. When large numbers of 17 year olds are denied a high school diploma because they failed an exit exam, there’s an uproar.

When large numbers of 13 year olds hose the 8th grade test there isn't.

That's the difference.

Here is Chester Finn on cut scores in exit exams:

As if the official passing score of 55 on the state's Regents exams were not low enough, the Buffalo News reported this week that students needed to answer just 33 percent of the questions correctly to achieve that score on the Regents exam in biology, and 45 percent of the questions in math.

[snip]

Should a state be ashamed of setting a passing score this low? Not necessarily, so long as the assessment is good and the "cut score" isn't going to remain low forever. Developing a tough test but setting the initial passing bar low can be a shrewd reform strategy, provided the bar is then continually raised. A state that has high expectations for students spelled out in rigorous academic standards--and solid tests aligned with these standards--has taken important steps toward standards-based reform. Yet--regrettably but realistically--many of today's students are not prepared to meet high standards. This leaves states with three tough options: 1) flunk lots of students, 2) offer easy tests that most students can pass, or 3) offer challenging tests but set cut scores low at the outset, then ratchet them up. Option three may be the most likely to lead to improved instruction. New York claims that next year the cut score goes up to 65. Some doubt that this will actually happen. Watch this space.

source: Gadfly 2001




That was 5 years ago, and the cut scores have not moved:

When the New York State Board of Regents voted last week to delay holding all students to higher standards for at least two more years, they portrayed it as a simple ''mid-course correction'' that was to be expected.

[snip]

An independent panel examining the state's Math A exam in June, which 63 percent of the students failed, concluded that the test itself was badly flawed. They said that if the state uses ''make or break'' tests, then it must spend the money to get them right. In the same vein, the panel found that Albany officials had raised standards but never made the curriculum clear or invested enough in training teachers.

[snip]

On the surface, the idea of guaranteeing that all students receive the same high-quality education is attractive.

Many states have embraced the standards-based approach that New York is using, which calls for statewide learning goals and statewide testing.

The federal No Child Left Behind Act, passed in 2001, gave further momentum to the movement, with annual testing and penalties and remedies for schools and children that failed to meet standards.

But as much of the country is carried along by this movement, there are growing concerns that the pendulum has swung too far.

Robert L. Linn, a University of Colorado professor and co-director of the Center for Research on Evaluation, Standards and Student Testing, who has served as an adviser to New York's Department of Education, expressed some of the mixed reactions to the standards approach when he said: ''Nobody can argue against No Child Left Behind, because how can you say that you should leave some children behind? But it is also nuts to say that it is possible to bring everybody to the same level. You can say that your goal is to have everyone run a mile in under five minutes, but do you really believe that it can be accomplished? I don't.'' [ed.: please. Running a mile in under five minutes ≠ passing algebra 1]

[snip]

New York used to issue different diplomas for students at different levels. Only the top students, who took the toughest Regents exams, got the prestigious Regents diploma. It was not until 1996 that the Regents made the exams a condition of high school graduation for everyone.

Scaling Back Changes On Regents Standards ($) By KAREN W. ARENSON
Published: October 14, 2003



Apparently it's possible to earn scores of 1 to 4 on the Regents exams these days, just as students do on the annual tests, though you'd never know it drilling down into the DOE website.

Irvington students earn a heck of a lot of 4s on Regents English:

  • Regents ELA 2003: 79% of Irvington test-takers earned a 4

  • Regents ELA 2004: 66% earned a 4

  • Regents ELA 2005: 71% earned a 4

  • Regents ELA 2006: 70% earned a 4

How did our lower grades do last year on the annual NCLB tests?

  • Grade 3 percent earning a 4 on annual ELA exam: 18.4%

  • Grade 4 percent earning a 4 on annual ELA exam: 32.3%

  • Grade 5 percent earning a 4 on annual ELA exam: 26.3%

  • Grade 6 percent earning a 4 on annual ELA exam: 38.8%

  • Grade 7 percent earning a 4 on annual ELA exam: 29.7%

  • Grade 8 percent earning a 4 on annual ELA exam: 16.7%


That's some bounce.

Ralph assured us that we could count on all of our students continuing to do very, very well on Regents ELA.

I wonder why that is.




does everybody bounce?

Not necessarily.

Assuming I’m reading the charts right, in 2 of the last 3 years Hastings-on-Hudson (pdf file), 2 towns over from us, saw its 8th grade scores go up from what they'd been in 4th grade.

Back in 4th grade, both of those classes had lower scores than Irvington children. In 8th grade their scores were higher — on the same “unnecessarily difficult” test our assistant superintendent seems to feel is too much for Irvington children to manage.

Hastings didn't come up at the meeting.




RAND on middle school

So I was Googling up a storm today, trying to find a direct comparison of the Regents' exams, on which our students do so well, to the annual NCLB exams, on which they do much less well. I came up empty, but I did find this passage in a famous RAND study of middle schools:

In sum, the international comparisons do not convey a favorable picture of the achievement of U.S. middle school age students. Although many of the other OECD countries may not have the disparity between the haves and have-nots or the same levels of racial or ethnic diversity as the United States, these factors alone cannot account for the standing of U.S. students. That 4th graders perform well on TIMSS but 8th graders do not suggests that economic conditions cannot explain differences in the relative performance levels for these two grades (Suter, 2000). Analyzing TIMSS results, Schmidt, Jakwerth, and McKnight (1998) found that the variability in student achievement levels in the United States is comparable to that in other countries. Furthermore, tabulations presented by Richard Houang (cited in Suter, 2000) showed that, even if all students belonging to ethnic or racial minorities are excluded, white U.S. students still rank in the lowest one-third of all countries at the end of secondary school. Thus, we cannot attribute the low relative rank of U.S students to the performance of specific racial or ethnic groups. However, differences between certain demographic groups should not be ignored; in later sections of this chapter, we therefore attempt to describe such group differences within the United States more fully.

source: Focus on the Wonder Years: Challenges Facing the American Middle School:
Challenges Facing the American Middle School
Jaana Juvonen
Vi-Nhuan Le
Tessa Kaganoff
Catherine Augustine
Louay Constant
p. 32-34

Our public schools do not serve rich white kids well.

In fact, I've begun to wonder whether some of our affluent suburban schools are giving students less "value-added" per year than inner city schools.




CHAPTER 3: Achievement of Advanced Students



-- CatherineJohnson - 28 Sep 2006

Back to: Main Page.