Skip to content.

Kitchen > PrivateWebHome > WebLog > SandraStotskyOnReadingAndEdSchools
06 Feb 2006 - 12:59

close 'em down


Abstract: Reading instruction is one of the very few areas where it is not the case that “more research is needed.” Educational policy makers already have the theory and the evidence supporting it to guide the implementation of effective reading programs from K-12. In fact, they have had the theory and the evidence for decades. The central problem they face in providing effective reading instruction and a sound reading curriculum stems not from an absence of a research base but from willful indifference to what the research has consistently shown and to a theory that has been repeatedly confirmed. Using Jeanne Chall’s The Academic Achievement Challenge as a point of departure, I suggest why our education schools, through their influence on teachers, administrators, textbook publishers, and state and national assessments of students and teachers, have come to be the major obstacle to closing the “gap” in student achievement.

source:
Why Reading Teachers Are Not Trained to Use a Research-Based Pedagogy:
Is Institutional Reform Possible?
Sandra Stotsky
Research Scholar
Northeastern University
Prepared for the Courant Initiative for the Mathematical Sciences in Education Forum:
“Delivery on the Promise of Mayoral Control”
Courant Institute of Mathematical Sciences
New York University
October 2, 2005





David Klein on Bennet-Kew

Not all teachers can accept the kind of environment one finds at Bennett-Kew. Newly credentialled teachers from prestigious universities are sometimes turned away after a semester or two. Education college doctrine is often at odds with what works at Bennett-Kew, and Mrs. Ichinaga has found that in some cases noncredentialled teachers provide better instruction than credentialled ones.

source:
High Achievement in Mathematics:
Lessons from Three Los Angeles Elementary Schools
by
David Klein
Commissioned by the Brookings Institution
August 2000





I have never heard of it

Notices [of the American Mathematical Society]: Starting in 1968, the government funded a huge study called Project Follow-Through. It cost a billion dollars and ran almost thirty years. The purpose was to examine how different teaching methods or philosophies affected student performance. What they found was that the traditional, “direct instruction” method was the most effective. Are you familiar with this study?

[President of NCTM,] Gail Burrill: I have never heard of it.

source:
Interview with Gail Burrill by Allyn Jackson





Project Follow-Through — what happened?

I've barely skimmed the surface of writing about what happend and why.

However, out of my very small sample of articles on the subject, Cathy L. Watkins' piece is the first thing I'll read in full.

excerpts:

The history of Follow Through and its effects constitute a case study of how the educational establishment functions. As in other bureaucracies, it is composed of parochial vested interests that work to either maintain the status quo or to advance a self-serving agenda. As a result, the largest educational experiment in history (costing almost one billion tax payer dollars) has been effectively prevented from having the impact on daily classroom practices that its results clearly warranted. Let's look at some factors that operate at each level of the educational establishment to influence decisions about teaching methods and materials.

Policymakers. Follow Through demonstrated that public policy is based on public support, not on empirical evidence....Because the Direct Instruction model represents a minority view in education, it was not surprising that policymakers failed to take a strong position in support of the Follow Through results.

Although some policymakers may have some formal training in areas of education, they typically rely on input from education professionals when developing and supporting programs. The influence of stakeholders in traditional educational practices can be seen throughout the history of Project Follow Through....For example, the chairman of the Follow Through National Advisory Committee was the dean of the Bank Street College of Education, whose model was ineffective in improving academic achievement or affective measures.

....In fact, some social policy analysts assert that in situations where administrators are strongly convinced of the effectiveness of a program, it is likely that an evaluation will be disregarded. This is tragically illustrated in California where policy makers enamored with Whole Language were seemingly incapable of attending to data showing serious declines in students' reading performance, including a national assessment on which California students placed last.

[snip]

Colleges of Education. Project Follow Through was unique because it examined not only instructional programs, but the educational philosophies from which they were developed....The majority of models were based on philosophies of "natural growth" (Becker and Carnine, 1981) or what Bijou (1977) referred to as "unfolding." According to these models, learning involves changes in cognitive structures that are believed to develop and mature in the same manner as biological organs. Whole Language is an example of instruction derived from this philosophy. It is based on the belief that reading develops naturally given sufficient exposure to a print-rich environment.

The second philosophical position is concerned with principles of learning or "changing behavior" (Becker and Carnine, 1981). From this perspective, teaching involves specifying what is to be taught and arranging the environment in such a way that the desired change in behavior results.

Although the data from Follow Through support the latter position, the majority of colleges of education espouse a philosophy of cognitive restructuring. Thus, the data from Follow Through fail to support the philosophy that dominates colleges of education. This obviously made it difficult for educators to accept the Follow Through findings and they responded by discrediting the evaluation as well as by voicing specific objections about the Direct Instruction model or questioning the values of the model. For example, educators are fond of accusing direct teaching approaches of ignoring the "whole child" by emphasizing academic achievement at the expense of affective development. The Follow Through data clearly show that no such trade-off occurs. The Direct Instruction model was more effective than any other model on measures of self-esteem. A second objection is that this Direct instruction is reductionistic and results in only rote learning of non-essential skills. Yet, the data show that students in the Direct Instruction model demonstrated superior performance on measures of complex cognitive skills. In contrast, not a single model that set out to improve these cognitive skills was able to do so.

[snip]

The training paradigm underlying most teacher training programs has little to recommend it, with students spending the majority of their time listening to lectures about theory and method. Sponsors of Follow Through models found that lectures about teaching had little impact upon actual teaching practices. Training was most successful when it included modeling of the desired behaviors, opportunities for teachers to practice, and feedback about their performance (Bushell, 1978)....

Teachers. Probably the biggest obstacle is the fact that the instructional methods a teacher uses are most likely to be those taught during his or her own training....there are currently thousands of teachers in classrooms who do not know how to teach beginning reading, because the professors who "taught" them adhered to a philosophy of "natural growth." One teacher confided to me, "I do not know how to teach reading to someone who doesn't already know how to read"!

Teachers may not seek out empirically validated methods, such as Direct Instruction, because they fail to recognize that their current methods are not effective. [ed.: self-assessment is difficult for everyone, not just for students] Student failure is more likely to be attributed to deficits within the child or to external factors such as the child's home life, than to ineffective instruction. ...even if teacher did know there was a better way to teach, how would they acquire the necessary skills? Surely not by returning to the schools where they received their initial teacher training.

Teachers who are motivated to look for and use effective methods, often run into opposition....

School Districts. The fact that effective teaching methods are available does not mean that they will be adopted. According to Alan Cohen (personal communication, 1992), "We know how to teach kids, what we don't know is how to get the public schools to do it!"

....One way that Follow Through differed from other federally funded programs was that in exchange for funding, particular instructional practices were specified and monitored. This system of supervision resulted in a higher degree of fidelity of implementation of the model than might otherwise be expected. However, schools are generally not organized to provide the level of supervision that Follow Through model sponsors found necessary to ensure fidelity of implementation.

Publishers. Much, perhaps most, of what a teacher does is determined by the materials he or she uses....materials are not field tested to ensure their effectiveness with children. The publishing industry does not initiate the development of instructional materials, but instead reacts to the demands of the educational marketplace....In California the state adopts an instructional framework. Criteria for instructional materials are then derived from the framework. Publishers are provided these criteria and busily get to work developing instructional materials that conform to them. They submit their materials during the textbook adoption process and panels evaluate the extent to which the materials correspond to the specified criteria. Noticeably absent from these criteria is any mention of measured effectiveness. ...field tests are expensive, and the prevailing contingencies provide absolutely no incentive for publishers to conduct them in order to provide learner verification data because such data are not considered in textbook selection and adoption. (See "Why I sued California, Engelmann, ADI News, Winter, 1991).

The Public. What the public has supported is a system which has continued to neglect effective methods of instruction....Parents and others have been led to accept that the failure of a great many students to learn is due to deficits in the children. The general public has no way of knowing that children's achievements are largely a function of how they are taught.

source:
Project Follow-Through: Why Didn't We? (full text of Cathy L. Watkins' article)





teaching to crammery

I've attended many CSE meetings, and until recently it hadn't occurred to me that our definition of 'learning disabilities' is entirely a function of public school curricula and teaching practices — which is not to say children don't have biological differences in learning ability. They do. But the definition of LD is comparative. You don't diagnose a learning disability with a brain scan or a blood test. In fact, I don't think learning disabilities are actually 'diagnosed' at all, are they? [please fill me in — I remember my neighbor, who is a clinical psychologist, explaining this to me a couple of years ago...]

IIRC, a child's problems in school 'qualify' as a learning disability when he or she has a normal IQ, but performs two years below grade level.

The possibility that the child may be two years below grade level because of a problem in the school, not the child, is never raised — and, in fact, can't be raised. It's not on the menu.

In 100% of all cases, the problem is discovered in the child, not in the school.

Once you let this fact sink in for a bit.....you're midway into a paradigm shift. A big one.

At ktm, we've talked about kids who do OK in spiral curricula.

I was one of those kids; probably many or most of you were, too.

Lately I've been wondering what it is about some children that allows them to do OK in courses that aren't taught to mastery.

I've called Christopher's accelerated math class a Death March to Algebra.

It is a Death March to Algebra, but there are going to be a bunch of kids still standing at the end. If I have anything to do with it, Christopher will be one of them.

How are they doing it?

And how normal is it that they are doing it?

Lately I've been realizing......we've based our concept of normal learning on these kids.

Learning disabilities are defined in relation to these children. Christopher's class is mostly populated by 'high-achievers,' by which I mean kids who do OK in spiral curricula. I'm starting to see this particular group of kids as a group, as a specific sub-population within any larger population of children. There's 'something about them' — something different. (I'm thinking it has to do with speedy memory; these are kids who can be taught to crammery. But I don't know.)

A child who's two years behind the kids who 'do OK' in a spiral curriculum is diagnosed with LD.

At the moment, I've got only one word to say about this realization and what it implies, or may imply:

yikes



update: from Charles

The indispensable Fordham Institute had a big report on why the big Follow-Through study was ignored.

Why Education Experts Resist Effective Practices (And What It Would Take to Make Education More Like Medicine) by Douglas Carnine


If you're interested in Project Follow-Through, Carnine's article is probably the place to start.


Washington Times article on Project Follow-Through
Effective Educational Practices (issue devoted to Project Follow-Through]]
Project Follow-Through: Why Didn't We? (brief summary Watkins' article)
Project Follow-Through: Why Didn't We? (full text of Cathy L. Watkins' article)
Sciencephobia (EDUCATION NEXT)
Illinois LOOP page on Project Follow-Through

cram school
teaching to crammery in middle school
the kind of kids who can be taught to crammery
free teach to crammery clip art
teachtocrammery



-- CatherineJohnson - 06 Feb 2006

Back to main page.



Comments

After entering a comment, users can login anonymously as KtmGuest (password: guest) when prompted.
Please consider registering as a regular user.
Look here for syntax help.


It's always worse than you think.

Check out the political agenda of the whole language founders and promoters as outlined in The Whole Language Catalog and the Reading and Writing Quarterly.

An analysis of this agenda is in the Comment section here: http://instructivist.blogspot.com/2006/02/revised-whole-language-golf.html

Now I understand, among other things, why educationists oppose tests and basal readers, for example.

Excerpt from Patrick Groff's analysis:

The third prominent argument for employing WL teaching to convey political-economic ideology centers on an attack on standardized reading tests.12 That assault on those tests is not surprising since they measure how well students comprehend precisely the meanings authors planned to convey and not how well they are “socialized into particular social practices” of a left-wing origin.

The Quarterly writers voice vigorous grievances against the tests: they are “scientific,” statistically sophisticated, and based on “meritocratic principles,” that is, “glorify” competitiveness. Proof that these tests “corrupt the concept of fairness” is that students who score low on them typically are from politically oppressed low-income minority families. These students do not possess “the knowledge required” to score high on the tests and do not have “knowledge of test-taking skills.” Therefore, testing these students signifies a “systematic bias” against them of a “racist” nature. Since it is held that the tests pander to students who are “white, male, middleclass, and American ” scores on them thus “may be more findings of cultural difference [among students] than anything else.”13

From the advent of the WL movement in the 1970s, its members have charged that standardized reading tests deliberately project socio-economically disadvantaged students onto “a trajectory of school-based failure.” The Quarterly writers repeated the common WL outcry that such testing must be abandoned and replaced with “individualized assessment” by bona fide WL teachers. This changeover, if activated, doubtless would work to the advantage of WLs reputation. So far, all the published accounts of WL instruction involving teacher assessment of students’ reading conclude that it is superior to DISEC teaching. On the other hand, an overwhelming preponderance of relevant experimental research findings conclude the opposite.

The writers’ fourth main argument for the necessity of WL teaching that politically indoctrinates students is that DISEC instruction is expressly designed to “protect the privilege of the upper and upper-middle classes by encoding their values and intentions into school reading practices.” This encoding is said to take place through schools’ adoption of traditional reading instruction textbook series, called basal readers. These series of books are castigated as a dastardly “remote control” device operated by “the upper-middle and upper classes” to “neutralize other peoples’ [the downtrodden masses’] literacies in their efforts to control their lives.”14 Lower-class and minority students, the writers claim, cannot satisfy the rigorous requirements imposed by the readers, for example, “completing daily assignments and periodical tests, ” because they do not reflect these students’ peculiar cultural “intentions and values” and “ways of making sense of [written] text.” 15

According to the writers, the economic upper-classes induce frustration among students by “design.” Through the imposed adoption of basal readers, the socioeconomic despots engage in “manufacturing reading failures among their [lower-class] children and hindering their prospects for the future” for jobs with decent wages. As a result, under-class students “doubt the value of who they are and what they do and could know.”16

-- CharlesH - 06 Feb 2006


When you read Sandra Stotsky's entire article http://instructivist.blogspot.com/2005/10/willful-indifference.html and Patrick Groff, it becomes clear how reading instruction was politicized.

I remember that you commented on this issue in connection with a WSJ commentary. People like Ken Goodman, the WL founder, explicitly linked systematic reading instruction to the "right-wing".

Also see a study that refutes a basic tenet of WL, the psychotic guessing game (miscue analysis) here: http://instructivist.blogspot.com/2005/07/maze-craze.html

-- CharlesH - 06 Feb 2006


Thanks, Charles - haven't read it yet, but I will.

I'm getting the feeling that these folks have 'played out their hand.'

How much patience does the public have left for this stuff?

I'd say none.

Of course, constructivists have institutional power that doesn't dissolve because 'the public' is out of patience.

-- CatherineJohnson - 06 Feb 2006


Stotsky on how reading instruction was politicized:

In her last book, Chall frankly noted that the problem today is the identification of each theory and the pedagogy that best implements it with a political preference. She is right, but she did not explain how this alignment took place in reading. Phonics instruction was not aligned with any political party or label until the late 1960s and early 1970s. Advocates of a subject-centered education like Richard Hofstadter, Albert Shanker, and E.D. Hirsch were political liberals, not conservatives. Phonics instruction was one of the first areas of pedagogy to be politicized, and by the author of Reading: A Psycholinguistic Guessing Game -Kenneth Goodman, with the help of his educator wife, Yetta Goodman. They were the founders of the whole language movement. In an attempt to ascribe the low reading achievement of low-income children to language differences, not language deficits, Goodman claimed that phonics instruction imposed standard forms of speech on dialect-speaking children through the teaching of conventional sound-letter correspondences, leading to a lack of motivation to learn to read and to these children's failure to connect what they decoded with their native language. Because they could not associate the words they identified with the language they spoke, he argued, they could not read with meaning. Phonics instruction, he also implied, was the preferred strategy of Christian fundamentalists, darkly hinting that it was favored by conservative parents because it fit in with attempts at controlled literal understandings of a text. In effect, Goodman made phonics instruction a civil rights issue and smeared it as a tool of both white middle class oppressors and white fanatics.

Goodman's colleagues in education schools across the country took up this argument with eagerness and further support from Paulo Freire's influential Pedagogy for the Oppressed , first published in 1970 and now available in a 30 th anniversary edition. A Brazilian educator and a Marxist, Freire, too, ridiculed phonics instruction as an oppressive strategy for teaching illiterate Brazilian fishermen and farmers how to read, advocating instead a whole language approach. To a large extent, his teaching materials consisted of party slogans and Marxist propaganda, so far as I can determine. Although Freire has been judged one of the most influential educators of the 20 th century, I have been unable to locate independent evaluations of his work in Brazil or elsewhere.

-- CharlesH - 06 Feb 2006


Another point of interest.

The National Council of Teachers of English (considered the premier "professional" organization of teachers of English), runs something called the Whole Language Umbrella. http://www.ncte.org/groups/wlu/leadership/107155.htm That doctrine is an integral part of that organization.

NCTE also runs a network called Teachers Applying Whole Language that holds constant conferences. I read some of the transcripts and something curious caught my eye. The argument was made at one of the conferences that teachers should not teach spelling because they can't spell themselves. They should not expect more from their students than they are able to do. This is fascinating. Teacher ignorance as an argument for student ignorance. The right thing to do, IMHO, would be to encourage teachers to become more knowledgeable.

I also found it curious that one of the Teachers Applying Whole Language groups has a political awareness committee. http://tawl.missouri.org/

Why don't these clowns concentrate on phonemic awareness?

-- CharlesH - 06 Feb 2006


The indispensable Fordham Institute had a big report on why the big Follow-Through study was ignored.

Why Education Experts Resist Effective Practices (And What It Would Take to Make Education More Like Medicine)

by Douglas Carnine

http://www.edexcellence.net/institute/publication/publication.cfm?id=46

-- CharlesH - 06 Feb 2006


This tendency of bureaucracies to ignore and try to bury systematic evaluations is much wider than the educational bureaucracy.

For example, the history of the development of a method for measuring longitudede shows similar behaviour. Or the behaviour of British generals during WWI.

This makes me think that just blaming the people involved and calling them evil does not do much good.

Somehow we need to change institutions so that people have to pay attention to results. Market structures tend to do this (if you continually ignore feedback, eventually a competitor who doesn't tends to come along and steal your customers), but I'm not sure how you add them into education or other bureaucracies, or what subsitute could be devised.

-- TracyW - 06 Feb 2006


Tracy - you do public policy, right??

(Or did?)

You've gotta write some stuff for us — !

-- CatherineJohnson - 06 Feb 2006


Tracy

This makes me think that just blaming the people involved and calling them evil does not do much good

Absolutely.

I don't know when I finally figured this out, but it's absolutely true.

I haven't posted about this, because I can't yet (relates to a book project), but one thing I learned from Temple is:

"The same people who perform badly inside a bad system can turn around and perform well inside a good system."

Temple's work with McDonald?'s is revolutionary.

Her animal welfare audit basically reformed an entire industry in 18 months' time.

And here's the cool thing: the same people who were doing such a bad job before the audit turned around and did great jobs after.

This wasn't always the case. Temple has figures on how many employees at each plant needed to be removed.

But for the vast majority of plant employees, it was true.

Temple says there were plenty of cases where the plant 'troublemaker' became a 'star employee' after the audit was imposed.

-- CatherineJohnson - 06 Feb 2006


I assume you're talking about monitoring 'outputs,' not 'inputs' (correct me if I'm wrong).

That's my mantra: OUTPUTS.

I support NCLB for this reason. It's an outputs approach to the schools. (It does need some modifications; as things stand it appears to reward states for lowering standards & then meeting them.)

You're absolutely right about bureaucracies. Ed was saying, a couple of days ago, that bureaucracies are designed to diffuse responsibility.

Of course, this means that not only can you not blame anyone, but an employee who wants to take personal responsibility for a project or an outcome is going to have a hard time doing it.

-- CatherineJohnson - 06 Feb 2006


Write what about what?

I'm rather limited in what I can write anyway that's directly about my work, since much of what I did is covered by confidentiality issues and it would be unethical to talk about it.

Anyway, I have my doubts about how effective focussing on monitoring outputs rather than inputs will be. Bureaucracies have strong incentives to lobby for evaluation levels to be reduced or made meaningless, e.g. the lobbying currently going on over the NCLB.

And wars tend to have pretty clear results, yet one sees military commanders failing to learn all the time there too.

And failing businesses have been known to lobby the government to try to avoid going bust. Sometimes they've succeeded too.

-- TracyW - 06 Feb 2006


Now I've stopped feeling quite so depressed, there are some upsides.

Democracy seems to help in keeping governments somewhat responsive to criticism. If nothing else, the head-in-the-sands get unelected (e.g. Robert Muldoon).

Also a lack of natural resources. One of the puzzles in development economics for a long time was "why are so many countries poor, despite having rich natural resources?" A rather convincing argument is that they're poor because the government can make money from the natural resources rather than having to create incentives to create wealth and pander to the taxpayers. The cry should be "No representation without taxation" - with apologies to the American revolutionaries. Of course, this raises the question: "Why is Australia so rich, despite having rich natural resources?"

-- TracyW - 06 Feb 2006


Anyway, I have my doubts about how effective focussing on monitoring outputs rather than inputs will be. Bureaucracies have strong incentives to lobby for evaluation levels to be reduced or made meaningless, e.g. the lobbying currently going on over the NCLB.

So you would say monitoring outputs works better in industry?

-- CatherineJohnson - 07 Feb 2006


I'll have to post some of ANIMALS IN TRANSLATION.

Temple's audit is brilliant.

It works.

-- CatherineJohnson - 07 Feb 2006


Any general thoughts you have on policy are interesting to me - I wasn't thinking of anything more specific.

-- CatherineJohnson - 07 Feb 2006