Blog Post
Hi Michael,
I do enjoy your feedback. I, too, do not take it personally.
While I follow Kohn and Deming both, I can not say with certainty what Deming's source material was for integrating his ideas into his philosophy of improvement. I suspect, but cannot prove, that Kohn played a role. I did recently read an article related to Deming, that included similar research that I think predates Deming meeting Kohn. Deming's background research on the top is fuzzy.
But Kohn's is not. His works are one of the most thoroughly cited works I've ever read. So far as I've examined the sources, his conclusions seem in line with reason. It may not be hyperbole to say that ALL the research on the topic agrees with his positions/conclusions.
Specifically regarding grades, I want to insert a side note, from Malcolm Gladwell. He wrote a piece in Outliers regarding the fact that 70% of pro hockey players in Canada were born between January and July first.
I'll leave out the middle of the story, which is fascinating.
The conclusion, the selection was based on a January 1 cutoff date for age groups as young as 8 years old. This created an artificial bias that favored 'slightly older, bigger' kids. This resulted in the near impossibility of a Canadian youth hockey play born in November or December ever playing pro hockey. As you say, the system is/was at fault, not the youth players.
Yet, those youth you desired to play pro, but were born in the wrong month, may suffer from not meeting their biggest desire. They, and their parents, and other teammates, may even BLAME them for not doing better.
A child, being blamed, for something entirely out of their control.
This same result, surely exists, for American school children. I doctoral study in waiting must exist for someone to do the math. And, no future date is required. The trends could show quite easily that a bias exists even from simple calculations based on past data. In Outliers I believe Gladwell touched on this saying that at the time of publication only Denmark systematically separated content into levels at the elementary school level.
You did discuss overjustification, and you're obviously correct, that it does not negatively affect everyone. Or does it?
Dr. Deming does not refer to the issue as a problem in and of itself. He points out, rightly, that be they good grades or bad grades, all involved attribute the grades, usually in their entirety, to the student's effort. Deming, often deferring to Peter Scholtes, reminds us that this is utterly foolhardy. Family socioeconomic status is the highest predictor of academic success. Via Gladwell we learn that the Chinese cultural work ethic translates into willingness to stick with hard problems long, resulting in Chinese students with an IQ of 100 working comparably to American white students with an IQ 120. (I do not endorse IQ as measure, but some do). In other words, Chinese-American students benefit from Chinese culture, academically. (Outliers goes much further in various ways).
From Deming's view, which originated with Shewhart, establishes that in industry the individual worker affects the quality of the goods they produce between 3 and 7 percent. We would expect this in any robust system. Yet, when the worker's output result is a defect, historically their supervisor would 'blame' the defect entirely on the worker. Very similar to letter grading.
The issue then, in real life, is that children and willing workers CANNOT discern with any accuracy, whether their defect was indeed attributable to them, or if it is the result of a defective system, over which they have no control.
This misunderstanding happens, of course, for both 'good' and 'bad'. A worker may be fired over this mistake, or given a bonus for randomized successes.
Taleb reminds us that stock brokers that make large profits for five years in a row can't help but believe in themselves, that they know what they are doing, though statistically speaking nothing is happening, and they are succeeding at random.
Deming has a story related to your claim that we cannot know if a behavior is intrinsically motivated.
On arriving at the airport, the airline sent a worker with a wheelchair to assist Dr. Deming. A woman working the ticket counter badly wanted to meet him, so she volunteered.
She met Dr. Deming at the gate, and stayed with him until he entered his taxi, at which point, Dr. Deming, without thinking, handed her two dollars as a tip.
He saw his mistake immediately, in her face. He had overattributed her behavior extrinsically when her desire was purely extrinsic, (using the common meaning here, not the/your correct meaning). In this case, she had already received her reward, then had it dashed away, belittled.
I'm convinced he knew.
In addition, one can discern, occasionally, by asking a question. "Why do you like reading so much?". "Because it's fun!" Whether precisely accurate or not, we have gotten a clue from a very simple analysis.
The benefits of extrinsic motivation are not arguable. The 'goal' of it is what is in question. And if we acknowledge that there is a drastic risk due to overjustification, how do we decide whether to address the risk?
It seems to me that much of gamification is the replacement of an intrinsic reward with an extrinsic one. This replacement, with each iteration, shifts the needle from intrinsic to extrinsic.
In my work I'm blessed to work with students who are doing well academically, extremely high risk of not graduating, (and that which follows). Often, their primary concern in class is simply 'their grades'. What do they need to do to 'pass'. Barely pass. Near zero interest in learning, or approaching problems of any modicum of difficulty, unless it's required to pass.
My narrative for them is that they have moved through 12 years of extrinsic motivation, (possibly born in the latter part of the window), and due to factors completely outside their control, 'believe' they are stupid, dumb, unworthy, bad at math, bad at drawing, and a host of other false myths.
The risk, as it were, of letter grading in school, is the demoralization of children that have no ability to discern fact from fiction. This is, in my view, immoral.
Would it not be immoral to tell kids that since they were born in the last half of the year, that they don't get to go to college? The factual issue here is completely clear, but I'm suggesting that overjustification is also immoral. And the risk, to children, is just too great.
But further, successful children, perhaps born in January, grow up 'believing' they have innate talent. Innate talent in math, music, creative arts. and a few may. The rest were just born.
Deming quotes this story. In Deming's book he states, "I have no reason to believe this story is false".
The quote is from The Face of Battle by John Keegan:
As to the influence and genius of great generals — there is a story that Enrico Fermi once asked Gen. Leslie Groves how many generals might be called “great.” Groves said about three out of every 100. Fermi asked how a general qualified for the adjective, and Groves replied that any general who had won five major battles in a row might safely be called great. This was in the middle of World War II. Well, then, said Fermi, considering that the opposing forces in most theaters of operation are roughly equal, the odds are one of two that a general will win a battle, one of four that he will win two battles in a row, one of eight for three, one of sixteen for four, one of thirty-two for five. “So you are right, general, about three out of every 100. Mathematical probability, not genius.”