Marshall Memo 649
A Weekly Round-up of Important Ideas and Research in K-12 Education
August 22, 2016
1. Five considerations when making ethical decisions
2. The link between principals’ evaluations and student achievement
3. Priming the pump to improve the questions students ask
4. The Goldilocks level of teacher support during inquiry learning
5. Students who are afraid they won’t be perfect
6. Misconceptions about reading difficulty
7. Myths about differentiation
8. Research on effective K-12 mathematics practices
9. When are people most likely to think about leaving their jobs?
10. The downside of having a Plan B
“If there is one theme that has emerged from the fractious state of our political and civic lives in 2016, it is not how divided we are, but rather how deeply and stubbornly obtuse we are about one another’s lives.”
Robert Pondiscio in “J.D. Vance’s Hillbilly Elegy Is Required Reading for Education
Reformers” in Education Gadfly, August 17, 2016 (Vol. 16, #33), http://bit.ly/2bsEGhi
“Judgment is hard to define. It is a fusion of your thinking, feelings, experience, imagination, and character.”
Joseph Badaracco (see item #1)
“I wouldn’t go ahead with something just because my brain told me it was the right thing to do. I also had to feel it. If I didn’t, I had to get my brain and my gut into harmony.”
An experienced executive (quoted in item #1)
“In fact, we know from looking at the comparisons between classes of 25-30 to 15-20, in smaller classes, teachers talk more. There is less feedback. There is less group interaction… If I’m given trillions to reduce class sizes and that’s the only choice, I’ll take it. But if I’m given trillions, I’d rather spend the money on developing teacher expertise…”
John Hattie quoted in “Dr. John Hattie: Assessment Should Measure Teachers’ Impact”
by Roger Riddell, July 21, 2016, Education Drive, http://bit.ly/2acbAp1
“So that’s the question I’d ask: Any time a teacher does a test, what did they learn about their impact? Who did they have their impact with? [H]ow they have to change for groups of kids and individual kids. If that’s the purpose of assessment, it’s very powerful.”
John Hattie (ibid.)
“Judgment is hard to define,” says Joseph Badaracco (an ethics professor at Harvard Business School) in this Harvard Business Review article. “It is a fusion of your thinking, feelings, experience, imagination, and character.” Good judgment is crucial when leaders are called upon to make decisions in situations where information is incomplete, boundaries are unclear, and colleagues disagree. “In gray areas, your job isn’t finding solutions,” says Badaracco; “it’s creating them, relying on your judgment.” At such moments, he advises answering these questions one by one:
• What are the net, net consequences of all your options? This is not just about a cost-benefit analysis, says Badaracco, nor is it going with your gut. Truly difficult problems “require you to think more broadly, deeply, concretely, imaginatively, and objectively about the full impact of your choices… You might sketch out a rough decision tree, listing all potential moves and all probable outcomes, or designate certain people to act as devil’s advocates to find holes in your thinking and prevent you from rushing to conclusions or succumbing to groupthink.”
• What are your core obligations? These are your duties “to safeguard and respect the lives, rights, and dignity of our fellow men and women,” says Badaracco, and you do this “by relying on what philosophers call your ‘moral imagination.’ That involves stepping out of your comfort zone, recognizing your biases and blind spots, and putting yourself in the shoes of all key stakeholders, especially the most vulnerable ones. How would you feel in their place?”
• What will work in the world as it is? Machiavelli may need to be your guide because the world is often “unpredictable, difficult, and shaped by self-interest,” says Badaracco. “Sound plans can turn out badly, and bad plans sometimes work… You must also ready yourself to be agile and even opportunistic – maneuvering around any roadblocks or surprises – and, when the situation calls for it, to play hardball, asserting your authority and reminding others who is the boss.”
• Who are we? Humans are by nature social animals, says Badaracco, so you need to “step back and think about your decision in terms of relationships, values, and norms. What really matters to your team, company, culture? How can you act in a way that reflects and expresses those belief systems? If they conflict, which should take precedence?”
• What can I live with? An experienced leader said to Badaracco, “I wouldn’t go ahead with something just because my brain told me it was the right thing to do. I also had to feel it. If I didn’t, I had to get my brain and my gut into harmony.” Badaracco’s advice: “End your conversations with others, close the door, mute the electronics, and stop to reflect. Imagine yourself explaining your decision to a close friend or a mentor – someone you trust and respect deeply. Would you feel comfortable? How would that person react?” He also advises putting the decision and the rationale in writing. “Writing forces clearer thinking and serves as a form of personal commitment.”
“How to Tackle Your Toughest Decisions” by Joseph Badaracco in Harvard Business Review, September 2016 (Vol. 94, #9, p. 104-107),
https://hbr.org/2016/09/how-to-tackle-your-toughest-decisions
In this working paper from Mathematica Policy Research, Moira McCullough, Stephen Lipscomb, Hanley Chiang, and Brian Gill report on their comparison of the performance evaluations of 305 Pennsylvania principals with their students’ achievement gains. Data on principals’ evaluations came from a no-stakes pilot of the Pennsylvania Framework for Leadership, an instrument with 20 performance indicators in four domains (Strategic/Cultural Leadership, Systems Leadership, Leadership for Learning, and Professional and Community Leadership). Data on student achievement came from a value-added analysis of state test scores in each principal’s school, calculating student gains using an elaborate formula that separated the principal’s contributions from factors beyond the principal’s control – for example, neighborhood conditions and personnel decisions made by previous principals that were difficult to alter in the short run.
The researchers found a “relatively small” but statistically significant positive relationship between principals’ evaluation scores and their students’ achievement gains (0.17 was the correlation coefficient between principals’ overall scores and value-added estimates of their students’ math achievement). The correlation was stronger in rubric areas Systems Leadership and Professional/Community Leadership; stronger with students’ math compared with ELA achievement; and stronger with principals who had been leading their schools for three or more years.
The researchers acknowledge that their study didn’t find a robust link between principals’ evaluations and student achievement, but nonetheless argue that “including a measure of professional practice similar in content and structure to the Framework for Leadership is a viable option for states and districts that seek to employ a multiple measures approach to evaluating principals.”
[Why was the link between principals’ evaluation scores and student achievement so weak, when previous research has shown that principals are the second-most powerful factor in student learning (only teaching is more important)? Some possible explanations:
“Psychologists and educational scientists seem to converge on the notion that student involvement is key to successful learning,” say Dutch researchers Ard Lazonder (University of Twente) and Ruth Harmsen (University of Groningen) in this article in Review of Educational Research. “Despite their appealing nature, controversy remains as to whether and when inquiry-based methods promote student learning.” Lazonder and Harmsen did a meta-analysis of 72 studies to try to bring some clarity to the issue. Their research question: how much teacher guidance – and what type of guidance – is desirable as students of different ages engage in inquiry learning?
Their conclusion: Teacher guidance is essential to students’ success during inquiry learning and is also important to learning outcomes – and this is true for students of all ages. The type of teacher guidance, and how much, depends on the situation. Lazonder and Harmsen list some possibilities, ranging from the least to the most directive:
In this Inside Higher Ed article, Joseph Holtgreive (Northwestern University) observes that many of his high-achieving students did well in high school with relatively little effort, but find things more difficult in college. Some of these students panic when they get a low grade on a midterm and want to drop the course.
The problem, says Holtgreive, is that they’re focusing on their GPA, the way they did in high school. “Yet while these students think they’re keeping their eyes on the ball,” he says, “they are actually just staring at the scoreboard. For students who found high school relatively easy, staring at the measurement of their performance is affirming. Even more affirming is the gap between their outcomes, in the form of grades, and their input, in the form of effort. The wider the gap, the smarter they feel…” But when they do less well on challenging courses in college and have to work harder, they feel dumb.
The solution to this bind, says Holtgreive, is for students to redirect their attention from the scoreboard to the game of learning: “Focusing on learning creates a direct relationship between input and outcome: the more effort they invest, the greater the opportunity to learn… When the goal is to be smart, the formula is reduced to maximizing grades while minimizing effort. When the goal is to learn, the formula becomes about maximizing learning while optimizing effort. The more effective their effort, the more they can learn.” Better grades are a natural byproduct, rather than the end goal.
Too much focus on grades reinforces what Carol Dweck calls a fixed mindset. “If students believe that how they perform at one moment in time exposes the limits of their potential rather than serving merely as a snapshot of where they are in the process of growing their abilities,” says Holtgreive, “feelings of struggle and uncertainty become threatening rather than an opportunity to grow.” The anxiety can lead students to tighten up and self-sabotage.
Holtgreive describes how he counseled a young engineering student who loved her Russian literature class but wanted to drop it because of a bad midterm grade. A look of true excitement crossed her face “when it dawned on her that she got to decide how she would show up for her learning. There is no shame in going all in, and just maybe the rewards will outweigh the risks.”
In this Reading Rockets article, literacy guru Tim Shanahan weighs in on the question of how much students should be stretched beyond “just right” texts. “Research has not been kind to the idea of mechanical ‘instructional level’ criteria like 90-95% accuracy,” he says. “Language learning doesn’t work that way.” He proceeds to puncture some beliefs that haven’t stood up to new evidence:
• Misconception #1: Easier texts are more motivating. Shanahan says he believed this until quite recently, but the research has changed his mind. The idea that students “can miss some specific number of words, but only that number and no more, just hasn’t panned out,” he says… “[I[n other words, our relatively easy book matches may be holding kids back, preventing them from exposure to more challenging features of language and meaning.”
• Misconception #2: All texts need to be at an instructional level. “Text level should vary,” says Shanahan; “kids should move across a range of texts from easy to difficult. In the teaching of most skilled activities (e.g., foreign language, dancing, bicycle racing), the idea is not to protect the learners from harder applications of those skills, but to vary the routines between relatively easy challenges and those that scare and potentially embarrass the learner.”
• Misconception #3: Text level is the only feature of the learning situation that can be varied. “Not only should texts vary in difficulty,” says Shanahan, “but the amount of help, guidance, explanation, and scaffolding ought to vary, too… When kids are in easy texts, the training wheels can be taken off. When they are in harder texts, as a teacher I need to be prepared to offer greater guidance and support. That means easier texts when reading with 30 kids, and harder texts – certainly beyond the normally prescribed levels – when I’m sitting closely with 6-8 kids and can monitor more closely and intervene more easily.”
• Misconception #4: More-challenging texts will disrupt kids’ development of decoding skills. In grades K-1, beginning readers need relatively easy texts that are clearly decodable and have consistent spelling patterns. But by second grade, they’re ready for a greater range of text difficulty. “No one, however, is saying just throw kids into hard text and hope they make it,” says Shanahan. The key factors are variety of high-quality, engaging texts and lots of appropriate support.
“Synthesis of IES-Funded Research on Mathematics: 2002-2013” by Bethany Rittle-Johnson and Nancy Jordan, Institute of Education Sciences, July 2016,
http://ies.ed.gov/ncer/pubs/20162003/pdf/20162003.pdf
This Harvard Business Review “Idea Watch” article reports research on telltale signs that professionals are thinking about moving on. Perennial factors include not liking one’s boss, not seeing opportunities for promotion or growth, or being offered a better job, perhaps for higher pay. But time-of-life issues also play a part. “We’ve learned that what really affects people is their sense of how they’re doing compared with other people in their peer group, or with where they thought they would be at a certain point in life,” says Brian Kropp of CEB Global. “We’ve learned to focus on moments that allow people to make these comparisons.” Some examples:
In this Harvard Business Review article, Alison Beard interviews Jihae Shin (Wisconsin School of Business) about her research showing that when people make a backup plan, they perform less well. Does that mean planning ahead about about what we’ll do if we fail makes us less likely to succeed? Exactly, said Shin: “We think that when achieving a goal requires work, not luck, making a backup plan can hurt performance by reducing the desire for that goal.”
But aren’t we taught not to put all our eggs in one basket? We are, says Shin, and it’s reassuring to think that if we fail, it won’t be the end of the world. “However,” she continues, “the costs of making backup plans haven’t previously been examined, and we believe that acknowledging both costs and benefits can lead to better, more informed decision making.”
So should we always act as if failure is not an option? “The punch line of this research could certainly be this,” says Chin: “If you prepare for failure, you may be more likely to fail. But the practical advice we would give is more nuanced than that. We’re not suggesting that you always avoid making backup plans. But maybe you could hold off on doing so until you’ve put as much effort as possible into your primary goal.”
© Copyright 2016 Marshall Memo LLC
About the Marshall Memo
Mission and focus:
This weekly memo is designed to keep principals, teachers, superintendents, and others very well-informed on current research and effective practices in K-12 education. Kim Marshall, drawing on 45 years’ experience as a teacher, principal, central office administrator, and writer, lightens the load of busy educators by serving as their “designated reader.”
To produce the Marshall Memo, Kim subscribes to 64 carefully-chosen publications (see list to the right), sifts through more than a hundred articles each week, and selects 5-10 that have the greatest potential to improve teaching, leadership, and learning. He then writes a brief summary of each article, pulls out several striking quotes, provides e-links to full articles when available, and e-mails the Memo to subscribers every Monday evening (with occasional breaks; there are 50 issues a year).
Individual subscriptions are $50 for a year. Rates decline steeply for multiple readers within the same organization. See the website for these rates and how to pay by check, credit card, or purchase order.
Website:
If you go to http://www.marshallmemo.com you will find detailed information on:
• How to subscribe or renew
• A detailed rationale for the Marshall Memo
• Publications (with a count of articles from each)
• Article selection criteria
• Topics (with a count of articles from each)
• Headlines for all issues
• Reader opinions
• About Kim Marshall (including links to articles)
• A free sample issue
Subscribers have access to the Members’ Area of the website, which has:
• The current issue (in Word or PDF)
• All back issues (also in Word and PDF)
• A database of all articles to date, searchable
by topic, title, author, source, level, etc.
• A collection of “classic” articles from all 12 years
Core list of publications covered
Those read this week are underlined.
American Educational Research Journal
American Educator
American Journal of Education
AMLE Magazine
ASCA School Counselor
ASCD SmartBrief
Center for Performance Assessment Newsletter
District Administration
Ed. Magazine
Educational Evaluation and Policy Analysis
Educational Horizons
Educational Leadership
Elementary School Journal
Essential Teacher
Go Teach
Harvard Business Review
Harvard Educational Review
Independent School
Journal of Adolescent and Adult Literacy
Journal of Education for Students Placed At Risk (JESPAR)
Journal of Staff Development
Kappa Delta Pi Record
Knowledge Quest
Literacy Today
Middle School Journal
Peabody Journal of Education
Perspectives
Phi Delta Kappan
Principal
Principal Leadership
Principal’s Research Review
Reading Research Quarterly
Responsive Classroom Newsletter
Rethinking Schools
Review of Educational Research
School Administrator
School Library Journal
Teacher
Teaching Children Mathematics
Teaching Exceptional Children/Exceptional Children
The Atlantic
The Chronicle of Higher Education
The District Management Journal
The Journal of the Learning Sciences
The Language Educator
The Learning Principal/Learning System/Tools for Schools
The Reading Teacher
Theory Into Practice
Time Magazine
Wharton Leadership Digest