The dilemma of authentic learning: Do you destroy what you measure?

This article was first published on O’Reilly Radar on March 7, 2012

John Seely Brown tells us the half-life of any skill is about five years. This astounding metric is presented as part of the ongoing discussion of how education needs to change radically in order to prepare students for a world which is very different than the one their parents graduated into, and in which change is accelerating.

It’s pretty straightforward to recognize that new job categories, such as data science, will require new skills. The first-order solution is to add data science as a college curriculum and work the prerequisites backward to kindergarten. But if JSB is right about the half-life of skills, even if this process were instantaneous, the learning path begun in kindergarten might be obsolete by middle school. Continue reading

Posted in education | Leave a comment

Math Wars: The Debate Between Higher Order Vs. Rote Learning

This article was originally posted on Getting Smart on February 28, 2012

Recently, EdSurge published a fabulous post highlighting the escalating rhetoric that the Khan Academy has inspired among math educators and edupreneurs. Sal Khan’s success has brought to the forefront a discussion that has been ongoing in academic and education circles for some time. This debate parallels the one about Common Core Math Standards exemplified by the Wurman and Wilson article referenced in a recent Getting Smart post.

At the heart of the debates is the tension between teaching students to accurately perform math computation and procedures versus teaching students higher-order mathematics skills. Versions of this debate have persisted through numerous iterations of math reform. As early as 1965, Tom Lehrer quipped in his song, New Math, “but in the new approach, as you know, the important thing is to understand what you’re doing rather than to get the right answer,” a perspective that summarizes the skepticism of parents and employers and leads many an edupreneur to focus on the “rote skills” of memorizing number facts and solving problems procedurally.

And yet, there seems to be general agreement that we want kids to understand the math as well as be able to perform it. Traditional thought suggests that before students can learn higher-order thinking about math, they need to be fluent in the basics. It turns out, though, that there are counterexamples. Without knowing any math facts even very young students can accurately perform and gain a conceptual understanding of division through equipartitioning, for example. Further, it turns out that with a higher-order framework in place, the process of recalling the associated facts and procedures becomes more efficient thanks to the way the brain chunks them together into meaningful units as it develops expertise. I’m no mathematician or researcher, but as a mom this seems to me to imply that I should strive to offer my children opportunities to gain mathematical understanding before asking them to become efficient problem-solvers and computational whizzes.

But then, that same research points out that the chunking that happens also relies on deliberate practice – about 10 years of it to become an expert in anything. So perhaps I should instead insist that my kids gain fluency in rote computation so that as they tackle higher-order math, whether applying computation in real-world situations or solving algebraic equations, they are not spending excessive cognitive energy on solving the 3d grade part of the problem. Perhaps like katas in martial arts, the deliberate practice to automaticity of rote mathematical facts and procedures provides the tools necessary to grapple with real mathematical problems – a process which I don’t doubt is necessary to gain authentic higher-order skills.

Higher-Order Thinking Versus Rote Learning

Separating out the learning of conceptual understanding from procedural fluency is non-trivial. One challenge, as I see it, is to find ways of instilling higher-order skills without turning them into just another layer of abstraction in rote procedural learning.

Here’s an example of that problem: If a student can quickly fill out an addition worksheet, that doesn’t provide much information regarding whether she understands addition conceptually. To see whether she really understands addition, we may want to ask her a real-world question so we construct a word problem along the lines of “Jane has 11 apples and Molly has 6. How many do they have altogether?” Our student may struggle with this word problem so in order for her to pass the new test, we teach her how to read the word ‘altogether’ as a clue to recognize that this is an addition problem. We wanted to know if a student could add, so we gave her addition problems. It turns out she could learn those by rote so we asked a higher-order question in the form of a word problem. But the “teach to the test” arms race then created rote learning for solving that type of problem, too.

How do you develop assessments of student understanding that can be tested en masse but is not subject to proceduralization? And if the goal is to avoid proceduralization, how do you develop digital tools to support higher-level conceptual learning? Is the computer truly not a natural medium for mathematical learning? And if so, does that also rule out the computer as a mechanism for connecting communities of learning that might better provide that personal, human support? Or do these questions simply demonstrate a failure of the imagination?

So what do students need from us in order to develop both mathematical fluency and higher-order mathematical thinking? Speaking again as a mom of two very different children, and not as an education scientist or researcher, I suspect we need authentic problems to work on and opportunities to practice skills until they become deeply ingrained, something that looks more like on-the-job training than leture-and-test. If this is, indeed, true, the Khan Academy debate will need to be reframed.

Khan Academy Raises the Floor

Which brings me to what I love about Khan Academy – it raises the floor. Although it doesn’t teach higher-order math skills, neither do many math teachers. In the public school system you get the teacher you get, generally without appeal, and most likely you will receive traditional lecture and test pedagogy at a set pace. If you are lucky, you will get more enlightened math education, yet the odds are good that you will still end up performing rote procedures…just at a higher level of abstraction. If you are extremely lucky and learn math from a mathematician, you are still one of 30 kids being guided through the beauty that is math in lockstep. But in the classrooms that are using the Khan academy, students:

Have more autonomy – not only can students move at their own pace, the entire learning map is spread out in front of them and they can move around it according to their own choices
Have the experience of achieving mastery – mastering Khan (that is, the specific subset of things it offers) is very straightforward with charts, badges, and reports that give the student a clear sense of progress and of distance remaining
Have fun – Sal Khan is a pretty entertaining guy, not a bad choice if you are destined to learn by lecture anyway
And in some cases, gain a sense of purpose – in many classrooms, educators are experimenting with using class time to explore authentic questions and problems and letting students watch Khan’s videos at home to find the tools they need to address those questions.
I was prepared, based on my biases and theories and parenting experience to disdain Khan before it was cool to disdain Khan. But here’s the thing: I tried it and found it fun, inviting, and engaging. The badging design is smart and understated so my kids want to collect the badges. The problem solving is somewhat adaptive so no one has to spend hours on rote work they’ve already mastered. When combined with the support of a good teacher, it reduces much of the friction associated with learning traditional materials in traditional ways. Most importantly, it can be extremely efficient in covering the “basics” leaving far more time and space for the higher-order problem solving, open exploration, collaborative work, and project-based learning that so often gets squeezed out of classrooms.

As much as I would LOVE to use a tool, technique, or approach that would help my kids achieve computational and procedural fluency as a side effect of authentic problem solving, to date I have found those only in theory and aspirations. I therefore welcome the tools, limited though they may be, that make that process even the tiniest bit easier. Khan Academy does this, raising the floor in a way that is intrinsically scalable and affordable.

Now it’s up to the education and entrepreneurial communities together to raise the ceiling. Higher-order problem solving and procedural automaticity are inextricably intertwined. Khan’s contribution to a subset of that space is far less a barrier to the development of truly innovative on-line mathematical learning tools than the prevailing mindset of least-common-denominator rote testing, and the collective memory of the adult community of what school is supposed to be like. It’s not that Khan Academy is close to all I would hope for – it’s just better than the alternatives for many, many people. More importantly, it still looks like math to the traditional community of parents, teachers, entrepreneurs and employers while starting to show just some of what is possible when digital tools help make education more personalized.

At the end of their blog post, EdSurge calls for both approaches to be reconciled – I second that and call for a vote. What do you think?

Posted in education | Leave a comment

wanted: a 21st century education

This article was originally posted on Getting Smart on February 16, 2012

Well into the 21st century, we are still trying to get a handle on what a 21st century education really is – both the question of what young adults really need to know and be able to do and the question of the best way to help them get there. I first encountered this issue as a high-tech executive when coaching talented engineers through a series of workplace myths.

Young engineers tend to come out of school with a mindset that the only truly valuable contributions are individual contributions. In a workplace where nearly all projects require collaboration among colleagues, they are prone to sitting at their desks working on a problem for weeks when a few quick conversations could have the problem solved in hours. Even when coached to seek help, they still feel as though they are somehow “cheating.” Continue reading

Posted in education | Leave a comment

three game characteristics that can be applied to education

This article was originally posted on O’Reilly Radar on November 7, 2011

In a related post, I talked about what the notion of gamification as applied to education might mean on three levels. In particular, I described the lessons that might be learned by the field of education from the different types of gaming encountered in World of Warcraft and Minecraft — two very different online multiplayer games. In this post, I look at the technology roadmap that can support these three levels of application in real schools. Continue reading

Posted in education | Leave a comment

world of warcraft and minecraft: models for our educational system?

This article was originally posted on O’Reilly Radar on November 4, 2011

 

What is wrong with schools that there is so much discussion about how to fix them through gamification? One perspective is that students are unmotivated by school but obsessed with gaming — perhaps a game-like structure for school would make students as passionate about solving quadratic equations as killing monsters. Another perspective is that students are not being prepared for a 21st-century workforce — perhaps the collaborative requirements of online guilds and group challenges would help them gain the skills needed to work in a global environment. A third perspective is that school has lost any authentic connection with real life — perhaps introducing playfulness will create more relevance and authenticity.

Continue reading

Posted in Uncategorized | Leave a comment

acquiescence vs. participation

In previous posts, I’ve written about compliant employees and obedient children. This post continues the theme by discussing acquiescent students. Compliant employees, obedient children, and acquiescent students are all often considered “good”: good employees do as they’re told, good kids don’t talk back, and good students sit quietly in lectures and do well on tests.

Continue reading

Posted in education | Tagged | Leave a comment

obedience vs. cooperation

In my last post, I wrote about the pitfalls of compliant employees – they don’t have the chance to develop the good judgment needed to be effective in the unpredictable and rapidly changing business environments that we currently live in.  The same dynamic shows up with our children as with our employees.

Continue reading

Posted in parenting | Tagged | 1 Comment

compliance vs. collaboration

At one time or another, every leader reflects ruefully just how much easier everything would be if their employees just did what they said. No questions, no dissent, no misunderstandings.

For some leaders, that’s a holy grail – for them professional excellence looks like an organization that runs like a machine: predictable, consistent, with quality, productivity, and efficiency continually increasing. This is the assembly line model – when we know exactly what we want to build, we can focus everything into optimizing every machine, every worker, every process on increasing the efficiency of building one exact, specific widget.

Continue reading

Posted in industry | Tagged , | 1 Comment

education as a platform

This article was originally posted on O’Reilly Radar on September 28, 2010

Any and every education reform design is going to fail for two reasons. The first is that the problem is not one that is solvable by “design” in the traditional engineering sense — the education system, including all its human elements, is too complex for that. The second is that the system as currently built contains feedback loops that damp out change.

Continue reading

Posted in education | Tagged | Leave a comment

apprentice yourself

I’ve had a number of conversations recently with technical women who are just starting their careers.  These dynamic, smart, and interesting young women are coming into the workplace eager for new challenges and want to know how they can gain the opportunities that will let them show their worth and develop their talent within a corporate environment.  As I talk with them, I always find myself saying the same thing in one form or another: “apprentice yourself.”

 

Continue reading

Posted in industry | Tagged , | Leave a comment