Open Thinkering

Menu

Tag: assessment

Obliquity, PISA, and ‘shareholder value’ in education.

At TEDx Warwick last Saturday I was first up, meaning I could sit back, relax and listen properly to the other speakers. Whilst I could write several posts about floating islands, medical implants and sustainability, I want to focus on just one of them.

John Kay, author of Obliquity: why our goals are best achieved indirectly, gave what I considered to be a fascinating talk. His book has been on my Amazon wishlist almost since it came out and I’ve now got several more reasons to read it.

Before I go any further, the stimulus for writing this post comes from the TES article ‘Wales asks schools to teach to the Pisa test‘. As I mentioned in my recent Purpos/ed Ignite presentation, education is under the control of governments, and PISA is pretty much the only tool they have to compare educational outcomes. Unfortunately, it focuses on a very narrow aspect of education and is accused of using discredited statistical techniques.

John Kay’s key point was that we often achieve the ends we desire indirectly. He summed this up perfectly by his example of ICI, the chemical company. I haven’t got the exact quotations he used, but in the 1970s ICI’s mission statement focused firmly on innovation and customers. ‘Shareholder value’ was merely a by-product of the core function of the company. By the 1990s this had reversed, with ‘shareholder value’ being the number one priority.

Of course, ICI no longer exists having lost its innovative edge. Likewise, if we focus on narrow and questionable measures of education to make comparisons with other countries, we miss the point of learning. PISA is the educational equivalent of ‘shareholder value’. Focusing on the by-product rather than the core mission is worrying.

Perhaps it’s time to take education out of the hands of politicians?

If you’re interested in debating the purpose(s) of education, you might want to join the debate at purposed.org.uk. Look especially at our call for more #500words contributions!

If not now, when? Why we need #openbadges and #dmlbadges for lifelong learning RIGHT NOW.

badges

You know what? If I could, god-like, step outside of time and decide just when to make a large-scale change to western education systems, I think I’d choose right now. Why? People are ready for change. The current system isn’t working and we haven’t got the money to prop it up any more.

And you know what else? If I could choose an organisation to come up with an alternative system, I’d entrust a non-governmental international organisation that had demonstrated its non-profit and open credentials to drive things forward. Kind of like Mozilla, then. But you’d also need big-hitters and a backer credible with educators. Step forward HASTAC, the US Department of Education and NASA.

It’s now or never. As a father of two children under five, I passionately want something different in place for my children going forward. I think this is the only chance for changing educational assessment radically before my children become adults.

If you’re involved with education at any level you know how much assessment drives learning. Whether we’re talking about intrinsic or extrinsic motivation relating to badges, we can all agree of the importance of getting something out of learning experiences. Something that shows what you know. That’s why I think badges are perfect for MOOCs, for example.

But it’s no good sitting on the sidelines. I’m off to the Mozilla Festival today to meet more people involved in the #openbadges project and, hopefully, Mark Surman (CEO of Mozilla) to discuss his proposal for a web literate planet. What can YOU do? Well, there’s $2 million of (international) competition money available for a range of things relating to badges:

  • I encourage educators to get involved in the content competition, identifying the types of content may suit badges. Closing date: 14 November 2011
  • I encourage researchers (faculty members and students alike) to get involved in the research competition to establish a sound theoretical basis for badges. Closing date: 28 November 2011
  • I encourage designers and coders to get involved in the design competition to implement the technologies required for a badge infrastructure. Closing date: 12 January 2012

As I’ve explained recently, the world doesn’t change in and of itself: it takes human agency to do so. Are you going to step up and help move things forward?

Image CC BY-NC-SA keoshi

 

What did we learn during a ‘semester of learning’ on #openbadges over at P2PU.org?

Open Badges and Assessment

Seven weeks ago I proposed a ‘semester of learning’ about Mozilla’s Open Badges. This was originally going to be hosted on an installation of BuddyPress, but eventually resided at P2PU.org in a group called Open Badges and Assessment. It attracted a diverse mix of people, most of whom I’d never encountered before (I love it when that happens!) Many of use are continuing the conversation at a new HASTAC group.

In a similar way to a MOOC (Massive Online Open Course) the semester of learning was an informal affair where participants (of which there were 84 altogether) could be as active as they want. Again, as with MOOCs, many were content to listen in upon what others were talking about. Others played a more active role. I’ve archived the study group, but it will remain available indefinitely on P2PU.org for your perusal.

Things tailed off slightly towards the end, for two reasons. The first was that I was in the last couple of weeks of my thesis, so was spending all of my spare time on that. Secondly, the conversation moved from being in a niche area to being much more mainstream (via Twitter, etc.) with the launch of the DML Competition

As a taster of what went on in the semester of learning here’s some comments from the beginning and towards the end.

Week 1

There are key questions around ensuring quality for these badges to take hold. If they are to become something valuable on a CV for example then a prospective employer needs to be able to ascertain the level & rigour involved in the aquisition of the badge. (Dan Stucke)

I’m really impressed by the scope of this Mozilla project. I must admit, I signed up merely because I am interested in looking at ways for developing badges in a high school context, so to see this scale up in such a monumental way is pretty inspiring.

The potential for a new standard in qualifications that learners continue to build upon is very interesting. For example, my own degree and teaching qualifications are relatively old compared to everything I have learned since, and even though there is no formal recognition of my increased learning over the years, save a few references from previous employers, I’d say the undocumented skills I have now make me a far more qualified person than I appear to be on paper. I think the case studies from the open badge system framework draft make this point quite well. (Jackson Bates)

My main worry about the badges appraoch is that it will only be a kind of add-on to the normal educational modle. What I’m mainly interested in doing is entering into direct confrontation with the university as it currently exists. I want to fight with the university, offer an alternative to it, and fundamentally challange the values at work in the university. I’m worried that a badge just isn’t going to cut it, that it won’t be taken seriously enough or that it will only be taken seriously as an add-on to a “real” university education. (Thomas Gokey)

Week 6

Every time a new educational fad erupts it seems to be polarizing, which seems to hold true in the conversations surrounding the dml announcement.  Instead of talking about whether we agree or disagree with the movement a better topic would be, what can these badges do for education, specifically assessment?

I am excited to see what comes of the research grants for the badges.  Will we start giving badges instead of end of course assessments/exams?  Would that be a good thing?  How would it work?

Yes of course it would be messy, but what if students had to obtain specific badges to pass into the next grade or to receive a high school diploma?  Would it motivate students to complete their coursework or would it only further increase dropout rates?  At any rate it is obvious that we would have to get the buy in of students to pull this off effectively…. (AndiStrack)

In the twitter about the grants, people expressed concern that there would be a proliferation of badges of dubious value. Nobody can stop that from happening and it would not be desirable. Our organization plans to categorize and rank badges by difficulty. We think our website that lists the badges will get substantial traffic just as our lists of open textbooks have done. (Jacky Hood)

Conclusion

I found P2PU.org a fantastically easy way to setup a study group and would certainly do so again. I think that the semester of learning helped point people towards certain resources that they may not otherwise have seen and, perhaps more importantly, engage with other people they may not have come across. It was great to see, given some of the superficiality and shallow reading evident from those reacting in various backchannels during the announcement, that those who were part of the group were committed to going away to think and read.

What did we learn? Well, I think I can speak on behalf of us when I say that talking of ‘badges for lifelong learning’ sounds simple but actually contains a lot of nuance and hidden complexity around assessment. I’m very much looking forward to continuing the conversation both on Twitter (using the hashtags #openbadges and #dmlbadges) and within the new HASTAC group.  🙂

css.php