Open Thinkering

Menu

Tag: community

Thinking through the Web Literacy standard arc.

Update: For the latest information on the Web Literacy standard work, head to http://mzl.la/weblitstd


TL;DR version: Mozilla is working on a new, open learning standard for Web Literacy. We’ve got weekly community calls and a blog to help us come to a consensus on what we need and what such a standard will look like. Our first target is the Mozilla Festival in October where we hope to have organisations that have aligned with the standard, as well as some Mozilla-devised learning activities, assessments, widgets, pathways and badges available.


Working in a distributed way at Mozilla is an interesting experience. We, of course, have strategies and roadmaps and an element of top down decision-making, but by and large there’s a great deal of consensus-making that goes on. Over the next few months we’re going to be learning on that experience to engage the community in coming up with a new, open learning standard for Web Literacy. If you’re unsure why we need such a standard, you might like to check out some of my previous posts on the topic.

If you’re at all familiar with how formal, technical standards are constructed then you’ll be aware that it’s often a multi-year process with much to-ing and fro-ing. While that’s absolutely necessary for a technical of standard, we’re hoping to foreshorten the process significantly in our attempt to define a learning standard for Web Literacy. Essentially, what we need is something that works well enough for those who would like to align with it. We can (and indeed, should) iterate as the Web evolves.

While I’m unwilling to put hard and fast dates on the following, these are the four steps we believe the community needs to work through in the medium-term to get to an alpha version of the standard:

  • Outcomes: What are our desired outcomes (and audiences)?
  • Categories: Are our current 4 categories enough?
  • Assessing & Sharing: How do we scale this standard?
  • Building: Here’s the framework—what should we add or remove?

What I can say is that to have time for testing, for organisations to have time to think about how they will align, and for Mozilla to build the learning activities, assessments, widgets, pathways and badges we’re planning to build, then we need to get a consensus around this pretty quickly. Happily, the work that we’ve done previously seems to be a good base for this discussion. And so it should be – that framework was itself created after interviewing with a number of smart people and some research into the literature.

I’m very much looking forward to what Mozilla can create with the community over the next few months. If you’re interested in this work, may I suggest that you follow the new Web Literacy standard blog and, if possible, join our weekly calls? You’d be very welcome and you need no qualifications (other than an interest in the area) to get involved!

Image CC BY-NC sandcastlematt

First Mozilla Web Literacy standard community call recording now available

Update: For the latest information on the Web Literacy standard work, head to http://mzl.la/weblitstd


Today we had our inaugural Web Literacy standard community call. I’ll not be posting the recordings of these here, but rather on a new blog we’ve created specifically for the purpose:

http://weblitstd.tumblr.com

Do join us next week if you can! You’ll always be able to find the latest details of the Web Literacy standard work on the Mozilla wiki. 🙂

Some (brief) thoughts about online peer assessment.

When I was a classroom teacher, peer assessment was something I loved to do. Once you’ve shown learners the basics it’s as easy as asking them to swap books with the person next to them. Not only do they get to focus in on writing for a particular purpose, but it’s a decentralised system meaning there’s no single point of failure (or authority).

Online, however, things are a little more problematic. When we go web scale, issues (e.g. around identity, privacy and trust) become foregrounded in ways that they often aren’t in offline settings. This is something I need to think carefully about in terms of the Web Literacies framework I’m working on, as I’m envisaging the following structure:

  • Skills level – granular badges awarded for completing various tasks (most badges will be awarded automatically – as is currently the case with Mozilla Thimble)
  • Competencies level – peer assessment based on a portfolio comprising of the work completed towards the skills badges
  • Literacies level – self- and peer-assessment based on work completed at the competencies level

I’ll figure out (hopefully with the help of many others) what the self-assessment looks like once we’ve sorted out the peer-assessment. The reason we need both is explained in this post.

Some of the xMOOCs such as Coursera have ‘peer-grading’ but I don’t particularly like what they’ve done for the reasons pointed out by Audrey Watters. I do, however, very much like the model that P2PU have been iterating (see this article, co-written by one of the founders of P2PU for example). The (very back-of-an-envelope) way that I see this working for the Web Literacies framework is something like:

  1. A learner complete various activities and earns ‘skills’ badges.
  2. These skills badges are represented on some kind of matrix.
  3. Once the learner has enough badges to ‘level-up’ to a competencies-level badge they are required to complete a public portfolio featuring their skills badges along with some context.
  4. This portfolio is submitted to a number (3? 5? 7? more?) of people who already have the competencies-level badge.
  5. If a certain percentage (75%? 90%?) agree that the portfolio fulfils the criteria for the badge, the learner successfully levels-up.

There’s a lot of work to be done thinking through potential extra mechanisms such as rating-the-raters as well as making the whole UX piece seamless, but I think that could be a fairly solid way to get started.

What do you think? Any suggestions? 🙂

css.php