I'm Adam. Nice to meet you.
My Twitter bio:
Metrics Lead at Mozilla Foundation. Previously at WWF. Test, tinker, and question the answers.
What’s happening this week? My number one goal (P1) for this week is solving offline friendly mobile analytics for Webmaker App, while keeping other projects ticking along adequately. Here’s to a productive week.
One of this week’s conversations was with Nesta, about Webmaker usage within the UK and whether or not we have data to support the theory that face-t0-face events have an impact getting people involved in making on the web. These are two topics that interest me greatly. I’m basically copying some of my notes into blog form so that the conversation isn’t confined to a few in-boxes. And the TL;DR is our data represents what we’ve done, rather than any universal truth. Our current data would support the hypothesis that face-to-face time is important for learning, but that would simply be because that’s how our program has been designed to date. In other words, our Webmaker tools were designed primarily for use in face-to-face events, which meant that adoption by ‘self-learners’ online is low because their is little guidance or … Continue reading
I wrote a post over on fundraising.mozilla.org about our latest round of optimization work for our End of Year Fundraising campaign. We’ve been sprinting on this during the Mozilla all-hands workweek in Portland, which has been a lot of fun working face-to-face with the awesome team making this happen. You can follow along with the campaign, and see how were doing at fundraising.mozilla.org And of course, we’d be over the moon if you wanted to make a donation.
I posted to the fundraising.mozilla.org blog today: http://fundraising.mozilla.org/will-our-latest-donation-form-help-us-raise-more-money-this-year
If I find a moment, I’ll write about many of the fun and inspiring things I saw at Mozfest this weekend, but this post is about a single session I had the pleasure of hosting alongside Andrew, Doug and Simon; Learning Analytics for Good in the Age of Big Data. We had an hour, no idea if anyone else would be interested, or what angle people would come to the session from. And given that, I think it worked out pretty well. We had about 20 participants, and broke into four groups to talk about Learning Analytics from roughly 3 starting points (though all the discussions overlapped): Practical solutions to measuring learning as it happens online The ethical complications of tracking (even when you want to optimise for something positive – e.g. Learning) The research opportunities for publishing and connecting … Continue reading
I’m back at the screen after a week of paternity leave, and I’ll be working part-time for next two weeks while we settle in to the new family routine at home. In the meantime, I wanted to mention a Mozilla contributor analysis project in case people would like to get involved. We have a wiki page now, which means it’s a real thing. And here are some words my sleep-deprived brain prepared for you earlier today: — The goal and scope of the work: Explore existing contribution datasets to look for possible insights and metrics that would be useful to monitor on an ongoing basis, before the co-incident workweek in Portland at the beginning of December. We will: Stress-test our current capacity to use existing contribution data Look for actionable insights to support Mozilla-wide community building efforts Run ad-hoc analysis … Continue reading
Removing the second sentence increases conversion rate (hypothesis = simplicity is good). The button text ‘Go!’ increased the conversion rate. Both variations on the headline increased conversion rate, but ‘Welcome to Webmaker’ performed the best. We should remove the bullet points on this landing page. The log-in option is useful on the page, even for a cold audience who we assume do not have accounts already. Repeating the ask ‘Sign-up for Webmaker’ at the end of the copy, even when it duplicates the heading immediately above, is useful. Even at the expense of making the copy longer. The button text ‘Create an account’ works better than ‘Sign up for Webmaker’ even when the headline and CTA in the copy are ‘Sign up for Webmaker’. These two headlines are equivalent. In the absence of other data we should keep the version … Continue reading
Here are a couple of notes about ‘Hack the snippet‘ that I wanted to make sure got documented. It significantly changed peoples’ predisposition to Webmaker before they arrived on the site Its ‘post-interaction’ click-through-rate was equivalent to most one-click snippets Behind these observations, something special was happening in ‘Hack the snippet’. I can’t tell you exactly what it was that had the end-effect, but it’s worth remembering the effect. 1. It ‘warmed people up’ to Webmaker The ‘Hack the snippet’ snippet was shown to the same audience (Firefox users) as eight other snippet variations we ran during the campaign had the same % of users click through to the landing page had the same on-site experience on webmaker.org as all the other snippet variations we tested (the same landing page, sign-up ask etc) But when people who had interacted with … Continue reading
This post is an attempt to capture some of the things we’ve learned from a few busy and exciting weeks working on the Webmaker new user funnel. I will forget some things, there will be other stories to tell, and this will be biased towards my recurring message of “yay metrics”. How did this happen? As Dave pointed out in a recent email to Webmaker Dev list, “That’s a comma, not a decimal.” What happened to increase new user sign-ups by 1,024% compared the previous month? Is there one weird trick to…? No. Sorry, I know you’d like an easy answer… This growth is the result of a month of focused work and many many incremental improvements to the first-run experience for visitors arriving on webmaker.org from the promotion we’ve seen on the Firefox snippet. I’ll try to recount some … Continue reading
TL;DR: Check out this graph! Ever wondered how many Mozfest Volunteers also host events for Webmaker? Or how many code contributors have a Webmaker contributor badge? Now you can find out… The reason the MoFo Contributor dashboard we’re working from at the moment is called our interim dashboard is because it’s combining numbers from multiple data sources, but the number of contributors is not de-duped across systems. So if you’re counted as a contributor because you host an event for Webmaker, you will be double counted if you also file bugs in Bugzilla. And until now, we haven’t known what those overlaps look like. This interim solution wasn’t perfect, but it’s given us something to work with while we’re building out Baloo and the cross-org areweamillionyet.org (and by ‘we’, the vast credit for Baloo is due to our hard working … Continue reading