Open Thinkering

Menu

Tag: user research

Identifying and overcoming barriers to user research within organisations

Note: cross-posted at LinkedIn

Person asking 'What should we find out' with various options such as 'their needs and behaviours' and 'what a normal day looks like' surrounding htem

When WAO starts working with organisations, the most important thing we have to figure out is how decisions are made. After we’ve established that, the second is the organisation figures out how best to serve their audience. The latter can be done in several ways, but there’s no substitute for talking to people!

In our experience, there’s quite a few reasons why organisations might avoid user research. Let’s have a look at a few of the most common along with some arguments against (and ways around) them.

1. Inadequate understanding of its value

The world is not slowing down, and product development and service delivery are particularly fast-paced environments. That means it’s not uncommon for managers and stakeholders to overlook the vital role that user research plays in their success. This oversight may stem from a lack of comprehension regarding the tangible benefits that user research brings to the table. As a result, decision-makers might be hesitant to allocate resources towards research initiatives.

However, by shedding light on the value of user research and illustrating its impact on the effectiveness of  products and services, we can help foster a deeper appreciation among stakeholders. Quantitative data is important, but gaining qualitative data from users or your audience is vital. It’s the difference between ‘having a better value proposition’ and the realisation that your core audience doesn’t think that your product or service is actually for them.

2. Overconfidence in existing knowledge

People are promoted within organisations often because of their understanding of the sector in which they work. However, it can be dangerous to think that previous lived experience or a particular view constitutes the ‘truth’ of the situation. This can lead to thinking that user research is superfluous. Such overconfidence is usually based on anecdotal evidence, personal experiences, or preconceived notions that may not accurately reflect the broader user base.

If we acknowledge the limitations of these informal insights, then we can emphasise the importance of user research in painting a more comprehensive and diverse picture of users’ needs. By doing so, organisations can make more informed decisions and avoid the pitfalls of overconfidence, which ultimately results in more successful products and services for their users or audience.

3. Fear of negative feedback

No-one particularly likes to hear that they or their organisation are doing anything other than a good job. So it’s natural for people to be wary of negative feedback. The problem is that this apprehension can sometimes give rise to resistance towards user research, as decision-makers may be reluctant to uncover potential issues or face criticism.

There is a way of reframing this mindset by embracing the notion that constructive feedback is a valuable opportunity for growth and improvement. Looked at this way, organisations can overcome hesitations and appreciate the indispensable role that user research plays in enhancing their offerings. In the end, it’s through facing these challenges head-on that organisations can truly thrive and achieve long-term success.

4. Short-term focus

As mentioned above, we live in a fast-paced world with organisations tending to focus on short-term objectives and instant outcomes. User research, on the other hand, represents a long-term investment in product development, which might not always align with the immediate ambitions of an organisation or its decision-makers.

However, when undertaking user research for the first time, or for the first time in a while, immediately-actionable insights often are forthcoming. Coupled with the long-term value that user research brings to the table, organisations can strike a balance between short-term wins and sustainable success. In doing so, they can foster a more holistic approach to product development that not only meets immediate needs but also paves the way for a future-proof, user-centric experience.

Close-ups of a person with text 'Diversify how you research your user'

5. Limited resources 

User research is a time-consuming process. I’m well aware of this as my wife (Hannah Belshaw) is a user researcher! As such, organisations might find themselves facing constraints around budgets or staff, which can make it challenging to plan and carry out research sessions. More frequently, they may opt to prioritise other initiatives over user research.

Nevertheless, by acknowledging the long-term value that user research brings to product development and service design, organisations can make a conscious effort to allocate resources effectively. User research can be weaved into the fabric of strategic planning to ensure that their products and services continually evolve to meet the needs and expectations of their users. This ultimately drives long term success.

6. Lack of expertise

Organisations often don’t know what they don’t know about user research. Sometimes they don’t have the required in-house expertise for designing, implementing, and analysing user research sessions. This gap in their knowledge can make it difficult to derive actionable insights which means that they’re hesitant to get started in the first place.

Once this challenge has been recognised, organisations can seek to bridge that gap in their expertise, either through training existing staff, hiring new ones, or partnering with external experts. By tapping into the wealth of knowledge that user research provides, organisations they can ensure that their products and services evolve in sync with the ever-changing needs of their users.

7. Resistance to change

The idea of user research is to gain insights to improve products and services. Sometimes, these insights can lead to a call for substantial alterations which, understandably, might be met with resistance. After all, if you’ve invested considerable time and effort into the existing design, then you might not be best pleased if you’re being asked to change course. In addition, there are many people and organisations who are naturally averse to change of any sort.

However, by embracing the notion that adaptability is key to long-term success, organisations can begin to  adopt a growth mindset. By navigating this resistance to change they can make use of user research insights to create better, more user-centric products and services that ultimately stand the test of time.

8. Other factors

There are many other reasons barriers to performing effective user research. For example, gaining buy-in or support from leadership can be an uphill battle, making it difficult to secure the necessary resources or cooperation. Then there are sometimes privacy and legal concerns, particularly when handling sensitive information or user data. And, of course, logistical complexities in terms of co-ordinating with research participants, internal teams, and external organisations can be off-putting.

To overcome these additional obstacles, organisations can focus on ensuring proper legal guidance when dealing with sensitive data — which is something they should be doing anyway! Effective project management should help with difficulties around logistics, and it’s always a good time to start fostering a culture of research appreciation among leadership.

Person folding arms saying "It's not really what we were expecting" with text underneath reading "(this is the whole point of user research!)"

Conclusion

User research is a form of superpower for organisations. Doing it effectively means the difference between designing products and services that work for your users and audience, and creating a barrier between you and them. It’s no silver bullet, but if the best time to start was several years ago, the second best time to start is today!


Images CC BY-ND Visual Thinkery for WAO

First version of report published sharing findings from Zappa project user research

Illustration of a bear, fox, badger, and squirrel looking into a fire. Taken from the Bonfire website.

Over the last month, I’ve been working with the Bonfire team to perform some initial user research on the Zappa project. The aim of the project, funded by a grant from the Culture of Solidarity Fund, is to empower communities with a dedicated tool to deal with the coronavirus “infodemic” and online misinformation in general.

We ended up speaking with 11 individuals and organisations, and have synthesised our initial user research into the first version of a report which is now available.

📄 Click here to access the report

Some interesting findings from user research for the Zappa project (so far!)

Squirrels around a bonfire

One of the things about working openly is, fairly obviously, sharing your work as you go. This can be difficult for many reasons, not least because of the human tendency toward narrative, to completed stories with start, middle, and end.

The value of resisting this tendency and sitting in ambiguity for a while is that allows for slow hunches to form and serendipitous connections to be made. So it is with user research I’m doing as part of the Zappa project for the Bonfire team. We need time to talk to lots of different types of people who meet our criteria, and to spend some time reflecting on what they’ve told us.

As I wrote in my previous post about the project, we’d identified some of the following:

  • a list of people we can/should speak with
  • themes of which we should be aware/cognisant
  • groups of people we should talk with

Inevitably, since this initial work, we’ve come up with some obvious gaps in the people we should speak to (UX designers!). The people we’ve spoken with have recommended other people to contact as well as avenues of enquiry to follow. This is such an interesting topic that we need to be careful that the project doesn’t grow legs and run away with us…

10 interesting things people have told us so far

We haven’t started synthesising any of what our user research participants have said so far, but as we’re around halfway through the process of conducting interviews, I thought it might be worth sharing 10 interesting things they’ve told us. These are not any any particular order.

  • Countering misinformation is time-consuming — to fact-check articles takes time and by the time the result is published the majority of the people who were going to read it have done so anyway.
  • Chat apps — public social networks are blamed for not dealing with mis/disinformation but some of the most problematic stuff is being shared via messaging services such as WhatsApp and Telegram.
  • Difference between human and bot accounts — it’s possible to reason with a human being but impossible to do with a bot account.
  • Metaphor of adblock list — a way of reducing the burden of moderation on administrators and moderators* of a federated social network instance by creating a more systematised version of something like the #Fediblock hashtag.
  • Subscribing to moderator(s) — delegating moderation explicitly to another user, perhaps by automatically blocking/muting whatever they do.
  • Different categories of approaches — for example, reputational solutions that deal with trusted parties, technical solutions that prove something hasn’t been tampered with, and process-based solutions which make transparent the context in which the content was created and transmitted.
  • Visualising connections — visualising the social graph could make it easier to spot outlier accounts which may be less trusted than those that lots of your other contacts are connected to.
  • Fact-checking platforms can be problematic — they promote an assumption that there is a single ‘Truth’ and one version of events. They can be useful in some instances but also be used to present a distorted view of the world.
  • Frictionless design — by ‘decomplexifying’ the design of user interfaces we hide the system behind the tool and the trade-offs that have been made in creating it.
  • Disappearing content — content that no longer exists can be a problem for derivative works / articles / posts that reference and rely on it to make valid claims.

It’s been fascinating to see the different ways that people have approached our conversations, whether from a technical, design, political, scientific, or philosophical perspective (or, indeed, all five!)

Next steps

We’ve still got some people to talk with next week, but we are always looking to ensure a diverse range of user research participants with a decent geographical spread. As such, we could do with some help identifying people located in Asia (yes, the whole continent!) who might be interested in talking about their experiences, as well as people from minority and historically under-represented backgrounds in tech.

In addition, we could also do with talking with people who have suffered from mis/disinformation, any admins or moderators of federated social network instances, and UX designers who have a particular interest in mis/disinformation. You can get in touch via the comments below or at: [email protected]

css.php