New Report Identifies Emerging Landscape and Trends

Digital strategy is a growing priority in nonprofits, but, according to new research, this growth is not consistent across organizations in terms of staffing, tools and strategies. Care2, hjc, and NTEN: The Nonprofit Technology Network recently announced the release of a new study, 2015 Digital Outlook Report, which compiles responses from nearly 500 professionals that work in the nonprofit sector about their digital strategy outlook for 2015.

Fifty-six percent of survey respondents (all from nonprofit organizations) reported that they do not have any staff dedicated to digital strategy, but some of it has to do with size—66% of respondents from organizations with 76 or more full-time staff noted that they have a dedicated team for this.

While budget and capacity constraints continue to play a key factor for all nonprofits when planning their digital strategies, the report highlights four elements to improve digital interaction with prospective donors and supporters where budget is not a barrier: right audience, right plan, right content and right tools.

"We know that staff time is valuable, but we've already budgeted for it. Many of the recommendations highlighted in this report require staff time to strategize, make changes, and optimize online processes or experience. They do not, necessarily, require new funds or larger budgets for new tools. It's a matter of being strategic, not buying more technology,” said Amy Sample Ward, CEO of NTEN, according to a news release.

The report also includes three case studies from nonprofits: Alzheimer Society of Ontario, Covenant House International and Ontario SPCA. Across the board, nonprofit leaders are focused on building the right infrastructure and resources to enable multi-channel marketing. They are hyper-focused on the constituent experience and converting that experience into a viable marketing strategy for donor acquisition.

For nonprofit digital strategy, 2015 is all about integration. Whether it's integration of content or integration of staff, nonprofits are trying to take the next step beyond engagement to conversion. Digital is, now more than ever, an inherent component of effective organizations. Looking ahead, the report offers seven steps for nonprofit digital strategy success in 2015.

"It's all about people in any industry. Whether we're talking about Oracle, IBM or a charitable organization, how you deploy your human resources is the key to success,” said Mike Johnston, president and founder of hjc, in the release. “This exciting new piece of research digs a bit deeper to uncover the evidence, and subsequent guidance for, any nonprofit with rationed resources, who wants to be more successful in digital marketing and fundraising.".

Source: PR Newswire; edited by Richard Carufel

In trying to understand what data-driven design is, we can start with what data-driven design is not. Then maybe we can work toward how data might actually help make user experience better.

Myth 1: Data means numbers
A lot of the data about a site or app flows in from analytics, and analytics are basically tallies of who has come to your website, how they got there, how long they stayed, and what they clicked or tapped. Other data may come from how many clicked A and how many clicked B. More tallies. Then there are intercepts and surveys where scored responses are counted. Still more tallies.

Numbers represent the actions of real people with complicated lives. But rolling the behavior of millions of people into a single number is not always useful, or reliable. Even the most organized sets of numbers don't answer a lot of the questions we still have about user experience, like why people take action or why they don't, or how they felt about it, or what expectations they bring to the experience. Interviews, ethnographic studies, and usability tests fill in the gaps left by numeric data. But because qualitative insights are not numeric, they are often not considered data.

In other fields, like the social sciences and medicine, there is no question that qualitative is still data. Small numbers, or thick data, still count whether they remain as narrative or are quantified. This makes sense for data-informed design too.

The true defining characteristic of data that can be used to inform design, are the traces left behind by people, no matter the source.

Myth 2: Data is the objective truth
Quantitative data typically tallies completed actions, and usually those tallies are compiled by software rather than humans. This makes quantitative data seem like hard fact.

Even if data is big, it does not mean it is objective. Bias is inherent in any dataset. Datasets are created by humans, who interpret them and assign meaning, even if a machine runs the numbers.

Signal bias — or the bias of omission, inclusion, and emphasis — is one common bias, especially for big data. For example, social media data shows only one segment of the population — those who are on Twitter or Facebook using a certain hashtag. Likewise, the subset of people who agree to be observed or participate in a study represents only a very small subset of the general population.

Another bias is something like the Heisenberg uncertainty principle, where results are changed just by observing. No matter how neutral the environment and the demeanor of the moderator in a lab usability test, behavior, once observed, is different. Very few studies, even contextual or ethnographic studies, leave it totally up to the user. This is the case with quantitative studies too, like surveys or intercepts, where we frame the experience in a certain way just by asking questions about it.

Designing with data has to go beyond algorithms, automation, A/B testing, and analytics. Designing with data has to go beyond algorithms, automation, A/B testing, and analytics.

Further, when we compare online studies with no human contact, and in-person studies where the user is interacting with a moderator or with another user, we see a substantial positive effect on how people perceive a site or app when there is another human being involved. This extends to what they say, how they rate, and what they do or try. Call it the nice factor.

Big or small, no data is perfect. There are limitations and bias present in every type of data. Good data describes its biases, and always provides context.

Myth 3: Bigger is always better
The hype around Big Data (note the CAPS) suggests it has the power to reveal all the secrets of humanity and accurately predict the future. And OK, sometimes bigger is better when it comes to data. If you are measuring something subjective, like emotional response based on self-reported ratings, more responses give you a greater confidence level in the results.

When we think bigger, we tend to think about tallies: the volume and velocity part of the big data equation. But big data is also about variety, and that means diverse sources. We can’t expect analytics to tell us everything we need to know about user behavior any more than we can expect a usability test to address every possible user behavior We have to get our data working together in a way that isn’t all about back-end integration. It’s more about creating meaningful categories — also known as metrics — to evaluate, understand, and keep track.

Data from multiple sources creates a more nuanced picture and, in the end, an actionable outcome. Broader, not bigger, is better.

Myth 4: Data is for managers, not designers 
Data is often used to pass judgment on a site or app (e.g. “The data says that conversions are down after the latest redesign”). Of course, this strikes experience design practitioners as reductionist, opportunistic, or just plain wrong. Certainly, it's tempting to look for data that proves the wisdom of a decision, whether to solve internal battles, counter a gut-feel approach, or just prove return on investment. Proving a point is only one part of the data story though.

If you are using data to inform design, you have three ways to look at things: proving, improving, and discovering. Using data to improve often means the data-informed equivalent of iteration — tracking across time and across versions or even against competitors. Using data to discover is about looking at data in relation to other data (big or thick) to explore patterns and trends.

Part of the issue here is that data use is siloed — the business leadership is working with one type of data and the UX team another. Each team has a different frame of reference, and may not be aware of, or simply discount, the data of the other.

Data is not just about proving who is right or wrong, it is about making improvements and discovering new possibilities. It’s another way to tell the story of the real people using technology.

Myth 5: Data kills innovation
Data is seen as the antithesis of innovation, in all sorts of ways. Well, actually in three ways:

1. Most data, whether analytics, survey data, or customer service data, is backward-looking. Although we can discover patterns and trends, it is not easy to make predictions based off of those discoveries.
   
   
2. Data is tactical rather than strategic. Think of Google's 41 shades of blue testing. Because data-informed design is associated with A/B testing, it seems like a good way to tweak a design element but it’s not so great for creating an amazing experience.
   
   
3. Data, especially analytics, seems to skim the surface. Seeing what people clicked, how much they scrolled, or where they lingered can work well to form a picture about how to market a product. It does not work so well for informing design, because it lacks information about motivations, expectations, perceptions, or emotions.
   
   

There is some truth to all of these observations, of course. The core problem is not in the data itself, but in how it’s being used.

For any data to inform design it has to be calibrated to embrace complexity. The user experience is not a funnel.

Myth 6: There is a right way to use data to inform design
So far, there isn't one canonical way that works for every team in every organization. There are a few guidelines to start with though.

• Use data from a variety of sources to inform your design: analytics, A/B tests, social media sentiment, customer service logs, sales data, surveys, interviews, usability tests, contextual research, and other studies.
  
  
• Include numbers and context. Whether you call them quantitative and qualitative, studies and non-studies, or big data and thick data, you need the numbers and the context to tell the real story.
  
  
• Make sure data is sensitive to the complexity of the human experience. Use averages sparingly, infer with caution, corroborate liberally.
  
  
• Use data to track changes over time, explore new patterns, and dig deeper on problems, rather than just to prove who's right or wrong.
  
  
• Decide on meaningful categories that let you make sense of the data and tell a story about the experience.
  
  
• Develop a way to share and discuss data in your organization, and start by defining the basics together.
  
  

Designing with data has to go beyond algorithms, automation, A/B testing, and analytics. Rather, the goal is to use all the data to develop a better understanding of everyday experience.

• Why This Apple Guy Believes in Google’s Material Design
• Green Means Stop, Red Means Go? #wtfUX
• Strategic Service Design on the Fly
• QuickPanel: Craft amid Complexity

This article originally published at UX Magazine

TOPICS: BUSINESS, DATA, DEV & DESIGN