Showing posts with label Quantitative research. Show all posts
Showing posts with label Quantitative research. Show all posts

Monday, 8 July 2024

Difference Between Qualitative and Quantitative Research in UX

Qualitative and Quantitative Research in UX


As a beginner in the UX research field, it's essential to understand the difference between qualitative and quantitative research methods. Both approaches play crucial roles in product development, but they serve distinct purposes and provide different types of insights.

Qualitative Analysis vs Quantitative Analysis

Quantitative analysis focuses on numerical data, providing concrete, measurable insights. It's concerned with the "what" and "how many" aspects of user behavior. For example, quantitative research might investigate how many users click on a specific button or how long it takes for a page to load.
On the other hand, qualitative analysis explores subjective characteristics and opinions, delving into the "why" and "how" aspects of user behavior. It's concerned with understanding users' thoughts, feelings, and experiences. Qualitative research might investigate why users prefer a particular feature or how they perceive the overall user experience.

UX Tools Survey 2024

Defining Qualitative Research

Qualitative research is the process of collecting, analyzing, and interpreting non-numerical data, such as language, text, video, photographs, or audio recordings. This approach helps researchers understand how individuals subjectively perceive and give meaning to their social reality. In UX research, qualitative methods are used to gain a deeper understanding of users' needs, motivations, and behaviors.
“There are also unknown unknowns, things we don’t know we don’t know.”
— Donald Rumsfeld, Former U.S. Secretary of Defense

Key Characteristics of Qualitative Research:

  • Non-numerical data: Qualitative research focuses on collecting and analyzing non-numerical data, such as text, images, or audio.
  • Subjective insights: Qualitative research provides subjective insights into users' thoughts, feelings, and experiences.
  • In-depth understanding: Qualitative research aims to gain a rich, in-depth understanding of users' perspectives and behaviors.

When to Use Qualitative Research:

  • When you want to understand users' motivations, needs, and behaviors in-depth.
  • When you need to explore complex, nuanced issues that can't be reduced to numbers.
  • When you want to gather rich, contextual data that provides a detailed understanding of users' experiences.

3 Months free Interaction Design Foundation


Defining Quantitative Research

Quantitative research is the process of collecting, analyzing, and interpreting numerical data, such as statistics, metrics, or survey responses. This approach helps researchers understand patterns, trends, and relationships within large datasets. In UX research, quantitative methods are used to identify areas for improvement, measure the effectiveness of design changes, and track user behavior over time.
“Quantification clarifies issues which qualitative analysis leaves fuzzy. It is more readily contestable and likely to be contested. It sharpens scholarly discussion, sparks off rival hypotheses, and contributes to the dynamics of the research process.”
— Angus Maddison, Notable scholar of quantitative macro-economic history

Key Characteristics of Quantitative Research:

  • Numerical data: Quantitative research focuses on collecting and analyzing numerical data, such as statistics, metrics, or survey responses.
  • Objective insights: Quantitative research provides objective insights into user behavior, free from personal biases or interpretations.
  • Large-scale analysis: Quantitative research allows for the analysis of large datasets, enabling researchers to identify patterns and trends that may not be apparent through qualitative research alone.

When to Use Quantitative Research:

  • When you want to measure the effectiveness of design changes or track user behavior over time.
  • When you need to identify areas for improvement or optimize existing features.
  • When you want to analyze large datasets to uncover patterns and trends that inform product decisions.

Conclusion

In conclusion, qualitative and quantitative research methods serve different purposes in UX research. While qualitative analysis provides subjective, in-depth understanding of users' thoughts, feelings, and experiences, quantitative analysis offers objective, measurable insights into user behavior. By understanding the differences between these approaches, you'll be better equipped to choose the right method for your research goals and provide valuable insights that inform product development.



Share:
Continue Reading →

Saturday, 4 June 2022

Card sorting data analysis - Qualitative & quantitative ways


Card sorting data analysis

Card sorting is a method used to help design or evaluate the information architecture of a site. In a card sorting session, participants organize topics into categories that make sense to them and they may also help you label these groups. To conduct a card sort, you can use actual cards, pieces of paper, or one of several online card-sorting software tools. Card sorting helps us gain valuable insight about the structure of data. Know more 


There are some ways which UX researchers or designers can use to analyse the card sorting data and bring clear insights which helps in decision making. 


Card Sorting Data Analysis


Qualitative analysis

While conducting the card sorting activity in-person or remotely using moderated sessions, the notes & observation is considered as qualitative data. Qualitative analysis is helpful in understanding the schema of target participants and their thinking process. This gives high level idea about the trends & themes emerging from the sessions, which should be supported with quantitive data to bring clear insights. Hot picks in this kind of analysis is the new categories created by participants, top confusing cards, terminology issues, similar groups or card categories etc.



3 Months free Interaction Design Foundation


Quantitative analysis


1. Using spreadsheet (frequency & percentage)

Create a spreadsheet, listing the cards in the rows and the categories in the columns. From card sort’s results, determine how participants grouped the cards into the categories, then add the raw counts to the spreadsheet. Later replace the raw counts with percentages. Each percentage is the number of participants who sorted certain cards into a particular group divided by the total number of participants. Once you’ve calculated the percentages, keep only the percentages that are substantial enough to take into serious consideration. 

2. Using online tool

If you are using any online card sorting tools, they provide initial level analysis which are helpful in looking the data from a different perspective. Some of the most common type of analysis are as below:


DISCLOSURE: This post may contain affiliate links, meaning when you click the links and make a purchase, we receive a commission.

UX Design certificate by Google



Similarity Matrix: The similarity matrix is a simple representation of pair combinations, intended to give you a quick insight into the cards your participants paired together in the same group the most often.  Ref


Similarity matrix card sorting

OptimalSort’s Similarity Matrix 


Top UX Courses at Udemy


Dendograms: A dendrogram is a diagram that shows the hierarchical relationship between objects. It is most commonly created as an output from hierarchical clustering.  Ref


Dendograms card sorting

AAM Dendrogram in OptimalSort




Check top Card sorting tools 



References:

Card Sorting - Interaction Design foundation 


Dancing with the Cards: Quick-and-Dirty Analysis of Card-Sorting Data


The Pros and Cons of Card Sorting in UX Research

What is Information Architecture


7 best card sorting tool



3 Months free Interaction Design Foundation


Share:
Continue Reading →

Tuesday, 16 November 2021

How do you go about performing UX research?


Human-centric User Experience


User-experience research methods are excellent for generating data insights, and continuing efforts aid in getting the job done. The UX research serves as a foundation for the UX design process. Various UX strategies can maintain product development efforts on pace, in accordance with genuine user requirements rather than fictitious ones, at any and every level of the design process. We can't picture design without conducting research, and we can't fathom it at all. UX research has always been essential for double-checking pre-made assumptions, validating facts, and proposing modifications.



Why do you exactly need UX research?

  • Increases the product's worth
  • During brainstorming and post-design, it saves a lot of time and money.
  • Helps you to develop design ideas that are quite useful to users and simple to use.
  • Ensures that users are able to execute their activities without committing blunders.
  • Reduces your product's training curves by making it easier and faster to understand and use.
  • It will assist you in estimating the return on investment (ROI)
  • Allows you to discover early adopters.
  • Ensures that your hypotheses are accurate.
  • Helps to understand about your competitor’s products
  • Also, UX research can be conducted at any phase of the process, so that's a bonus!



Let us look at the elements of UX research 


UX Research

 


Qualitative Research

Qualitative research is the procedure of collecting as well as analysing non-numerical data in order to gain a better grasp of user perspectives and motives, as well as to generate a thorough comprehension of an issue. Rather than guessing over causation, qualitative information allows you to make correct, educated decisions for your users. Acquiring this psychological or empathic data could make it much simpler for consumers to invest in product modifications.



Top UX Bootcamps by Interaction Design Foundation - $200 OFF




Quantitative Research

Quantitative research is the procedure of gathering and analysing numeric data in order to uncover patterns or statistics, as well as evaluating data points for providing quantitative outcomes. Qualitative research has identified the most critical design concerns, detects usability flaws, and aids in the discovery of potential solutions during the design process.



“When should I start conducting user research for my new project?” is among the most often asked concerns. There are three possible responses:

  • Conduct user research at whichever stage you're at.
  • Conduct user research at any and every stage of the process.
  • Conduct the majority of user research earlier on in the project (when it would have the greatest impact).



Share:
Continue Reading →

Monday, 3 May 2021

Survey research - Ways to clean survey data before analysis

 

Survey research data cleaning

A survey is a research method used for collecting data from a predefined group of respondents to gain information and insights into various topics of interest. The process involves asking people for information through a questionnaire, which can be either online or offline. According to Interaction Design Foundation “Surveys and Questionnaires – When you ask for many users’ opinions, you will gain massive amounts of information. Keep in mind that you’ll have data about what users say they do, as opposed to insights into what they do. You can get more reliable results if you incentivize your participants well and use the right format.”


Surveys are an important user research method, in which userinformation at bigger counts gets considered. Before stating with data analysis it is important to validate the data quality, else it may deteriorate the inferences and can lead to wrong insights. The data quality can be improved by doing detail data cleaning. 


DISCLOSURE: This post may contain affiliate links, meaning when you click the links and make a purchase, we receive a commission.

UX Design certificate by Google


Survey data cleaning involves identifying and removing responses from individuals who either don’t match your target audience criteria or didn’t answer your questions thoughtfully. There are several ways your survey data can have false data points which needs to be removed before beginning the analysis. Below are some of the ways you can clear false data from gathered survey data and improve the quality of your data. 


How to conduct data cleaning in survey


Remove partially completed responses - 

You might have noticed that sometimes few participants did not answer all the survey questions due to any reason (ex. Technical issue, fatigue, non-interest etc.) This partial filled data can create some noise in pure data analysis. It is advised to remove the partial completed responses from the overall data before starting analysis.   


Remove straightliners - 

Researchers needs to be cautious about straightline respondents and responses must be removed before analysis. Straightlining is when respondents choose similar answer option frequently (such as first/last option etc.). There might be higher possibility that the respondent has not responded the answers honestly. 

3 Months free Interaction Design Foundation


Remove Speed responses - 

Imagine the average time to complete your survey is 4:30 minutes and you have found the quickest response by one of the participant was 20 seconds. There is higher chances that quickest respondent might have completed survey just to complete. This kind of responses are called speed responses. There is no certain rule to identify such speed responses but some statistics calculation can help you such as: take average completion of time, check min and max range of time, set your own rule of remove responses which are x% less than the average. 

Remove outliers - 

Sometimes you have encountered responses falling under unrealistic range for example “In which sport you see yourself as pro” and one respondent selected all the sports from option. This kind of responses are called outliers. Outliers can not be said as fake response but also should be removed before starting analysis because it may impact some calculation ex. Range, min-max values, st. deviation, average etc. 

UX Design certificate by Google

Remove fake or manipulated answers - 

This becomes tricky sometimes but researchers should always be beware of fake or manipulated responses from participants. There are many ways to check fake responses such as, using open ended questions - check is any response contain unreadable or meaningless response like ‘fgfgfh’ type text etc. Another way is to check fake response by having multiple questions to validate response like one question “Do you play outdoor games? (With responses I don’t like playing outdoor game)”, after few questions another question can be added in survey like “which outdoor question do you like the most”. If some participants responding “I don’t like playing outdoor games” and later the same participants responding like they like football. These participants might have a high probability in faking the responses and can be eliminated from master data. 



Read more:

https://www.interaction-design.org/literature/article/useful-survey-questions-for-user-feedback-surveys?ep=uxness

https://www.uxness.in/2016/06/10-survey-tools-for-ux-designers.html 



3 Months free Interaction Design Foundation

 

Share:
Continue Reading →

Tuesday, 9 March 2021

What is triangulation in User Research (UX research)?

What is Triangulation in research


What is Triangulation 

One of the biggest challenge or doubt for any research project is to bring confidence levels in research findings & insights. To increase confidence in to insights researchers often use a technique called ‘Triangulation’, which is nothing but to gather the insights from multiple methods or ways for the same research question(s). According to Wikipedia - triangulation refers to the application and combination of several research methods in the study of the same phenomenon. By combining multiple observers, theories, methods, and empirical materials, researchers hope to overcome the weakness or intrinsic biases and the problems that come from single method, single-observer, and single-theory studies. 


3 Months free Interaction Design Foundation


The term ‘triangulation’ originates in the field of navigation where a location is determined by using the angles from two known points. Triangulation can be used in both qualitative studies & quantitative studies and popularily used in Sociology. The purpose of triangulation in qualitative research is to increase the credibility and validity of the results.

Triangulation is an analysis technique used in multi-method research designs. Many research projects utilize more than one data collection method, leading to the development of different datasets. Datasets might be those collected from a quantitative survey or participant observation, for example. The results from the datasets are analyzed independently, but they also need to be compared to each other in some way. How they are compared depends on the methodological framework used. Triangulation is one technique to combine datasets, and three different kinds of triangulation can be distinguished: convergence, complementarity, and divergence or dissonance.  (International Encyclopedia of Human Geography, 2009)


DISCLOSURE: This post may contain affiliate links, meaning when you click the links and make a purchase, we receive a commission.


UX Design certificate by Google



Types of triangulation 

1. Data triangulation: involves time, space, and persons. 

2. Investigator triangulation: involves multiple researchers in an investigation. 

3. Theory triangulation: involves using more than one theoretical scheme in the interpretation of the phenomenon. 

4. Methodological triangulation: involves using more than one method to gather data, such as interviews, observations, questionnaires, and documents.


Top UX Courses at Udemy


Triangulation in UX research (user research) 

Triangulation involves using several data collection techniques in order to validate findings. For example, instead of performing solely qualitative interviews for data collection, add focus group sessions, collection of documents, and/or collection of personal journal entries from participants. These additions bolster the quality of your findings. (Cheryl Patton, PhD). According to NNgroup’s article on Triangulation in UX research - Triangulation means looking at a question from a different point of view, which lets you see part of the answer that wasn’t previously apparent. You’ve probably done this many times in your everyday life — when you asked someone else’s opinion about a situation, hoping that a different point of view will reveal something that wasn’t obvious to you. In UX research, to triangulate the findings one can combine the research methods and support the findings by doing comparison analysis. Also one can relook at the historic (previous research) and triangulate with present findings using comparison. Having said that for referencing the previous or historic research, consider the insights validity in to account.


References

https://en.wikipedia.org/wiki/Triangulation_(social_science) 

https://ebn.bmj.com/content/16/4/98 

https://www.sciencedirect.com/topics/social-sciences/triangulation 

https://www.nngroup.com/articles/triangulation-better-research-results-using-multiple-ux-methods/ 



3 Months free Interaction Design Foundation



Share:
Continue Reading →