In the realm of user experience, there are many ways to go about understanding how users interact with a product or service. We can observe users in a lab setting or track their interactions through analytics tools. But there’s another method that is often overlooked: The diary study.
Just as the name suggests, a diary study involves participants keeping a diary of their thoughts and experiences while using a product or service. It's almost like a personal journal, but with specific prompts to help researchers understand how users interact with a product.
Diary studies can be a great way to get insights into user behavior that wouldn’t be possible through other methods. They provide insights into real behavior in real time as well as over time. They can also be more engaging for participants and help build a rapport between researchers and participants.
Let's take a closer look at how you can conduct a successful diary study for in-depth insights into user behavior.
Also referred to as a camera study, a diary study is a qualitative research method where participants are asked to document their behaviors and experiences and their thoughts and feelings about those behaviors and experiences over time.
Diary studies are an excellent research method to explore use of a product or service. Unlike focus groups or interviews, a key benefit of diary studies is that they allow researchers to in reality track user behavior and attitudes over a specified period of time versus a participant attempting to think back and recall their behavior and attitudes or be requested to artificially complete tasks.
In the same way that a personal diary gives deep insights into a person's thoughts and feelings, diary studies can provide valuable insights into how users interact with a product or service and how they feel about those interactions.
By asking participants to document their actions and thoughts in a journal-like format, researchers can gain an understanding of how users interact with a product on a daily basis, as well as pinpoint any problems or frustrations they may experience.
There are different methods researchers can use to gather data from diary study participants:
While some might view the diary study as an unstructured way to conduct research, done correctly, a diary study can provide valuable insights into authentic user behavior and attitudes.
Diary studies are highly useful tools, but they won't suit every need. They're best for understanding how people use a product on their own, in their natural environment. If you want to understand how users interact with your product in a lab setting, or if you need precise quantitative data, diary studies may not be the best option.
The main uses for these studies include:
Examples of when a dairy study is an appropriate research method are:
Keep in mind that a diary study is designed to collect qualitative and longitudinal (over time) information and insights. If you're looking for something more specific or if you need to quantify your results, consider a more appropriate research method.
Some factors that could lead you to choose an alternative to a diary study include:
An example of when a diary study is not the best research method is: You are redesigning a registration process for a new website. You're interested only in understanding how the sign-up process works for a limited number of users.
For this example, you might want to use a different UX method as It is only focused on one element of the website, and not the entire user journey – so a diary study would be unnecessary.
Diary studies are perhaps one of the most participant-friendly forms of user research. Unlike other research methods that require in-person sessions or long surveys, diary studies can be conducted through a simple questionnaire or open-ended form that users complete independently.
The benefits of diary studies are clear: they allow researchers to capture authentic user behavior in their natural environment, over an extended time period.
However, there's still the potential to waste time on this method if you don't plan it out effectively. So, where should you begin?
1. Understand Your Research Question and Scope
This is a crucial step to cover, and it will also help you decide which type of UX test is the best method for your needs. Ask the following questions to clarify your research question and your scope:
After answering each question carefully, you'll be able to develop a plan for your diary study.
2. Decide On Your Study Duration
Diary studies can go for days, weeks, months even – whichever length works best for your goal or research question and for your budget.
Of course, the longer the duration of your diary study the more expensive it becomes—higher incentives will need to be paid to participants, more time will need to be spent managing participants, adding questions, prompts and tasks.
3. Choose Your Format
Your next step is to decide the format of your diary study. There are two main types of diary studies:
Both formats have their pros and cons, so you'll need to decide which is best for your research question and scope. For example, if you want to focus on a specific behaviors, a questionnaire-based study is the better option. But if you're interested in getting a broad picture of user behavior and the thoughts and emotions behind those behaviors, an open-ended form is likely the better choice.
Another factor to consider is the collection platform. Do you want to use paper forms or electronic (online) forms? A pen-and-paper approach is more cost-effective, but you won’t always be able to guarantee legibility and it will be difficult and time-consuming to make sure participants are engaged and active in their entries.
On the other hand, while more costly, electronic collection has many benefits:
4. Create Your Questionnaire or Form
Your third step involves crafting the diary itself. This can be done in a few ways:
Creating a Questionnaire-Based Study
If you are writing a question-based diary study, remember that your questions should never be too prescriptive or leading. You want users to answer them honestly, without feeling like they're being led towards a specific response.
Here are some tips for writing effective questions:
Here are some example questions that might be used in a diary study:
The questions are clear and concise. They cover not only what tasks were attempted and completed but also spotlight tasks that were difficult to complete and why as well as what couldn’t be completed.
Creating an Open-Ended Form
With an open-ended form, your goal is to gain as many insights as possible from users. These can be used to answer general questions about user behavior or to get a deeper understanding of specific behaviors or goals.
Here are some tips for creating an effective open-ended form:
For instance, this topic might be included in an open-ended form:
"What are your thoughts on the visual design of the website, consider different pages/parts of the site, likes, dislikes and why?"
While the question is non-leading and allows users to write about their thoughts it also encourages participants to offer enough information to be valuable.
5. Choose Your Logging Style
Before handing the diary study out to users, you’ll need to decide exactly how you want them to post. You’ve got a few options here.
Option A: Interval-Contingent Protocol
An interval-contingent protocol asks users to complete diary entries at fixed time intervals, rather than after specific events. For example, you might ask participants to complete an entry every morning, afternoon, and evening. This type of protocol is generally used for studies that are less time-sensitive, or when the researcher wants general or broad insights.
Option B: Signal-Contingent Protocol
You might opt for a signal approach, which asks users to complete diary entries only after specific events. If you send a text message to a participant’s phone, for example, you could ask them to post in their diary in response to the text. Signal-contingent protocols are generally used when researchers want responses to specific questions or explore specific user reactions or behaviors.
Option 3: Event-Contingent Protocol
The third option is the event-contingent protocol in which users complete diary entries after specific events, such as using a new feature or visiting a particular website. You would consider this option if you want to learn about users’ experiences in a specific context.
Once you’ve decided on the type of protocol, it’s important to create clear instructions for participants. Tell them exactly when and how they should complete diary entries. This will help to ensure that your data is accurate and reliable.
6. Distribute the Questionnaire or Form
You've created your questionnaire or form, so now it's time to distribute it to your users. There are a few ways to do this:
When distributing your questionnaire or form, make sure to include clear instructions on how to complete it. Also, be sure to remind users that they can take their time in completing the form, and that there is no rush – the last thing you want is hurried answers that aren’t accurate.
Let's step back for a minute and think about who you would like to participate in your diary study. The people you select will have a big impact on the success of your study – from the quality of the information you collect to how much work you have to do in the follow-up phase.
Ideally, your participants should be:
Now that you know who you're looking for, how do you go about recruiting them? One way is to post a recruitment message on your company's website or blog, or on social media sites like Twitter and Facebook. You can also use traditional research recruiters.
Another option is to reach out to your existing user base. If you have a mailing list, send out an email inviting people to participate. You can even try contacting people who have recently contacted your support team or left comments on your blog or social media pages.
Recruiting platforms are a newer option. Respondent is a recruiting platform where millions of professionals are pre-vetted and qualified. If your UX research requires specific users from specific professions or at certain professional levels, consider Respondent. And Respondent doesn’t only make the recruit easy, it makes reminders and incentive payments turnkey
Diary Studies: Well Worth the Effort
For a successful diary study, it is important to think about the goals of the study and the types of information you hope to gain. Be sure to create a study protocol that outlines the tasks and questions that will be asked of participants, as well as the format in which the diaries will be collected and analyzed. Stay in contact with your participants to make sure they’re engaged and making entries and at the end of the study you’ll have the authentic and rich insights you need to improve your user experience and that would be almost impossible to obtain through other research methods.
Recommend Resources: