Usability Test Script Generator

Study: Moderated usability test | Format: Remote | Length: 45 minutes | Looking at: the checkout flow

Participant: a frequent online grocery shopper

Text in [square brackets] is for you to fill in. Text in quotes is read aloud. Change anything you like.

Before you recruit: run the script once with a colleague to catch unclear tasks. If the tasks do not depend on each other, change their order between participants so one task does not always get the freshest attention.

1. In your own words, what do you mainly use the Corner Grocer app, or similar products, for? (Open answer) Moderator note: qualify if the answer relates to [the area you are testing].
2. Which of these best describes you? (Choose one) A. A frequent online grocery shopper B. [A different group you are not recruiting] C. [Another group you are not recruiting] D. None of these Moderator note: qualify on A only. Do not tell people which answer you are looking for.
3. Which of these have you used in the last three months? (Select all that apply) the Corner Grocer app; [a similar product]; [another similar product]; None of these Moderator note: qualify if [the range you need, e.g. includes the Corner Grocer app]. Decide this before you recruit.
4. Do you, or does anyone in your household, work in UX design, market research or advertising, or for the company behind the Corner Grocer app? (Yes / No) Moderator note: screen out Yes.
5. The session is a video call of about 45 minutes, and you would share your screen. Can you do that on a [laptop / phone] with a stable connection on [dates]? (Yes / No) Moderator note: qualify on Yes. Recording consent is asked at the session, not here.

"Hi [participant name], thanks for joining me. I'm [your name]. I'm helping to test the Corner Grocer app. I didn't design it, so you can't hurt my feelings."

Note for you: only say you did not design it if that is true. Otherwise say "I'm here to learn, not to defend it."

"Today I'd like to see how you get on with the Corner Grocer app, in particular the checkout flow. I'm testing the design, not you, so you can't do anything wrong. If something is confusing, that's useful for us to know."

"As you go, please think out loud: say what you're looking at, what you're trying to do and what you expect to happen. I may not answer questions during the tasks, because I want to see what you'd do on your own. Please be as honest as you like."

Note for you: This is a template, not legal advice - check it against your organisation's privacy notice.

"Before we start, I'd like to explain how we'll use what you tell me. [Organisation name] is responsible for your data (the 'data controller'). If you ever have questions about your data, you can email [contact email]."

"I'll take notes. I'd also like to record your screen and your voice, but only if you agree. You can say no to the recording and still take part."

"We're doing this research to improve the Corner Grocer app. We won't use what you tell me for marketing or sales."

"We rely on your consent to collect this information."

"Only [named team or people] will see the notes and any recording. We won't share them outside [that team]."

"It's stored [where, e.g. a restricted folder on our company drive] and deleted within [12] months."

"You can withdraw your consent at any time, during the session or afterwards, and ask us to delete your data. Just email [contact email]. There are no consequences: [you'll still get your incentive]. Our privacy notice is at [privacy notice link], and I can send it to you."

"Three quick questions. One: are you happy to take part on that basis? Two: are you happy for me to record? Three: are you happy for us to use short quotes from this session in our reports, without your name or anything that identifies you? Each is a separate yes or no. Do you have any questions before we begin?"

Start the recording only after you hear a clear yes to the recording question. If the answer is no or unsure, take notes only.

Log the consent: Take part: [yes / no]. Recording: [yes / no]. Anonymous quotes: [yes / no]. Given at [time], by [spoken on the recording / written / chat message].

• "Tell me a little about yourself and what you do day to day."
• "How often do you use apps or websites like this one? Tell me about the last time."
• "Have you used the Corner Grocer app before? What for?"

Give one scenario at a time, on paper or in the chat. Read it out and let the person start. Stay quiet and take notes. Do not point at things or explain the design.

Scenario: "It is Thursday evening and you are out of most things in the fridge. You want to get your usual weekly shop delivered on Saturday morning. Using the Corner Grocer app, show me how you would go about that, and keep talking me through what you are thinking."

Done when: [what success looks like, e.g. the person reaches the confirmation screen]

Watch for: [where you expect people to hesitate or go wrong]

Probe, only if needed:

• "What did you expect to happen when you did that?"
• "What are you thinking now?"
• "Talk me through what you're looking for."

After the task: "Overall, how easy or difficult was that, from 1 (very difficult) to 7 (very easy)? What made you say that?"

Scenario: "You open your order and see one item is marked as out of stock. You want to swap an item that is out of stock for something else. Using the Corner Grocer app, show me how you would go about that, and keep talking me through what you are thinking."

Done when: [what success looks like, e.g. the person reaches the confirmation screen]

Watch for: [where you expect people to hesitate or go wrong]

Probe, only if needed:

• "What did you expect to happen when you did that?"
• "What would you do next? What makes you say that?"
• "What does that label or word mean to you?"

After the task: "Overall, how easy or difficult was that, from 1 (very difficult) to 7 (very easy)? What made you say that?"

Scenario: "You are thinking of moving to a new flat across town. You want to find out how much delivery would cost to your address. Using the Corner Grocer app, show me how you would go about that, and keep talking me through what you are thinking."

Done when: [what success looks like, e.g. the person reaches the confirmation screen]

Watch for: [where you expect people to hesitate or go wrong]

Probe, only if needed:

• "What did you expect to happen when you did that?"
• "What were you hoping to see there?"
• "What are you thinking now?"

After the task: "Overall, how easy or difficult was that, from 1 (very difficult) to 7 (very easy)? What made you say that?"

If someone is stuck for more than a couple of minutes, ask "What would you do if I weren't here?" before you help, and note that you stepped in.

• "What was the easiest thing about using the Corner Grocer app today? And the hardest?"
• "If you could change one thing, what would it be?"
• "How would you describe the Corner Grocer app to a friend?"
• "Is there anything I didn't ask that I should have?"

"Thank you, that's really helpful. I'll stop the recording now. Your [incentive] will [be sent how and when]. If you change your mind about any of what you agreed today, email [contact email]. Do you have any questions for me?"

Stop the recording, then write up your top three observations while they are fresh.