Cognitive Walkthrough

Number of ParticipantsFacilitatorsCategoryDurationLevel of Difficulty
51-2Test Phase30minModerate

Description

It is a usability evaluation procedure for a user interface to test its exploratory learning features i.e whether any first time user can be comfortable understanding and using the interface without any formal training or background. (Shekhar& Marsden,2018)
Cognitive walkthrough is based on a theory that users often learn how to use a product through a process of exploration not through formal training course. (Polson & Lewis,1990)
Cognitive Walkthrough is more of a task specific approach to usability as compared to heuristic evaluation which is a more holistic usability inspection method. It is done at the testing stage of a product’s development Cycle. A user who is not very conversant with the product is given a list of task to carry out and questions are asked from the users’ point of view. CW is basically a task-specific approach to doing usability testing.

Materials

  • Laptop
  • Projector
  • Sticky Notes
  • Pens & Paper

Preparation

The Cognitive walkthrough workshop participants will be selected based on the following criteria:
The user should be someone who hasn’t used the tested application before. This is to ensure that the user has no prior knowledge of the Interface, which will go a long way in highlighting usability issues as the user tries to navigate around the web application.
The user may be someone with an Intermediate level of IT proficiency. It is an important criteria because it helps the designer to test how intuitively users can navigate around the application.

  • Develop a persona for a typical user
  • Define tasks the user should perform within the application (possible to have a task flow, e.g. Login —> open browser and launch the website —> enter user credentials).

Step-by-Step Instructions

  1. Participants are admonished to perform all the tasks in a chronological manner, no step should be skipped.
  2. The follow up questions must be answered based on your experience while interacting with the Interface of the software.
  3. While Interacting with the Interface, it is important to write down some of your observations with the Software this will be talked about in the discussion section.
  4. All ideas are welcomed during this workshop, please feel free to talk to any of the moderators about what you experience while using the software.

For each step in the task, the following questions should be answered with a YES or NO. In the case of a NO response, this answer will be substantiated by a credible failure story which indicates that a usability problem has been identified.

  • Will the User understand how to start the task?
  • Are the controls easy to locate and interact with?
  • Will the User associate the correct action with the effect trying to be achieved?
  • Was there feedback to indicate you completed (or did not complete) the task?

Remarks, Tips, Limitations

To highlight all usability issues on the system during the workshop, it is important for the facilitators to take note of the following:

  • For all tasks that the user answers ‘yes’ , this answer should be substantiated by a credible success story for that question. And in the event of a ‘No’, it should be substantiated with a credible failure story.
  • While the users are executing the task, the facilitators should also record side issues such as (spelling errors, as well as design changes .
  • The purpose of the tasks/questions is to focus on how the users goals interact with the visible state of the interface to induce the user to take action.


Limitations

  • Cognitive walkthrough is not suited for identifying problems experienced by experts
  • This method of evaluation is not too good for assessing the efficiency and satisfaction of an interface.
  • The method is laborious and slow , and coverage is often limited to a relatively small number of tasks.
  • The cognitive walkthrough has a narrower focus then other inspection methods such as heuristic evaluation.
Strengths: Great for anticipating usability problems before the design is developed. Requires few resources. Can identify multiple usability problems.

Weaknesses: Not suited for identifying problems experienced by trained users. Focuses only on specific tasks (limited method). Can not assess efficiency and satisfaction of an interface.

References

Rieman, J., Davies, S., Hair, D. C., Esemplare, M., Polson, P., & Lewis, C. (1991, March). An automated cognitive walkthrough. InProceedings of the SIGCHI conference on human factors in computing systems(pp. 427-428).
Mahatody, T., Sagar, M., & Kolski, C. (2007). Cognitive Walkthrough for HCI evaluation: basic concepts, evolutions and variants, research issues. InProceedings EAM 2007 European Annual Conference on Human-Decision Making and Manual Control, Technical University of Danemark, Lyngby.
Rieman, J., Franzke, M., & Redmiles, D. (1995, May). Usability evaluation with the cognitive walkthrough. InConference companion on Human factors in computing systems(pp. 387-388).
http://blogs.ubc.ca/cpsc544/files/2017/08/3-s2.0-B978012410391700004X-main.pdf
Shekhar, A., & Marsden, N. (2018, May). Cognitive Walkthrough of a learning management system with gendered personas. InProceedings of the 4th Conference on Gender & IT(pp. 191-198).
http://blogs.ubc.ca/cpsc544/files/2017/08/3-s2.0-B978012410391700004X-main.pdf
https://ext.eurocontrol.int/ehp/?q=node/1622#:~:text=Disadvantages%3A,problems%20experienced%20by%20trained%20users
https://medium.com/user-research/cognitive-walkthroughs-b84c4f0a14d4

Contributed by Charles Ajiboye.

Similar Posts

68 Comments

  1. I would like to convey my love for your generosity supporting those people that really need assistance with this particular idea. Your very own commitment to passing the message along has been certainly invaluable and have without exception empowered others much like me to arrive at their endeavors. This important useful information implies a whole lot a person like me and somewhat more to my mates. Warm regards; from all of us.

  2. I like this website very much, Its a real nice office to read and find information. “‘Taint’t worthwhile to wear a day all out before it comes.” by Sarah Orne Jewett.

  3. I precisely wished to appreciate you all over again. I’m not certain what I would have created in the absence of those tactics shown by you regarding such a area. It truly was a terrifying situation in my circumstances, nevertheless looking at a new professional style you resolved the issue forced me to jump for delight. Extremely happy for the service and as well , trust you know what a powerful job you were getting into training many others via your blog post. More than likely you have never met any of us.

  4. I?¦ve been exploring for a little for any high quality articles or weblog posts on this sort of area . Exploring in Yahoo I finally stumbled upon this website. Reading this information So i am satisfied to show that I’ve an incredibly just right uncanny feeling I came upon exactly what I needed. I most definitely will make sure to do not omit this web site and give it a look on a continuing basis.

  5. Needed to compose you that little word to finally thank you once again for all the nice tricks you’ve provided on this site. It was really surprisingly generous of people like you in giving unreservedly all that numerous people could possibly have supplied for an e-book to get some bucks for themselves, most importantly considering that you might well have done it in case you considered necessary. The principles as well acted as the easy way to be sure that someone else have the identical desire just as my very own to realize much more with regard to this matter. I think there are numerous more pleasurable times up front for those who see your site.

  6. whoah this weblog is great i really like reading your articles. Stay up the good work! You already know, many people are hunting round for this info, you could help them greatly.

  7. I’ve been exploring for a bit for any high-quality articles or blog posts in this sort of space . Exploring in Yahoo I ultimately stumbled upon this website. Reading this information So i am glad to exhibit that I’ve an incredibly good uncanny feeling I found out exactly what I needed. I such a lot certainly will make sure to do not forget this website and give it a look on a relentless basis.

  8. I was just searching for this information for a while. After six hours of continuous Googleing, finally I got it in your web site. I wonder what is the lack of Google strategy that don’t rank this type of informative web sites in top of the list. Normally the top websites are full of garbage.

  9. An impressive share, I just given this onto a colleague who was doing a little analysis on this. And he in fact bought me breakfast because I found it for him.. smile. So let me reword that: Thnx for the treat! But yeah Thnkx for spending the time to discuss this, I feel strongly about it and love reading more on this topic. If possible, as you become expertise, would you mind updating your blog with more details? It is highly helpful for me. Big thumb up for this blog post!

  10. Admiring the dedication you put into your blog and detailed information you provide. It’s awesome to come across a blog every once in a while that isn’t the same out of date rehashed material. Excellent read! I’ve saved your site and I’m adding your RSS feeds to my Google account.

  11. Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point. You definitely know what youre talking about, why waste your intelligence on just posting videos to your site when you could be giving us something enlightening to read?

  12. Howdy this is kinda of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding skills so I wanted to get guidance from someone with experience. Any help would be enormously appreciated!

  13. I discovered your blog site on google and examine a couple of of your early posts. Continue to maintain up the very good operate. I just further up your RSS feed to my MSN News Reader. In search of ahead to reading more from you later on!…

  14. Hi, Neat post. There’s an issue with your website in web explorer, may check thisK IE still is the market leader and a good portion of other folks will omit your magnificent writing because of this problem.

  15. Hello, Neat post. There is a problem together with your site in internet explorer, would check this?K IE nonetheless is the market chief and a good part of people will pass over your fantastic writing due to this problem.

  16. Somebody essentially lend a hand to make critically articles I would state. This is the very first time I frequented your web page and up to now? I amazed with the analysis you made to create this particular submit incredible. Fantastic activity!

  17. I have been surfing online more than 3 hours these days, yet I never discovered any interesting article like yours. It is pretty worth sufficient for me. In my opinion, if all website owners and bloggers made just right content as you probably did, the internet will be much more useful than ever before.

  18. Excellent post. I was checking continuously this blog and I’m impressed! Extremely useful information specifically the last part 🙂 I care for such information a lot. I was seeking this particular information for a long time. Thank you and best of luck.

  19. Das NetBet Online Casino ist der beste Ort, um zu spielen, Boni zu verdienen und neue Möglichkeiten für ein nahtloses Spielerlebnis auf der Website oder in der App zu entdecken.

  20. This is the right blog for anyone who wants to find out about this topic. You realize so much its almost hard to argue with you (not that I actually would want…HaHa). You definitely put a new spin on a topic thats been written about for years. Great stuff, just great!

  21. Tauchen Sie ein in die besten Online-Spiele bei Playgama! ???? Spielen, verdienen und echte Belohnungen erhalten — kein Scherz! Beginnen Sie Ihr Abenteuer jetzt auf Desktop, Mobilgerät oder sogar auf dem Tablet, das Sie vergessen haben!????️

Leave a Reply

Your email address will not be published. Required fields are marked *