iCurator Pilot Usability Study
for Group 5, CS 160, Fall 2001Kevin Wang: contentLeila Takayama: documentationChuck Moidel: softwareScott Carter: design
Online version available at http://www.madpickle.com/icurator/
Introduction
iCurator is a system created for adult museum visitors with a wide range of experience with art, museums, and technology. iCurator allows museum visitors to automatically retrieve an assortment of information on artworks, send links and information via e-mail, and navigate their way successfully through galleries. By using barcodes placed throughout the museum, the iCurator provides useful information to the visitor based upon the visitor’s location whether it is at the entry of a gallery, at the elevator doors, or in front of a specific artwork.
The purpose of this pilot usability study was to discover layout and interactivity errors and to elicit both positive and negative feedback on the iCurator prototype. Critical incidents, errors and process data were recorded during the study and were later analyzed when evaluating the usability of the product. The results from this pilot study will influence changes we will later make to the iCurator prototype. Note that our pilot study was limited in scope. Given more time and resources we would have been able to run a comprehensive pilot.
Participants
We recruited three participants via
word of mouth. We chose these particular subjects due to their range of
demographics, especially in their experiences with museums. One subject had only visited a museum twice
in the last year while another subject had visited ten different museums within
the last year. None of the users owned
a personal digital assistant (PDA) or other pen input device, so they would
likely be representative of those museum visitors who are not familiar with PDA
interfaces. Two women and one man
participated in the study. Their ages ranged from 20 to 30 years and
occupations included graphic design, organizational psychology, and real
estate.
Apparatus
This usability session was held at the Berkeley Art Museum. Because the iCurator was implemented on the
HP Jornada Pocket PC, participants were asked to carry and use a Jornada
throughout the testing session. An analog tape voice recorder was used to obtain
an audio record of the proceedings of each usability test. The recorder was turned on after the first
task had been presented to the participant and turned off after the user had
made final comments after the end of the third task. Scott Carter carried the voice recorder in close proximity to
each of the participants in order to record their comments, as well as
ours.
Task 1:
Find the
artwork entitled “Number 6” by Jackson Pollock in the Berkeley Art Museum using
the iCurator. After physically locating
it, use iCurator to find additional information about the artwork.
In the first task, the participant was expected to use the search
function of the iCurator to locate “Number 6.”
To complete this task the user had to search, by titles starting with
the letter N, in order to find information about the piece “Number 6” and
determine that it is on the 6th floor of the museum. The user then had to find the map of the
Berkeley Art Museum on iCurator to physically locate the 6th floor
in the museum. After climbing the
stairs to the 6th floor, the user then had to locate to the iCurator
page for “Number 6” in order to compare the screen shot of the artwork with
what they could see on the 6th floor. Once the user located the artwork, they were to read an article
on iCurator about the piece.
Task 2:
Find an
artwork related to “Number 6” in the Berkeley Art Museum. Physically go to that piece.
In this task, the participant had to
see the link related artwork on the iCurator page for “Number 6.” By following this link, the user would be
brought to a page with information about “The Prey” by Hans Hoffman, which is
located on floor A of the museum. Using
the iCurator map function, the user then had to navigate through the museum
down to floor A and find “The Prey” by comparing the screen shot of the artwork
on the iCurator with what they could see after arriving on floor A.
Task 3:
Read more
information about “The Prey” and e-mail a relevant article to yourself using
iCurator.
The first part of this task is
similar to task 1. However, this task
differs from the first in that here the user is asked to e-mail an article
using iCurator. The users had to click on
either the e-mail icon or the e-mail menu button to compose a message containing
the article text. Users then had to
enter their e-mail addresses, using the built-in pop-up keyboard, and then
press a button to send the message.
Procedure
The pilot usability testing was performed in context at the Berkeley Art Museum on 2625 Durant Avenue on Sunday morning, November 11, 2001. Participants were greeted at the museum entrance and guided to a table. They were then given the consent and pre-questionnaire forms. After completing the paperwork, one member of our group read an introduction to the iCurator to them and then explained the user testing procedures. It was explained to participants that although there were no bar codes placed around the museum, that interaction could be faked simply by telling the experimenters that they would like to scan the nearest bar code. Next, the participants were given a demonstration task, wherein a member of our group showed how one could find out more about donating money to the museum using iCurator. After fielding questions about the procedure, iCurator, and other concerns, the first task was given to participants and the voice recorder was turned on.
Three experimenters followed each subject around the museum as they went through the tasks. One held the voice recorder, one gave the subject the tasks and asked questions to keep the subject thinking aloud, and one took notes on a clipboard to record critical incidents and errors. Once a subject finished a task the next task was presented immediately. The time at which each critical incident occurred was noted.
At the end of the third task, subjects were asked to make comments on the iCurator. These comments were recorded. Once a subject was finished making comments, the recorder was turned off and the subject was asked to fill out the post-questionnaire form to gather information that they might not have wanted to tell us verbally or that they might not have otherwise considered. Subjects were allowed to go back to the table to fill out the form if necessary. We answered any other questions that subjects had about the study or about the iCurator. Between subjects, the experimenters discussed problems observed with the iCurator, took notes on those problems, and brainstormed solutions. Anything that did not go smoothly during the user testing session was also discussed in order to improve the session for the next user. For example, we decided to make it more explicit to subjects that they could pretend to use bar codes even though they were not actually placed around the museum. Also, after the first user, we decided to briefly explain the cryptic maze-like layout of the Berkeley Art Museum to users before they started using the iCurator. Also, the tasks were slightly altered between the first and second user in order to maximize coverage of the iCurator features implemented. Prior to the set of tasks written here, the first task was to go to the 6th floor and find “Number 6” by Jackson Pollock. In order to utilize the search function, that task was changed to simply find the artwork with no mention of what floor it was on.
After all of the usability testing was complete we collectively analyzed the data.
Test Measures
During the experiment we recorded time, usability errors, usability successes, and process data. After the experiment we collected user’s opinions on the complexity, efficiency, organization, usefulness, speed, and reliability of the iCurator’s interface. Even though we recorded the time it took complete each task, we never intended to use it as a metric because subjects spent a majority of their session walking around the museum. In task 2, for instance, subjects must walk completely across the Berkeley Art Museum. Also, usability successes did not prove to be a useful metric because each of the users was able to successfully complete all three of the tasks.
As a result, the only dependent variable we present is the number of usability errors per task, also known as (negative) critical incidents. We identified and recorded a usability error any time the user was temporarily unable to make progress toward completing the task. This could have occurred because they were confused by the interface design, confused by the iCurator’s content, confused by the task, or any combination of the above. In most cases the user indicated a usability error, verbally expressing confusion or asking for clarification, but in some cases it was indicated by the user repeatedly looping through the iCurator’s content searching for a clue. We chose to measure the number of usability errors per task because the results would help us identify parts of the interface that needed improvement or better clarification.
Results
During the first task, the three users had two, three, and two usability errors respectively. Both the first user, MH, and the second user, SH, felt lost without explicit directions indicating how to get from the lobby to the sixth floor. MH even attempted unsuccessfully to use the elevator rather than the stairs to get there. SH, once at the sixth floor, wanted a map indicating the location of “Number 6” within the gallery. SH found it difficult to click on small letters in the search index using the stylus, while the third user, RS, instead of just clicking on the first letter of the word in the search index, attempted to spell the entire word. RS also did not understand that the strip along the bottom of the interface was a toolbar with click-able buttons. At the completion of the task, MH commented that the icon, indicating the floor on which the piece was located, was very helpful. Each of the users completed the task in less than six minutes and used the image of the artwork on the handheld device to identify the corresponding artwork in the gallery.
During the second task, the three users had zero, one, and one usability errors respectively. SH and RS were both confused about how they should find a “related” piece of art and asked “related in what way?” when given the task. Both users looked on the articles page and then began exploring content assuming that they would have to research the relationship themselves because they did not see the link referring to related artwork. Each of the users completed the second task in less than five minutes and again used the image of the artwork on the handheld device to identify the corresponding artwork in the gallery.
Lastly, during the third task, each of the three users had two usability errors each. All three of the users had difficulty locating and using the small built-in keyboard to enter their e-mail addresses. Each commented on the difficulty of finding the “@” sign and had trouble removing the keyboard once they were done with it. MH was confused by the automatic word completion suggestions and RS tried to use the help button to get help on using the keyboard. SH was frustrated that after e-mailing the article she wasn’t returned to the page from which she came, the article about “The Prey.”
After the three tasks, each user gave suggestions and rated the iCurator in six different categories. Each rating was on a scale from one to five, one being the lowest/worst and five being the highest/best. On average, the three users gave the iCurator a 3.3 in complexity, a 4 in efficiency, a 4 in organization, a 4.6 in usefulness, a 3 in speed, and a 4 in reliability (because of the small test population one should understand these numbers as only general performance indicators). In the suggestions, MH said that he liked the e-mail feature and thought it was easy to navigate the menus, but felt that the map was not a good representation of the museum. MH, SH, and RS all suggested that there should be more help regarding how to use the onscreen keyboard. SH commented that she liked the pictures in the interface and thought the maps were very helpful, but felt that the tiny interface was difficult to use without fine motor skills. Therefore SH suggested that there be a magnify option to enlarge certain images. Lastly, SH commented that it was easy to get lost navigating the iCurator and felt that a working back button would improve usability. RS commented that she liked being able to e-mail herself information and go through the museum at her own pace, but felt that the interface was too cluttered and was not colorful enough. RS recommended that onscreen buttons be big enough to select by fingertip and information be better organized for easy identification.
Discussion
The “Real” Experiment
Pilot studies are intended to weed out problems from the actual experiment to be run later on. There are a few ways that we would change the procedures of the experiment if it were to be run on a larger scale at a later time. First, in future usability tests we would change the first task to more completely cover the features of the iCurator. Rather than asking users to go to the 6th floor to find “Number 6”, the users would be told just to find “Number 6” somewhere in the museum. This requires that the user tests out the search feature. Second, to make note-taking easier and more efficient, an additional voice recorder would be used for the note-taker to record critical incidents verbally rather than chasing after the user and trying to scribble down notes at the same time. Third, we would make it more clear to the user that all they have to do is ask us to reiterate the task in the event that they forget it sometime during the user testing session.
Proposed Changes to
the Interface
The pilot usability study brought out several issues regarding the navigation feature of the iCurator. Users had difficulty using the iCurator map as well as physically navigating through the museum. One problem was that users were confused about whether following a link to a given floor would give them information about the floor or information about a gallery on that floor. This is likely due to the layout of the Berkeley Art Museum, wherein each floor has only one gallery. The hierarchy of pages should support museums other than only the Berkeley Art Museum, so future iCurator prototypes will continue to have higher level “Floor” pages that link to lower level “Gallery” pages. To aide the physical navigation through a museum, we will provide a link on the map page for “Directions.” Upon clicking on such a link, the user will be lead through a step-by-step recipe-like set of instructions, leading them from their current location to their desired location. The instructions will be short sentences accompanied by images and maps.
Users felt that there was not enough help explaining how to use the iCurator. To solve this problem, we will implement an entirely new introduction page on which users will be presented with only two links: “Show me how to use iCurator” and “I already know how this works.” Novice users can use the former link to initiate a simple animation that briefly details the interaction techniques for the product. This animation could include an audio explanation. The latter link will take the user to the home page, allowing more experienced users to bypass the introductory explanation.
The keyboard was another problem encountered that all users encountered. Users had difficulty opening and closing the keyboard. To solve this problem, we will provide an ephemeral label explaining how to open and close the keyboard on pages where the keyboard is necessary (e.g., the e-mail composition page). Users also had difficulty locating the “@” symbol. To solve this problem, we will change the means of e-mail address input from one field to two, eliminating the need to enter the “@” symbol (i.e., from input_field to [input_field_1]@ [input_field_2]). Also, to reduce the time users spend on visual search, we will automatically focus the cursor to the e-mail address input field.
Several smaller problems arose that could be solved with minimal changes to the interface. The word completion feature confused users more than it aided them. We will fix this either by eliminating the word completion feature entirely or altering its word database to be more relevant for the museum context. Another problem was that users had difficulty clicking links. To solve this problem, the clickable regions could be made larger. Finally, the next prototype should include a means of locating utility rooms (e.g., restrooms and cloakrooms).
Appendices
Contents
This user study is being conducted as part of a computer science course, CS 160. The aim of the user testing is to improve the current design of the iCurator prototype. Data will be collected by interview, observation and questionnaires. Participation in this experiment is voluntary. Participants may withdraw themselves and their data at any time without fear of consequences. Any concerns about the user test may be discussed with the project members (Scott Carter, Chuck Moidel, Kevin Wang, Leila Takayama). Participant confidentiality will be provided by the separate records of names from data. Data will only be identifiable by participant codes. No identifying information about the participants will be available to anyone except the researchers and their supervisors. To make sure we have a correct record of you comments we may be taking a voice recording of the interview.
There are no foreseeable risks to you from participating in this user testing. There will be no costs to you, other than your time involved and any personal transportation costs.
It is expected that one interview will be sufficient. If we need follow-up information we will contact you by phone or email.
I hereby acknowledge that I have been given an opportunity to ask questions
about the nature of the user test and my participation in it. I give my
consent to have data collected on my behavior and opinions in relation to this
user test. I understand I may withdraw my permission and data at any
time.
Name ______________________________________________
Date _______________________________________________
Signature____________________________________________
Identification Code: ________________
Date: ___________
Age under 18 18-20 20-25 30-35 35+
Gender male female
Highest Academic Degree □ high school diploma or GED
□ bachelor degree
□ graduate degree
□ none of the above
□ other ________________________
Academic or Occupational Field: __________________________
How many times have you been to a museum in the last year?
0 1 2 3 4 Other ______
If yes, where? ___________________________________________________________
When you visit museums, how often do you go on curator-guided tours?
□every time □every other time □occasionally □rarely □never
When you visit museums, how often do you go on audio-guided tours (or other media-based tours)?
□every time □every other time □occasionally □rarely □never
Do you own a PDA? Yes No
□daily □weekly □every few weeks □monthly □other _____
[READ THIS TO EACH PARTICIPANT BEFORE PROCEEDING WITH TESTING]
Thank you for volunteering to be a participant in our user testing session for the iCurator.
The iCurator is an interactive, contextually-aware, PDA-based application that supports and enhances your museum-going experience. Some of the features of the system include: interactive maps, search functions, access to more information about galleries and artwork, video clips, audio clips, textual articles, and email functions. The interface is based upon that of a small scale Web site.
The iCurator contains navigational links similar to those of websites. Buttons are circled. To select links or buttons, press on the touch-screen of the PDA. To scroll down the screen you may either use the hardware buttons of the PDA or use a scroll bar on the side of the screen.
[DEMO THIS ON iCURATOR] For example, if I wanted to find out how to make a donation to the museum then I would click on the link labeled “donations” on the homepage. Following the link to the donations page, I would then be able to learn how to make donations to the museum by clicking on the link labeled “how to make a donation.”
You will be given 3 tasks to perform using the iCurator. We are interested in any comments that may come to mind while you are going through the tasks. Please try to think aloud as you perform the tasks. For example, “I’m looking for the link to the homepage.” Both positive and negative comments are useful for our study. We will be taking note of your verbal comments as well as your navigation through the system. Again, all identifying information will be kept confidential.
We will give you each of the 3 tasks one at a time. Proceed with completing the task and let us know when you feel that you have completed it. Because we would not be by your side while you were actually using the iCurator, we will try not to intervene or help too much. If you are stuck, let us know. Otherwise, please use the iCurator as you would if you were actually at the Berkeley Art Museum on your own with the iCurator.
Do you have any questions or concerns?
Identification Code: ________________
Date: ___________
Please list 3 things that you like about the iCurator:
1.
2.
3.
Please list 3 things that you dislike about the iCurator:
1.
2.
3.
Please write any suggestions for solutions to the things you dislike about the iCurator?
For the following sections (a-e), select all of the problems/issues you encountered while completing this task:
(a) Task complexity/applicability:
__didn't understand what to do
__difficulty remembering what to do
__task took too much time
__task seemed irrelevant for site
(b) Navigation:
__got lost
__links didn't work
__couldn't find links
__couldn't go back to previous page
__unexpected behavior
(c) Input:
__iCurator required too much input
__iCurator required too much scrolling
(d) Aesthetics:
__too much text to read
__cluttered screen
__obtrusive graphics
__boring/unengaging content
(e) Other:
Please rate the system on the following
(1=low, 5=high):
Complexity: 1 2 3 4 5
Efficiency: 1 2 3 4 5
Organization: 1 2 3 4 5
Usefulness: 1 2 3 4 5
Speed: 1 2 3 4 5
Reliability: 1 2 3 4 5
Notes for Participant _____________ Date:
______________
Task 1 (critical incidents with time stamp, errors, etc.)
# of critical incidents: _________
Total time taken to complete the task: _____________
Task 2 (critical incidents with time stamp, errors, etc.)
# of critical incidents: _________
Total time taken to complete the task: _____________
Task 3 (critical incidents with time stamp, errors, etc.)
# of critical incidents: _________
Total time taken to complete the task: _____________
Pilot Usability Study Raw Data
Tape counter on Olympus L200 where 1 tick is approximately 3
seconds real time. The time reported
here are extrapolated from the counter; all time in seconds. The tape speed is 1.2cm/s.
Subject 1
0 – The first thing I’ll probably do is to search, so I’m going to artist first. It’s the first thing I see. But there’s no link for the artist (not implemented).
30 – I can go to title.
48 – There is no number (numerical), (Scott: the title of the work is called “Number Six”) so I’ll try N.
54 – The Pollock is on the 6th floor, so I’ll click on that, because my first impulse is to click on it.
66 – Then I would click on 6th floor to try to get on to the 6th floor.
78 – I’m going to map because I’m expecting a map the 6th floor page.
108 – Is there a “you are here?” (Scott: you can just tell us)
168 – (Scott: You following the map alright?) yeah, this should be the 4th floor
219 – (Scott: Is it obvious you can click on the little map?) I was waiting to get to the floor then orientate myself using that.
234 – The picture seems really small I want it bigger.
240 – (reads text)
264 – So this can’t point me while I’m walking around
300 – I’m going to scan the bar code.
321 – (Scott: so now we want you to find the related piece)
333 – More info, that’s no a link (not implemented)
345 – Maybe artistic critiques will mention something.
348 – Or other gallery would offer something more.
360 – what does “related” mean?
390 – I have no idea.
429 – (finds the related work link) related works.
450 – The Prey on floor A.
468 – So we have to walk all the way down.
510 – One of the things that can make this easier is to make a “how to get there” button. Like if you’re on the 6th floor, how to get to the A floor.
543 – Maybe it can tell me if there’s a shorter way to get from the 6th floor to floor A.
561 – I’m confused by the elevation, obviously A is below six, maybe some sort of markers.
600 – Now I forgot what I was looking for, The Prey. (goto 6th floor page, Pollock page, then related works, then The Prey)
633 – (Leila: now you want to email to info to yourself) okay.
642 – Articles about this piece.
660 – The article seems really short (full article not implemented), if I email myself will I get just this little blurb?
705 – Keyboard.
729 – I would like to click on the box (text box) and the keyboard would automatically come up.
738 – There got to be an “@” symbol here, shift. I wouldn’t know how to do that (Scott indicated that the shift key will bring up another version of the keyboard with the “@”)
774 – You guys mentioned that the email will be kept on file so I wouldn’t have to type it again, it would be nice to be told (on the PDA itself). After I email myself, I want to be taken back to where the article is. So I emailed myself and would like to know if the task is completed.
User comments: Why’s the bathroom separated to from the rest of the museum? Something should say that. L is lobby?
0 – Blue are the links? Do I have to find it floor by floor? (Scott: you can do a search) So I can only click the blue ones and the buttons?
27 – Search by title, I can’t type here can I?
39 – No numbers here.
66 – Oh, N, Number Six, 6th floor. Can we go that way?
99 – This probably would be easier for someone who uses a computer in everyday life.
210 – (questions about task specifics)
258 – Most information you find in museums are disconnect, so this is really nice.
285 – I’m trying to find the piece again because I don’t remember what it looked like from before.
300 – So there it is.
309 – (Leila: You want to read the article and email it to yourself)
321 – So I write my address here.
330 – I wouldn’t know this is the keyboard unless you told me so.
General comments: home map was very clear. Help button not sure to people who don’t use
computers that often. Maybe categories
I can use not use floors. The shift
button, and the keyboard took me a while.
Pictures, articles and related works were very clear.
21 – So I clicked on the Six
36 – Enter the gallery, this is what’s inside the gallery, how do I get there?
60 – Home map, is there a tour?
63 – It’s not going to give me directions? I just have to go there?
78 – do I go here? (physically)
234 – That’s the picture, that’s it. (Scott, so now you want to find the Pollock)
288 – (Leila: now you want to find out more information about Number Six)
315 – The Prey by Hans Hoffman on Floor B.
429 – This one is The Prey. Is that it?
450 – Click on the email button. How do I use these things? Is there a keyboard?
495 – Where’s the “@” sign? Is that under shift?
512 – It’s just the case that I’m not familiar with these. (PDAs)
540 – The keyboard won’t go away.
General comments: Am I supposed to use the map to get around? Is there a best route there or something. The map is too (two?) dimensional. I found the floors by the numbers on the wall. Maybe something to tell you to click on the keyboard button for the email. Carrying it around no problem. Pretty easy to navigate. Pictures that showed you where you were.
Notes from User
Testing
Sunday, November 11,
2001
at Berkeley Art Museum
Pre-Questionnaire Results:
|
|
User MH |
User SH |
User RS |
|
Age |
20-25 |
20-25 |
25-30 |
|
Gender |
M |
F |
F |
|
Highest Degree |
Bachelors |
Bachelors |
Masters |
|
Field |
Graphic
designer |
Real
estate |
Organizational
Psych |
|
How many times to museum
in last year |
4 |
~ 10 |
2 |
|
Ever been on a curator
guided tour? |
No |
Yes |
Yes |
|
Where? |
- |
- |
Prado,
Spain, and several others |
|
How often use curator
guided tours? |
Rarely |
Rarely |
Rarely |
|
Ever used audio tours at a
museum? |
Yes |
No |
Yes |
|
Where? |
Dallas
Museum of Art |
- |
Technological
museum (Munich – Germany) and several others |
|
When at museum, how often
use audio-guided tours? |
Occasionally |
Rarely |
Occasionally |
|
Own PDA? |
No |
No |
No |
Post-Questionnaire Results:
|
|
User MH |
User SH |
User RS |
|
3 good things |
E-mail
feature |
Pictures
in the interface |
I can go
at my own pace (in comparison with a curator) |
|
Easy to
navigate through menus |
The map
is very helpful |
I wasn’t
isolated as I would have been with earphones |
|
|
|
|
Being
able to send myself more information home |
|
|
3 bad things |
Map not
good representations of museum |
Tiny
interface – bad motorskills |
It’s not
colorful enough |
|
Hard to
figure out how to bring out / put away keyboard |
Can’t
figure out the keyboard |
The shift
button à it wasn’t clear how to find the @ |
|
|
|
|
Having to
look at more than one list à side instructions at bottom icons |
|
|
Suggestions |
3
dimensions on map (maybe with floor plans for each elevation). Brief instructions on using keypad. |
Perhaps
include a magnify option for certain areas (a la zoomable feature on internet
maps) |
Press
with finger and not with pen [also said that links and buttons should be
bigger off audio record] |
|
Task complexity /
applicability |
- |
Didn’t
understand what to do. Difficulty
remembering what to do. |
Didn’t
understand what to do. Task took too
much time. (I think it got better
after first use) |
|
Navigation |
- |
Got lost.
Links didn’t work. Couldn’t go back
to previous page. |
- |
|
Input |
- |
- |
- |
|
Aesthetics |
- |
- |
Cluttered
screen |
|
Other |
Couldn’t
use map to navigate effectively |
- |
- |
|
Complexity Rating (5 point
scale. 1 low. 5 high) |
4 |
4 |
2 |
|
Efficiency Rating |
3 |
5 |
4 |
|
Organization Rating |
4 |
4 |
4 |
|
Usefulness Rating |
4 |
5 |
5 |
|
Speed Rating |
5 |
1 |
3 |
|
Reliability Rating |
4 |
3 |
5 |
Notes:
User MH
|
Task 1 |
11:22 |
Don’t
know how to walk there ? UG elevator – need key He knew
we were there from text |
|
11:27 |
Found it Floor B –
used map to find it! And icon in
upper right |
|
|
Task 2 |
11:30 |
Got to
“The Prey”, found keyboard!, emailed More
instructions on keyboard, put pathways |
|
Task 3 |
11:32 |
Suggestions
bad! Where is @ sign? |
[Tasks changed slightly between
first user and second user. Instead of
telling user to go to the sixth floor, the user is told to find the artwork
“Number 6” in the museum, utilizing the search functionality of the iCurator.]
User SH
|
Task 1 |
12:50 |
Began.
Hard to click N in search index Wanted a
map on sixth floor page Walking
long way!!! (walking from floor 1 to floor 6) Hard to
click Hard to
find artwork “Number 6” on that floor |
|
12:55 |
Found |
|
|
Task 2 |
12:56 |
Finding
more info “What is
‘related’?” “No idea” |
|
12:57 |
Put on
articles page. Founds its on Floor A,
“The Prey” |
|
|
12:58 |
Walking
to floor A Wants
“How to get there”. Forgot which
piece looking for |
|
|
1:02 |
Got there |
|
|
Task 3 |
1:02 |
Keyboards
needs “help” What is
“L”? Wants to
go back to floor page after email, not home page |
|
1:05 |
Done |
User RS
|
Task 1 |
1:25 |
Didn’t
know could click on toolbar (bottom) Tried to
spell out entire word in search page.
Say “click on first letter” |
|
|
1:29 |
Walked to
sixth floor of museum |
|
Task 2 |
1:30 |
Found
“Number 6” artwork. What do you mean
by “related”? Related how? |
|
|
1:31 |
Walking
down to floor A |
|
|
1:34 |
Found
“The Prey” on floor A |
|
Task 3 |
1:34 |
E-mail. Didn’t know it was a keyboard (explain
toolbar buttons) Found
“@”! Help for
what? Help about museum questions? Got rid
of keyboard! |
|
|
1:36 |
Done. More links and categories. Put “floors”
where “donations” link is |
More content?
upcoming museum events, museum membership, more articles
[email these types of information to self]
Navigation – must fix!
Users do more of a visual search à
more pictorial walkthrough?
Current map has cryptic stairs
Possibly eliminate overview maps?
When at map and you click on “6” for the sixth floor, go to
“direction” or “gallery information”?
Bathrooms
Shortest path from point A to point B (directions)
Keyboard
Explain how to use keyboard (or make
more intuitive)
-
open,
close, menu
Got rid of suggestions
Small keyboard