Lightbox User Testing Protocol

Barbara Glover barbara.glover at utoronto.ca
Wed Oct 17 17:40:21 UTC 2007


Hi Daphne
I'm going to try and schedule a meeting to finalize the plans for the  
user testing.  I'm having trouble keeping up with all the emails :-)   
Lots of good ideas though.

- Barbara
On 17-Oct-07, at 1:07 PM, Daphne Ogle wrote:

>
> On Oct 17, 2007, at 8:17 AM, Barbara Glover wrote:
>
>> Hi Allison
>> Thanks for sending the link to the chart.  That will help out.   
>> Originally I wanted to do a more comprehensive study of users  
>> representing both our faculty persona as well as student  
>> personas.  Daphne and I had a conversation about that this week  
>> and with the shortened time-line we thought to focus this round on  
>> faculty with the addition of a few key-board only users.
> Right now, students are not able to use the reorderer -- no  
> permissions in the Image Gallery tool to reorder images.  This is  
> likely to come but not for a couple versions.  Our focus right now  
> is to make the experience of posting images for students to view as  
> easy and pleasant as possible for instructors.  That said, testing  
> some students on the lightbox will give us some good user data on  
> the reorder generally -- how do the controls and interesting  
> moments work; do they know what they can do when and where they can  
> do it (related to my final comment).
>
> IMO focusing on our primary persona is not critical at this point.   
> The current functionality is pretty generic around reordering  
> images.  When the personas get interesting is in future phases of  
> the Image Gallery (and perhaps some of this will end up in the  
> lightbox component) when we support image heavy course instructors  
> in building their course content.  We of course want to test some  
> users that are used to working with images like Eileen is but I  
> also think we want to test a diverse mix of people to get a sense  
> of where and when the lightbox will support users best.
>>
>> Since our planning meeting yesterday though it appears we may have  
>> more time to complete further testing.  In light of this, I would  
>> like to propose we start the testing with faculty matching our  
>> primary persona for Sakai and then, branch out to include the  
>> students.
>>
>> As far as extrapolating to the Re-orderer in general, that was not  
>> the intent of these studies.  However it is a good suggestion and  
>> one as we do more planning around user testing in general that we  
>> should consider.
> We should get some good user data about the reorderer in relation  
> to images by testing the lightbox.  We could also think about  
> testing the uPortal portlet layout implementation to round out the  
> results a bit.  Perhaps we could outline what we want to know about  
> the reorderer and make sure we include tasks that get at that  
> information.
>
> -Daphne
>>
>> cheers
>> Barbara
>> On 16-Oct-07, at 8:46 PM, Allison Bloodworth wrote:
>>
>>> Hi there,
>>>
>>> It seems that one addition we should make to the testing protocol  
>>> is identifying the attributes of the users we want to test, and  
>>> then keeping track of which user types we've been able to find.  
>>> See http://wiki.fluidproject.org/display/fluid/Users+to+Research  
>>> for an example of an (admittedly complicated--we probably don't  
>>> need nearly this much detail) matrix Daphne, Judy and I came up  
>>> with for the Content Management Research. Are we only planning to  
>>> target folks who are similar to the two Lightbox personas (http:// 
>>> wiki.fluidproject.org/display/fluid/Lightbox+Personas), both of  
>>> which are faculty members? It sounds like we at a minimum need to  
>>> add "keyboard-only user" to the list of target characteristics.  
>>> Are there others?
>>>
>>> A question that may help answer that is to ask whether we trying  
>>> to extrapolate testing for the Re-orderer from testing of the  
>>> Lightbox? If so, I am wondering if we should consider also  
>>> testing students and people who are using Sakai for research or  
>>> project management as well (e.g. http://wiki.fluidproject.org/ 
>>> display/fluid/Sakai+Personas), since they may be using a version  
>>> of the re-orderer in another Sakai tool (e.g. Page Order Helper).  
>>> It wouldn't be testing in context, but at least it would be  
>>> testing user types who may encounter the Re-orderer. There would  
>>> also be the users of other Fluid applications to consider, but  
>>> I'm guessing they may be covered by some of the Lightbox or Sakai  
>>> personas, and am not sure it would make sense to define our  
>>> target testing subjects in an incredibly granular fashion  
>>> (because we are going to be limited as to who we can access).
>>>
>>> Allison
>>>
>>> On Oct 16, 2007, at 2:54 PM, Colin Clark wrote:
>>>
>>>> Hi Barbara and all,
>>>>
>>>> This is a really good testing protocol for the Lightbox. Nice work!
>>>>
>>>> The UX team talked about user testing briefly on our planning  
>>>> call today. For those of you who weren't there, here's a quick  
>>>> summary.
>>>>
>>>> The 0.1 release is unusual in that we haven't had the  
>>>> opportunity to do a lot of user testing on the Lightbox yet. Now  
>>>> that we've got a solid test plan, it will serve as the basis for  
>>>> identifying and fixing usability issues with the Lightbox and  
>>>> Reorderer over the next few releases. User testing will become  
>>>> an ongoing activity for us from here on.
>>>>
>>>> We'll fix as many issues as we can before 0.1, and then continue  
>>>> with user testing and refactoring into 0.2, refining the test  
>>>> plan as we go.
>>>>
>>>> Barbara mentioned during the meeting that she's planning to run  
>>>> this plan with Justin Obara early next week here in Toronto. Is  
>>>> anyone else able to do some testing with users at their  
>>>> institution?
>>>>
>>>> Colin
>>>>
>>>> Barbara Glover wrote:
>>>>> Hi Daphne/Mike/Allison/Shaw-Han
>>>>> We're trying to get some quick user testing done for the  
>>>>> release of  the Lightbox at the end of October.  Several of you  
>>>>> have offered to  help with this testing especially the  
>>>>> accessibility sections at your  universities.
>>>>> I've put together a protocol that we can use with the  
>>>>> instructor  user.  Please review and make changes at the  
>>>>> folllowing wiki page.
>>>>> http://wiki.fluidproject.org/display/fluid/Lightbox+User+Study 
>>>>> +Protocol
>>>>> Let's try and determine if we can get any testing completed in  
>>>>> the  next week before the release is done.
>>>>> cheers
>>>>> Barbara
>>>>> _______________________________________________
>>>>> fluid-work mailing list
>>>>> fluid-work at fluidproject.org
>>>>> http://fluidproject.org/mailman/listinfo/fluid-work
>>>>
>>>> -- 
>>>> Colin Clark
>>>> Technical Lead, Fluid Project
>>>> Adaptive Technology Resource Centre, University of Toronto
>>>> http://fluidproject.org
>>>
>>> Allison Bloodworth
>>> Senior User Interaction Designer
>>> Educational Technology Services
>>> University of California, Berkeley
>>> (415) 377-8243
>>> abloodworth at berkeley.edu
>>>
>>>
>>>
>>>
>>
>
> Daphne Ogle
> Senior Interaction Designer
> University of California, Berkeley
> Educational Technology Services
> daphne at media.berkeley.edu
> cell (510)847-0308
>
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://fluidproject.org/pipermail/fluid-work/attachments/20071017/001fcda1/attachment.html>


More information about the fluid-work mailing list