Feature Prioritization Research

Question 1: Verify if a dashboard was needed

RESEARCH METHOD: INTERVIEW

  • How often do you monitor your queues?
  • How frequently should information on the UI be updated?
  • What’s the biggest value of the GUI to you, compared to command line?
  • How often do tasks fail?
  • What do you do when tasks fail?
  • Do you launch qdo add, and qdo launch on separate occasions, or together?
  • How many queues and how many tasks do you usually have?

Question 2 (if Question 1 validates dashboard)

RESEARCH METHOD: CARD SORTING

PROTOCOL

  1. Here are the potential items to display: (Maybe good as a graphic card sorting activity, if a certain job status does not trigger action, then it should not be on the dashboard.) How often would you access the above information (w/o clicks, w/ one click, w/ two clicks, w/ three clicks)? Remember the less clicks, the more clustered the screen will be.
  2. Once items have been sorted, ask (especially for the w/o click items):
    • Describe a situation when this information would lead you to do something OR Give me an example of the actual data that would appear and the action that you would take in response. 
  3. Once items have been pruned from (2), ask about the number related items:
    • What are the useful comparisons (targets, standards, past data etc.) that will allow you to see these items of information in meaningful context?
  4. How would you group these items that could be used to organize the items of information on the dashboard?

 

ITEMS TO SORT

a.    task status in a queue

1)    Task list (list of individual tasks)
2)    Task status (list of the statuses of individual tasks without task detail)
3)    Failed task (list of failed tasks)
4)    Completed task (list of completed task)
5)    Waiting/pending/running/rerunning (currently not feasible in backend, ask Stephen if this would be useful) tasks ( list of tasks of each of the three statuses)

b.    Queue status

1)    Queue status (the number of tasks in the queue that are waiting, pending, running, succeed, fail) 
2)    Queue failures (a simple warning that there is at least one task that failed in the queue)
3)    Queue completion (notification that a queue is completed)

c.    General stats (* marks the number items that need comparison context)

1)    *Number of workers for a queue
2)    *Queue running time list
3)    *Queue waiting time list
4)    *Number of tasks in a queue
5)    Queue status (running/paused/resume/deleted (a list of each))
6)    Queue status (launched/ unlaunched (list of each)

d.    Any trends/history you want to see?

 

RANK ACTIONS

The card sorting activity may have given ideas to what actions are needed.
Rank importance of these action:

a.    Retry/rerun/recover
b.    Pause/Resume
c.    Delete
d.    View
e.    Edit (currently not feasible in backend)
f.    Other actions

Fill out the action verb with subject and object. E.g. qDO rerun the queue