Evidence story on map.png
 

My contribution and takeaways

  • computer vision
  • interaction design
  • user interviews
  • competitor analysis

Problem

Body worn cameras and CCTV (Close Circuit Television) cameras used by officers can capture all kinds of people, objects and activities in the course of an officer’s duties and responses to calls. The public or the media may make FOIA (Freedom Of Information Act) requests for some of this video footage. The police must blur out images of children, victims, personal information like license plates, store signs and other sensitive images in the video in order to protect citizens before releasing the video to the media. 

 

1. Manually performing such a task is labor intensive

Screen Shot 2018-08-03 at 14.04.13.png

With 1 camera for every 11 people, considering the population of Washington DC, 5.9 billion hours of video footage are generated every week. 

 

2. Video editing software requires countless hours to master  making police dependent on special video editing agencies. 

 
 
 

3. Editing large number of videos frame by frame is expensive

 
 
Responding to every FOIA request and redacting footage from their body worn cameras could take them over 1 million hours to complete.
— Washington DC Metropolitan Police Department

Users

 
 

 

 

Context of the application

 

 

 

Summary of competitor analysis

 

 

     

    Understanding user behavior from interviews

     
    I don’t believe the hype behind automated redaction. Either the tool is too hard to use or is not accurate enough for us to release the video to media. Maintaining versions of redacted videos is another beast to tame
    — Karen Simpson (Santa Clara Police Department)
     
     

    Emerging trends from user interviews

    1. Speed is a crucial factor to consider when dealing with a large number of FOIA requests.

    2. User must have the flexibility to manually add masks for redaction

    4. Provide a way to preserve original video

    5. Organize redacted videos by meaningful names

       
       

       

      Exploring solutions for user needs

      Video redaction panel with timeline view

      Redacted videos in thumbnail view

      Redacted videos in thumbnail view

      Progress indicator of analysis/redaction taking place

      Progress indicator of analysis/redaction taking place

      Masks in thumbnail view and manual mask creation mode

      Masks in thumbnail view and manual mask creation mode

      Exploring additional options while in manual mask creation mode

      Exploring additional options while in manual mask creation mode

       

       

      High fidelity prototype

      Case and evidence preview on map. Evidence linked to the case is contained in the circle.

      Case and evidence preview on map. Evidence linked to the case is contained in the circle.

       
      Screen Shot 2018-04-06 at 15.45.02.png
       
      Original video and list of redacted videos

      Original video and list of redacted videos

       
      Video redaction options along with list of masks detected and manual mask creation mode. 

      Video redaction options along with list of masks detected and manual mask creation mode. 

       

       

      Design decisions

      Progress indicator within original video instead of explicit indicator while analysis / redaction is taking place

      Having limited space within the editing panel, it was necessary to have as compact UI elements as possible. This style of progress indicator allowed user to view progress without moving focus from the original video. 

       
       
      Button transformations at various stages in redaction

      Button transformations at various stages in redaction

       
      ProgressIndicator.gif
       
       

       

      Enter mask creation mode and exit with a single click vs. Mask creation within video frame

      Manual masks can be created by clicking on the preview panel as well as the video frame. Having this flexibility was important to some users because viewing masks filtered in a panel was easier for them to add to the list while other users felt that being able to draw on the video panel provided them with some context around the mask.

       
       
      Manual mask exit mode.gif
       
       

       

      System status visible outside the application in notification panel instead of pop-up messages

      Pop up messages would not provide user real time feedback of the progress of the redaction. Having a dedicated space for progress indicators would provide users real time status messages of the task taking place in the background.

       

       
       
       
      radial_progress_bar.gif
       
       

       

      Adding/deleting manual masks within video frame vs. editing panel

      Giving user option to add/ delete masks on the video panel would add context to the mask being created (showing surrounding area) while showing the mask in a thumbnail view on the preview panel would show the content of the mask without noise. Since both scenarios had equal importance, it was decided that we have both options.

      Additionally, hover over feedback to the user is provided by changing color of mask when user hovers over masks. User may choose to unselect mask by simply clicking on the mask.

       

       
      ezgif.com-video-to-gif (2).gif
      Video Redaction_6.jpg
       

       

      Single button for all operations vs having multiple buttons

      Changing state of a single button for next steps would make the entire redaction process seem like a linear sequence of steps rather than disjointed pieces of events happening in the background.

      Having multiple buttons on the other hand, would require disabling certain actions while a button is active. 

       

       
      ezgif.com-video-to-gif (3).gif
       
       

      Outcome

      noun_1220055_cc.png

      increased redaction speeds by up to 600%

      noun_1304910_cc.png

      saved costs from hiring an external agency to redact videos

      noun_213021_cc.png

      improved the editing experience with user interface design changes and icon enhancements

      noun_425203_cc (1).png

      maintained versions of redacted and original videos that makes it easy to locate, download and share

       
      The software is simple to use.
      — Karen Simpson, Santa Clara Police Department
      This tool is extraordinarily powerful in its ability to accurately identify and redact human faces quickly through an entire video clip.
      — Karen Simpson, Santa Clara Police Department

      For details on design process, explorations and iterations, feel free to reach out to me.

       

      Other selected projects

      Tackling crime with predictive policing

      Data visualization, Visual design, Dashboard design

      Health insurance made easy

      Visual design, Mobile application design, Information architecture

      Preventing harmful drug interactions

      Usability testing using eye tracking, Visual design, Experience design