THN


Back home Case Study

UPS DIAD V Usability Study

A field evaluation of the handheld device UPS drivers use all day, every day. We rode along on a live delivery route to understand how the device performs under real conditions.

Client
UPS
Methods
Contextual Observation, Heuristic Evaluation
My Role
Lead Researcher
Deliverable
Findings Report + Recommendations
Background

The device drivers depend on.

The UPS DIAD V (Delivery Information Acquisition Device) is the handheld scanner drivers carry on every route. They use it to scan packages, navigate stops, capture customer signatures, and flag delivery exceptions. It is the primary tool of their job, in their hands for hours at a stretch, across varied outdoor conditions.

We were asked to evaluate how well the device supports drivers doing this work. Rather than rely on a lab or a simulated task, we went to where the real work happens: a full delivery route, with an active driver, on a normal day.

Research Approach

Ride-along + heuristic evaluation.

The study combined two methods. First, we conducted a contextual observation ride-along, accompanying a driver on his route and watching how he interacted with the DIAD V in the field. No tasks were assigned. We observed what he did naturally, noted moments of friction, and collected direct quotes. Second, we applied Nielsen's 10 usability heuristics as a structured evaluation lens, rating each against what we observed.

Contextual Observation

Rode along with one experienced UPS driver on a live delivery route. Observed device use across package scanning, signature capture, stop navigation, and exception handling. Took field notes throughout. No prompts, no think-aloud instructions.

Heuristic Evaluation

Applied Nielsen's 10 heuristics post-ride to synthesize findings into a structured severity framework. Each heuristic rated 1 (cosmetic) to 3 (major usability barrier). Findings cross-referenced against observed friction points and driver statements.

Field Observations

What the driver said and did.

Three patterns emerged clearly during the ride-along. Each connects directly to a screen content or information density problem.

"Sometimes I have to stop walking just to see the screen. The glare is bad."

Driver, observed mid-route

Stopping mid-route just to read the screen costs time and breaks the physical flow of the job. Screens packed with low-priority data make it hard to locate the relevant detail at a glance, forcing drivers to stand still and search.

"I keep pulling the device closer to see. Sometimes I have to take my glasses off."

Driver, observed during package scan

Dense screen layouts push type sizes down to fit everything. The driver was physically compensating throughout the day, not because of a vision problem, but because the screen was asking him to read too much at once at too small a size.

"I'm trying to get things delivered and our time is tracked. Sometimes I feel that this slows us down."

Driver, end-of-route debrief

Drivers are measured against tight delivery windows. Screens with too many elements require more reading and more decisions per interaction. Across hundreds of stops, that overhead adds up.

Heuristic Findings

Ten heuristics, rated by severity.

Severity 3 indicates a major usability barrier that disrupts the primary task. Severity 2 indicates a meaningful problem that should be addressed. Severity 1 is cosmetic or minor.

Severity 3
Visibility of System Status

Status updates are delayed or unclear. Drivers cannot easily tell whether a scan registered, a signature was captured, or a stop was marked complete without looking closely at small text.

Severity 3
Recognition Over Recall

The interface requires memorized workflows for common tasks. Menu labels don't match how drivers think about their work. Experienced drivers adapt; newer drivers slow down or make errors.

Severity 2
Match: System and Real World

Terminology and navigation structures reflect system logic rather than route logic. Drivers think in stops, packages, and exceptions. The device organizes around fields and screens.

Severity 2
User Control and Freedom

Limited ability to back out of a state or correct a scan error without restarting a workflow. Drivers who tap the wrong thing must navigate back through several screens to recover.

Severity 2
Error Prevention

The device is prone to accidental inputs, particularly when handled with gloves or while walking. No confirmation step before state-changing actions like marking a delivery as attempted.

Severity 2
Flexibility and Efficiency

No shortcuts or accelerators for high-frequency tasks. Experienced drivers repeat the same multi-step sequence hundreds of times per route with no way to streamline it.

Severity 2
Error Recovery

Error messages appear but don't explain what went wrong or what to do next. Drivers described guessing at corrections, which adds time and sometimes introduces new errors.

Severity 2
Help and Documentation

No accessible in-device reference for edge cases like damage claims, refused deliveries, or address discrepancies. Drivers rely on memory or call dispatch.

Severity 1
Consistency and Standards

Minor inconsistencies in button placement and label casing across screens. Not disorienting but adds cognitive overhead over a full shift.

Severity 1
Aesthetic and Minimalist Design

Screens contain more information than drivers act on at any single moment. Low-priority data competes visually with the task at hand.

Recommendations

Six changes, screen and software only.

All recommendations target screen content and layout. Hardware changes were out of scope for this engagement.

  • 1
    Reduce information density on primary task screens

    Each screen should show only what the driver needs to complete the current action. Secondary data (route metadata, internal codes, system fields) should be hidden by default and accessible on demand.

  • 2
    Increase font size on scan, signature, and stop confirmation screens

    Removing non-essential content creates room to increase type size without restructuring the layout. Larger type directly addresses the physical compensation observed during the ride-along.

  • 3
    Clarify confirmation states with prominent visual feedback

    After a scan, signature capture, or stop completion, the screen should show a clear, full-size confirmation before advancing. Small status text is too easy to miss while moving.

  • 4
    Simplify input fields to match driver mental models

    Fields that ask for system codes or internal identifiers should show plain-language labels. Where the physical QWERTY keyboard is available, text fields should default to it rather than forcing numeric-only input mode.

  • 5
    Move the Signature confirmation button away from high-traffic screen areas

    Repositioning the on-screen Signature button reduces accidental taps during scanning. A brief confirmation step before finalizing prevents deliveries being incorrectly logged as signed.

  • 6
    Add an in-screen quick reference for edge-case procedures

    A collapsible help panel for infrequent tasks (refused deliveries, damage claims, access code issues) reduces dispatch calls and removes the need to rely on memorized workflows.

Test Plan

UPS DIAD V Usability Test Plan

Download test plan

Findings

UPS DIAD V Usability Testing Findings

Download findings
Let's Connect

Have a research or design challenge? Let's talk.

Whether you're rethinking a product experience or trying to make complex workflows make sense, I'd love to dig in.

Email me
Location
Las Vegas, NV 89120
Availability
Open to new engagements