Test Results

Test Type: Tree Test   |   Created: Sep 25, 2023   |   Total Participants: 53   |   Participants Excluded from Dataset: 0
Description: No description provided.

Summary

This test includes 5 tasks

53/53 participants completed all tasks (265 total responses)

Response Overview
Correct 175 66.0%
Incorrect 88 33.2%
Skipped 2 0.8%

Tasks

Task 1

Where would you go to add a person as your beneficiary? Please explain your thoughts while navigating the menu.

Solutions

  • Profile and Settings / John Hancock IRA Beneficiaries (45 selected)

Incorrect Selections

  • Profile and Settings (4 selected)
  • Roth IRA Account Overview / Roth IRA Account Overview (1 selected)
  • Roth IRA Account Overview (1 selected)
  • Help Center / Contact Us (1 selected)
84.9 percent of users selected the correct solution
13.2 percent of users selected the incorrect solution
1.9 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Correct 45 84.9%
Incorrect 7 13.2%
Skipped 1 1.9%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:30
Fastest Time 00:08
Slowest Time 02:06
Median 00:26

Task 2

Where would you go to view your quarterly statements? Please explain your thoughts while navigating the menu.

Solutions

  • Roth IRA Account Overview / Statements, Tax, and Confirmations (47 selected)

Incorrect Selections

  • Roth IRA Account Overview (3 selected)
  • Roth IRA Account Overview / Roth IRA Account Overview (1 selected)
  • Profile and Settings / John Hancock IRA Bank Information (1 selected)
  • Roth IRA Account Overview / Transaction History (1 selected)
88.7 percent of users selected the correct solution
11.3 percent of users selected the incorrect solution
A summary of responses
Status Number Percentage
Correct 47 88.7%
Incorrect 6 11.3%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:32
Fastest Time 00:07
Slowest Time 02:00
Median 00:25

Task 3

You’re moving to a new home. Where would you go to update your address? Please explain your thoughts while navigating the menu.

Solutions

  • Profile and Settings / John Hancock IRA Profile Information (35 selected)

Incorrect Selections

  • Profile and Settings / John Hancock Communication Preferences (8 selected)
  • Profile and Settings (7 selected)
  • Roth IRA Account Overview / Roth IRA Account Overview (2 selected)
  • Home (1 selected)
66.0 percent of users selected the correct solution
34.0 percent of users selected the incorrect solution
A summary of responses
Status Number Percentage
Correct 35 66.0%
Incorrect 18 34.0%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:37
Fastest Time 00:08
Slowest Time 03:14
Median 00:27

Task 4

Where would you find the confirmation of the transaction you made recently? Please explain your thoughts while navigating the menu.

Solutions

  • Roth IRA Account Overview / Statements, Tax, and Confirmations (5 selected)

Incorrect Selections

  • Roth IRA Account Overview / Transaction History (43 selected)
  • Roth IRA Account Overview (3 selected)
  • Home (2 selected)
9.4 percent of users selected the correct solution
90.6 percent of users selected the incorrect solution
A summary of responses
Status Number Percentage
Correct 5 9.4%
Incorrect 48 90.6%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:31
Fastest Time 00:05
Slowest Time 02:34
Median 00:23

Task 5

It’s time to file your taxes! Where would you go to view your 1099-R? Please explain your thoughts while navigating the menu.

Solutions

  • Roth IRA Account Overview / Statements, Tax, and Confirmations (43 selected)

Incorrect Selections

  • Help Center / Forms and Documents (3 selected)
  • Roth IRA Account Overview (2 selected)
  • Profile and Settings (2 selected)
  • Home (1 selected)
  • Roth IRA Account Overview / Roth IRA Account Overview (1 selected)
81.1 percent of users selected the correct solution
17.0 percent of users selected the incorrect solution
1.9 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Correct 43 81.1%
Incorrect 9 17.0%
Skipped 1 1.9%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:45
Fastest Time 00:11
Slowest Time 03:49
Median 00:31