Test Results

Test Type: Tree Test   |   Created: Sep 22, 2023   |   Total Participants: 52   |   Participants Excluded from Dataset: 1
Description: No description provided.

Summary

This test includes 5 tasks

48/51 participants completed all tasks (249 total responses)

Response Overview
Correct 127 51.0%
Incorrect 115 46.2%
Skipped 7 2.8%

Tasks

Task 1

Where would you go to add a person as your beneficiary? Please explain your thoughts while navigating the menu.

Solutions

  • Profile and Settings / John Hancock IRA Beneficiaries (41 selected)

Incorrect Selections

  • Profile and Settings (2 selected)
  • Roth IRA / Roth IRA Account Overview (2 selected)
  • Home (1 selected)
  • Profile and Settings / John Hancock IRA Profile Information (1 selected)
  • Roth IRA (1 selected)
  • Roth IRA / Account Documents (1 selected)
80.4 percent of users selected the correct solution
15.7 percent of users selected the incorrect solution
3.9 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Correct 41 80.4%
Incorrect 8 15.7%
Skipped 2 3.9%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:33
Fastest Time 00:01
Slowest Time 02:40
Median 00:23

Task 2

Where would you go to view your quarterly statements? Please explain your thoughts while navigating the menu.

Solutions

  • Roth IRA / Account Documents (23 selected)

Incorrect Selections

  • Roth IRA / Roth IRA Account Overview (7 selected)
  • Roth IRA / Transaction History (3 selected)
  • Roth IRA (3 selected)
  • Help Center / Forms and Documents (2 selected)
  • Roth IRA / Recurring Transactions (2 selected)
  • Profile and Settings / John Hancock IRA Profile Information (2 selected)
  • Profile and Settings / John Hancock IRA Bank Information (1 selected)
  • Home (1 selected)
  • Profile and Settings (1 selected)
  • Roth IRA / Contribute & Exchange (1 selected)
  • Help Center (1 selected)
46.9 percent of users selected the correct solution
49.0 percent of users selected the incorrect solution
4.1 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Correct 23 46.9%
Incorrect 24 49.0%
Skipped 2 4.1%
A table of response times
Icon Title Time in minutes:seconds
Average Time 01:02
Fastest Time 00:14
Slowest Time 06:04
Median 00:38

Task 3

You’re moving to a new home. Where would you go to update your address? Please explain your thoughts while navigating the menu.

Solutions

  • Profile and Settings / John Hancock IRA Profile Information (37 selected)

Incorrect Selections

  • Profile and Settings / John Hancock Communication Preferences (6 selected)
  • Profile and Settings (3 selected)
  • Home (3 selected)
74.0 percent of users selected the correct solution
24.0 percent of users selected the incorrect solution
2.0 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Correct 37 74.0%
Incorrect 12 24.0%
Skipped 1 2.0%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:40
Fastest Time 00:02
Slowest Time 05:11
Median 00:30

Task 4

Where would you find the confirmation of the transaction you made recently? Please explain your thoughts while navigating the menu.

Solutions

  • Roth IRA / Account Documents (0 selected)

Incorrect Selections

  • Roth IRA / Transaction History (45 selected)
  • Roth IRA / Recurring Transactions (2 selected)
  • Profile and Settings / John Hancock Communication Preferences (1 selected)
  • Roth IRA (1 selected)
98.0 percent of users selected the incorrect solution
2.0 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Incorrect 49 98.0%
Skipped 1 2.0%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:32
Fastest Time 00:02
Slowest Time 02:00
Median 00:26

Task 5

It’s time to file your taxes! Where would you go to view your 1099-R? Please explain your thoughts while navigating the menu.

Solutions

  • Roth IRA / Account Documents (26 selected)

Incorrect Selections

  • Help Center / Forms and Documents (6 selected)
  • Profile and Settings / John Hancock IRA Profile Information (3 selected)
  • Roth IRA / Contribute & Exchange (3 selected)
  • Roth IRA (3 selected)
  • Roth IRA / Roth IRA Account Overview (2 selected)
  • Help Center / Need help finding a tax form? (2 selected)
  • Roth IRA / Transaction History (1 selected)
  • Profile and Settings / John Hancock IRA Bank Information (1 selected)
  • Roth IRA / Recurring Transactions (1 selected)
53.1 percent of users selected the correct solution
44.9 percent of users selected the incorrect solution
2.0 percent of users selected finding a solution
A summary of responses
Status Number Percentage
Correct 26 53.1%
Incorrect 22 44.9%
Skipped 1 2.0%
A table of response times
Icon Title Time in minutes:seconds
Average Time 00:52
Fastest Time 00:09
Slowest Time 05:58
Median 00:35