The Hierarchy Compliance Report was designed to meet the needs of various roles across Learning & Development and Sales to better understand the progress of learners for required programs. The information is presented in the view of the organizational hierarchy (i.e. reporting structure) and allows the user to drill down through that hierarchy from leadership down to individual learners. Filters for program, region, and group are provided to isolate areas of interest. Some common use cases are the following:
- A new company messaging program was launched and sales leadership wants to know how many learners have started and have completed the program across the entire organization.
- An L&D leader wants to follow the progress of a cohort of new hires who have been assigned a standard of on-boarding programs.
- Sales Ops wants to check that learners are making progress towards program requirements and to identify sales managers who need to reinforce completion deadlines with their teams
- An L&D specialist wants to inspect the efficacy of specific programs by looking at average scores and also to see if the review/coaching step is a bottleneck
- A sales manager wants to understand the progress of her team to required programs
Accessing the Report
In order to access this report, users must be assigned a role where the New Reporting feature is enabled and it will appear at the bottom of the left sidebar navigation.
NOTE: All information for this report is based on a snapshot of data that runs about every hour. This was done to optimize for performance. An indicator in the header of the report provides the timing, e.g. "Updated an hour ago"
Additionally, users who are assigned to a role with the Compliance Admin permission will be able to view this report for the entire organization. The user shown above has this permission so the report shows a roll up of the entire organization. When a manager that falls somewhere in the middle of the hierarchy accesses this report (without the Compliance Admin permission) the report displays information for only that manager's branch of the organization.
As users navigate the hierarchy a breadcrumb is construction to set context for the current level of the hierarchy. Each level is clickable to allow easy navigation back up in the hierarchy.
Understanding the Metrics
The header of the report shows a number of summary metrics for that level of the hierarchy. Programs that have been archived as well as data associated with inactive users are excluded.
Hierarchy size: Total number of active users below this level of the organizational hierarchy. Users who appear at the top level of the organization do not have a manager and are excluded from this metric.
Learners Assigned: Total number of learners in the hierarchy who are assigned to active programs
Started: Percentage of learners who have started their assigned programs. A program is started once the user has viewed or read the content associated with the activity.
Learner Completed: Percentage of learners who have completed (submitted) their assigned programs. Some programs may not require submissions in which case the completion status is satisfied once they have viewed or read the associated content.
Coach Completed: Percentage of learners whose assigned programs with submissions have been submitted and scored. This metric cannot exceed the Learner Completed metric as it is based on the total set of assigned programs requiring submission and not the total number of programs that are available to be scored. If Coach Completed is significantly lower than Learner Completed, then there may be an issue with the review/coaching process.
Score: Average of all scores across all learners assigned to active programs.
The body of the report contains rows for managers and/or learners as shown below.
Managers appear as rows where Hierarchy Size is greater than 1, and individual contributors do not have a Hierarchy Size. Therefore, the metrics per row are summarize either for the manager's team or for the individual contributor.
Learners Assigned: Reflects the number of learners contributing to the metrics. When filters are applied Hierarchy Size does not change, but the number of learns matching the filter criterial may change and be reflected by this metric.
Learner Completion: The definition matches the summary metric in the report header which is the percentage of learners who have completed (submitted) their assigned programs. Hovering the mouse pointer over the associated bar chart reveals a tooltip with the distribution of program statuses: completed, in-progress, and not started relative to the total number of programs.
Coach Completion: The definition matches the summary metric in the report header which is the percentage of learners whose assigned programs with submissions have been submitted and scored. The associated bar chart shows the distribution of status for coach reviews: completed, in-progress, and not started.
% Score: Average of all scores across all learners assigned to active programs.
Report filters are accessed by clicking the Filters button. This opens a modal where filters for program, region, and group are available. Each filter allows one or more values to be selected. Groups only apply to learner groups. Learners who fall within the selected groups then determine the associated set of assigned programs that drive the report metrics.
The final level of detail provided by the report is the set of assigned programs associated with an individual contributor. Clicking a row for an individual contributor opens a drawer that lists all in-progress programs for that learner. Each program can be further expanded to show the status of each activity. This view is identical to the view access by managers drill down into their teams via the My Team widget on the Coaching Dashboard.
Note: This drawer does not apply any of the filters set at the report level.