The Orchestrator now provides support for measuring and monitoring how well your devices are experiencing the Celona network. We now identify causes for a poor experience, rank them in order of impact, and will soon provide recommendations to troubleshoot and adapt your device experience within a site.
On your organization's health screen, you can expect to see a device experience score and ranking of contributing factors aggregated across all your sites and per individual site.
The metrics used to calculate the score correspond to different aspects of the network, such as stability, access, service, and application quality.
Device Experience Score
The device experience score for an organization, an individual site or individual device is rated as Good, Fair, or Poor. This score reflects the overall quality of a device’s connectivity and is determined by evaluating how each device is impacted by the network.
Additionally, when viewing the device experience for your organization or a specific site, hover over any data point in the chart to see how many times devices had a good, fair, or poor experience during that period.
Factors Diminishing Experience
To calculate the device experience score, we look at events that negatively affect network performance. These events are grouped into three main categories:
Attach Failures
Device misconfigurations
Edge issues or misconfigurations
Enterprise-related issues
Handover Failures
Preparation failure
Execution failure
Unknown target AP
Disconnects
Edge issues
Radio or AP down
Interference
These factors collectively shape the device experience score and help pinpoint where improvements can be made to enhance overall network performance.
The evidence observed for each of these metrics increases or decreases the experience score. For example, a higher attach failure rate, handover failure rate, or higher number of disconnects increases the negative impact on a device and thus reduces the score.
Along with the experience score, each factor’s contribution to bringing down the score is provided as a percentage.
The contributing factors are ranked – the highest contributor has the lowest rank.
The device experience score and contributions can be aggregated for all sites, individual sites, and individual devices to identify sites/devices with the highest impact.
The current charts display an aggregated experience score calculated every 5 minutes.
Attach: shows a line chart for the percentage of successful attach events, a bar chart for the number of attach attempts, and a tooltip that shows failure reasons and their counts.
Handover: shows a line chart for the percentage of successful handover events, a bar chart for the number of handover attempts. This release does not show failure reasons in the tooltip.
Additional device activity KPIs
Average Time to Attach and Handover: a line chart showing the time to attach, and a line chart showing the time to handover, and a threshold for time to attach, and a threshold for time to handover. Times above these thresholds are considered bad and contribute to lowering the score. (Note: Average attach time and handover time are not included in the device experience score calculation as of release 2411.1.)
Average Time to Recover: a line chart showing the time to recover after radio disconnect and a line chart showing the time to recover after handover disconnect. (Note: Average time to recover is not included in the device experience score calculation as of release 2411.1.)
