Skip to main content

Diagnostic Tools

Troubleshooting tool on Celona Orchestrator

Team Celona avatar
Written by Team Celona
Updated over a week ago

Celona Diagnostic Tools enables Orchestrator Admin users to conduct detailed troubleshooting by utilizing the pre-built suite of tools used by Celona support team. Upon execution of any of the diagnostic tools from Orchestrator UI, the debug commands will execute directly on the Edge and output will be reflected in Orchestrator console. Historical view of executed tools along with the details on the specific tool, user and time will be available for later review as well.

These tools can be utilized for troubleshooting during the network bring up on Day 0 / 1 as well as for the ongoing management and monitoring of the network as part of Day N operations.

Accessing Diagnostic Tools

Diagnostic Tools are only available for the Customer Admin users.

The Diagnostic Tools can be opened from the menu in Celona Orchestrator.

Executing Diagnostic Tools

To execute any of the diagnostic tools, it is required to first select Edge Cluster.

Once Edge Cluster is selected, the specific tool can be selected from the available list. Note: list of available tools depends on the OS version of selected Edge Cluster. Please reach out to support@celona.io in case if Edge upgrade is required.

There are 2 types of tools:

  1. Edge related tool. If one of these tools is selected, no additional input is required and the diagnostic tool window can be opened at this step.

  2. AP related tool. If one of these tools is selected, an additional field will appear prompting the user to select the AP before executing the tool.

Press “Open Diagnostic tool” to execute the tool.

Multiple Diagnostic tools can be opened simultaneously enabling the user to cross-validate multiple outputs for comprehensive troubleshooting – without needing to re-open and re-run the tools.

Press "Run Diagnostics" to execute the tool.

The output from the executed tool will be reflected in the console within the same tab and it can also be copied or downloaded.

Note that for certain commands, some additional inputs from the user might be required.

Terminating Diagnostic Tools

Execution in-progress for the asynchronous commands can be terminated by pressing "Terminate" button.

Accessing Executed Diagnostic Tools History

The history of executed tools is available by pressing “Executed Tools History” button.

List of Diagnostic Tools

Feature

Diagnostic Tool

Description

5G AP

Bootstrap Troubleshooting

Checks bootstrap troubleshooting steps.

Calibration Files Check

Verifies calibration files on 5G AP.

Check AP Model

Displays AP model.

Check Bootstrap Info

Displays bootstrap details and Edge IP assignment.

Reboot

Reboots the 5G AP.

5G/LTE

Domain Proxy Logs

Retrieves Domain Proxy logs.

IpAddSrv Logs

Retrieves IpAddSrv logs.

5GC (5G Core)

AMF Logs

Retrieves ongoing AMF logs from Edge.

Check Service Status

Displays the status of services on 5GC Edge.

PCF Logs

Retrieves ongoing PCF logs.

SMF Logs

Retrieves ongoing SMF logs.

UDR Logs

Retrieves ongoing UDR logs.

AP

Ping IP from AP

Sends 20 ping packets from AP to an IP.

Reboot

Reboots the selected AP.

Reboot History Log

Displays reboot history of the selected AP.

Uptime

Checks AP uptime.

Version Check

Retrieves AP version.

Ping AP from Edge

Sends a ping to AP IP from Edge.

Check NTP Configuration

Verifies AP NTP server configuration.

Bootstrap Reachability

Checks bootstrap reachability.

Bootstrap Info

Displays bootstrap details and Edge IP assignment.

Check Disk Space

Checks AP /mnt partition disk space.

Check Radio Details

Displays AP radio details, such as power and frequency.

Check GPS Sync

Verifies AP GPS synchronization.

Check PTP Sync

Verifies AP PTP synchronization.

5GC POD Logs

Collect 5GC POD Logs

Retrieves ongoing logs for AMF, SMF, UDR, UDM, AUSF, NRF, PCF, NSSF, IPADDR, and SVC registration from Edge.

Device

Device Status

Displays the status of a device in the system.

Edge

Execute Command

Runs a command on Edge.

Execute OpenSSL Command

Runs an OpenSSL command on Edge.

Execute Ping Command

Sends a ping from Edge.

Interface Details

Displays Edge interface details.

Reboot

Reboots Edge.

SAS Details

Retrieves SAS configuration details on Edge.

Trigger Support Dump

Initiates a support dump on demand.

Fix Ubyon UID

Fixes Ubyon UID.

Get Cluster Info

Displays cluster information.

Get IP Domain Interface Details

Retrieves IP Domain interface details.

LTE

ACS Logs

Retrieves ACS logs.

HSS Logs

Retrieves HSS logs.

MME Logs

Retrieves MME logs.

SPGW Logs

Retrieves SPGW logs.

Stats Logs

Retrieves LTE statistics logs.

SON-Assist Logs

Retrieves SON-Assist logs.

Miscellaneous

Start iPerf Server on IP Domain

Starts an iPerf server on the IP domain.

UE Flow/Route Info

Retrieves flow/route information based on UE IP from UDF.

5G AP Diagnostic Tool

  1. Bootstrap Troubleshooting
    The Bootstrap Troubleshooting diagnostic tool helps identify and resolve issues related to the onboarding process of a 5G AP in the Celona network. It checks whether the AP has successfully completed the bootstrap process, received its configuration from the Orchestrator, and established communication with the Edge. The tool verifies critical parameters such as IP address assignment, DHCP settings, DNS resolution, and connectivity to the Orchestrator. If any failure is detected, it provides insights into potential misconfigurations or network issues that might prevent the AP from properly joining the network. Identifies and resolves bootstrap issues, ensuring successful AP initialization.

    bootstraptool.png

    bootstrap.png

  1. Calibration Files Check
    The Calibration Files Check diagnostic tool verifies the integrity and availability of calibration files on a 5G AP. Calibration files contain essential hardware-specific parameters that ensure the AP operates within optimal performance and regulatory compliance. This tool checks if the necessary calibration files are present, correctly formatted, and not corrupted. If any discrepancies are found, it helps diagnose issues affecting the AP’s radio performance, such as incorrect transmit power levels, frequency tuning errors, or degraded signal quality. This tool is useful for troubleshooting connectivity issues and ensuring the AP functions as expected.

  2. Check AP Model
    The Check 5G AP Model diagnostic tool retrieves and displays the model information of a 5G AP. Select the Access Point and click the Run Diagnostics button to retrieve the AP model information.

  3. Check Bootstrap Info
    The Check Bootstrap Info diagnostic tool retrieves detailed information about the bootstrap process of a 5G AP. It verifies whether the AP has successfully received an IP address from the Orchestrator and established connectivity with the Edge. This tool checks key parameters such as the assigned Edge IP

  4. REBOOT
    The REBOOT diagnostic tool allows administrators to restart a selected 5G AP remotely.

5G/LTE Diagnostic Tools

  1. DomainProxy Logs
    The DomainProxy Logs diagnostic tool retrieves logs related to the Domain Proxy service running on the Edge. The Domain Proxy is responsible for managing communication between the Celona private cellular network and the Spectrum Access System (SAS) for CBRS deployments. This tool captures logs that provide insights into SAS registration, spectrum grant requests, and heartbeat messages. It is particularly useful for troubleshooting issues related to spectrum authorization, CBRS interference, or failures in obtaining and maintaining a spectrum grant. By analyzing these logs, administrators can diagnose connectivity problems between the Edge and SAS, identify errors in spectrum requests, and ensure the proper functioning of CBRS operations.

  2. IpAddrSrv Logs
    The IpAddrSrv Logs diagnostic tool retrieves logs related to the IP Address Service (IpAddSrv) running on the Edge, which is responsible for managing IP address assignments within the Celona network. This tool helps administrators diagnose issues related to DHCP and IP allocation for APs

5GC (5G Core) Diagnostic Tools

  1. AMF Logs
    The AMF Logs diagnostic tool retrieves logs related to the Access and Mobility Management Function (AMF) within the 5G Core (5GC). AMF is a key component for managing device registration, mobility, and session management in a 5G network. This tool captures real-time logs detailing UE authentication, handovers, session establishment, and signaling exchanges between the UE, gNB, and Core Network.

  2. Check Service Status
    The Check Service Status diagnostic tool verifies the operational status of key services running on the 5GC Edge and displays how long each service has been running in days. It provides real-time insights into whether essential network functions such as AMF, SMF (Session Management Function), PCF (Policy Control Function), UDR (Unified Data Repository), and others are active and functioning correctly.

    By executing this tool, administrators can quickly identify if any critical services have stopped, crashed, or are experiencing disruptions. The tool displays the active, inactive, or failed status of each service, along with the duration each service has been running. This helps users diagnose issues related to network instability, service outages, or failed user connections. If a service is found to be down, the logs from this tool can be used to determine the cause and take corrective actions, such as restarting the affected service or troubleshooting configuration issues.


  3. PCF Logs
    The PCF Logs diagnostic tool retrieves logs related to the PCF within the 5GC. The PCF is responsible for enforcing network policies, managing QoS, and handling charging rules for user sessions. This tool captures real-time logs detailing policy decisions, session modifications, QoS assignments, and interactions with other 5GC components, such as the SMF and UDR.

  4. SMF Logs
    The SMF Logs diagnostic tool retrieves logs related to the SMF within the 5GC. The SMF handles PDU (Protocol Data Unit) session management, IP address allocation, and traffic routing for connected devices. This tool captures real-time logs detailing session establishment, modification, release processes, and interactions with other core network functions, such as the AMF, UPF, and PCF.

  5. UDR Logs
    The UDR Logs diagnostic tool retrieves logs related to the UDR within the 5GC. The UDR is responsible for storing and managing subscriber data, policy information, and application profiles, making it a crucial component for authentication, policy enforcement, and session management.

AP Diagnostic Tools

  1. Ping some IP Address from AP
    Sends 20 ICMP packets from an AP to a specified IP for network reachability testing. The Ping IP from the AP diagnostic tool allows administrators to test network connectivity by sending 20 ICMP (Internet Control Message Protocol) ping packets from a selected AP to a specified IP address. This tool helps verify whether the AP can reach a particular destination, such as an Edge node, another AP, a core network component, or an external server.

    By analyzing the ping results, users can diagnose latency issues, packet loss, or network reachability problems. A successful ping response indicates that the AP has proper network connectivity, while failures may suggest issues such as misconfigured routing, firewall restrictions, or underlying network failures. Key metrics like round-trip time (RTT), packet loss percentage, and response time variations provide further insights into network performance and stability.

  2. Reboot
    The Reboot diagnostic tool restarts the selected AP.

  3. Reboot History Log
    A reboot history log is a record that tracks all past AP reboot events, detailing the date, time, and often the reason for each reboot.

  4. Check AP Uptime
    An AP Uptime Diagnostic Tool monitors the uptime (the period during which the AP is active and operational) of wireless APs.

  5. Check AP Version
    Retrieves the firmware version of the AP.

  6. Ping AP IP address from Edge
    Enter the IP address to ping, and it sends a ping request from Edge to an AP.

  7. Check NTP server Configuration
    Verifies if the NTP server is correctly configured and operational.

  8. Bootstrap Reachability
    Ensures that the AP can reach the CSO at cso.celona.io

  9. Check Bootstrap Info
    Displays the bootstrap status and Edge IP allocation details.

  10. Check Disk Space
    Check available disk space in the AP.

  11. Check Radio Details
    Displays radio parameters such as power levels and frequency settings

  12. Check AP GPS Sync
    Confirms whether GPS synchronization is functioning correctly



  13. Check AP PTP Sync
    Ensures that PTP synchronization is working properly

5GC POD Logs

  1. Collect 5GC POD Logs
    Collect logs from multiple 5GC functions, including AMF, SMF, UDR, UDM, AUSF, NRF, PCF, NSSF, IPADDR, and SVC registration, for comprehensive core network debugging.

Device Diagnostic Tools

  1. Device Status
    Retrieves the operational status of a connected device in the network.

Edge Diagnostic Tools

  1. Execute Command
    Run a custom command on Edge for diagnostic purposes.

  2. Execute OpenSSL Command
    Executes an OpenSSL command for certificate and encryption troubleshooting.

  3. Execute Ping Command
    Sends a ping request from the Edge.

  4. Interface Details
    Displays network interface configuration details on the Edge.

  5. Reboot
    Restart the Edge device.

  6. SAS Details
    Retrieves Spectrum Access System (SAS) configuration details.

  7. Trigger Support Dump
    Generates a support dump for debugging and issue analysis.

  8. Fix Ubyon UID
    Repairs the Ubyon UID configuration.

  9. Get Cluster Info
    Provides information on the current cluster setup.

  10. Get IP Domain Interface Details
    Retrieves configuration details for the IP Domain interface.

LTE Diagnostic Tools

  1. ACS Logs
    Collect logs from the Auto Configuration Server (ACS) to troubleshoot remote configuration issues.

  2. HSS Logs
    Retrieves logs from the Home Subscriber Server (HSS) for debugging user authentication problems.

  3. MME Logs
    Provides logs from the Mobility Management Entity (MME) to analyze control plane functions.

  4. SPGW Logs
    Collect logs from the Serving and Packet Gateway (SPGW) to diagnose packet forwarding issues.

  5. Stats Logs
    Retrieve LTE network statistics for performance monitoring.



  6. SON-Assist Logs
    Captures logs related to Self-Organizing Network (SON) functions for automated network optimization.



Miscellaneous Tools

  1. Start iPerf Server on IP Domain
    Initiates an iPerf server to test network performance within the IP Domain.

  2. UE Flow/Route Info
    Retrieves user equipment (UE) flow and route details based on the IP address, helping analyze data path issues.

Please reach out to support@celona.io in case of any additional questions regarding Diagnostic Tools.



Did this answer your question?