-
- From Network KPIs to Real User Experience: Rethinking Quality in 5G SA
- As 5G SA adoption accelerates, network performance alone no longer reflects user experience. Even when throughput and latency meet target levels, users may still encounter buffering, resolution drops, or delayed responsiveness?highlighting a critical reality: good QoS does not always translate into good QoE. Why QoE Matters More in the 5G SA EraThe shift toward experience-centric quality is being driven by the growth of real-time services, the expansion of OTT and adaptive streaming, and rising demand for enterprise-grade service assurance. Network quality must therefore be evaluated not only by infrastructure metrics, but also by how services are actually delivered and experienced. Why KPI-Based Evaluation Is No Longer EnoughTraditional KPI-based evaluation has clear limitations. Adaptive bitrate streaming can hide underlying network issues, while average-based metrics often fail to capture short but highly impactful degradation events. User experience is not defined by averages, but by moments. In 5G SA, perception depends not only on throughput, but also on consistency, responsiveness, and service continuity across different applications and environments. For many emerging services, experience is strongly influenced by packet delay variation, packet loss behavior, sustainable bitrate, transmission gaps, and service availability under realistic traffic conditions. In other words, quality is not only about speed, but also about how predictably and reliably services respond. What Experience-Centric Validation Requires To make QoE measurable and actionable at scale, a more structured validation approach is needed.A QoE-driven framework should combine network performance, service-level behavior, and perceptual quality. This makes it possible to evaluate how users actually experience services such as video streaming, web browsing, cloud applications, messaging, and real-time communication.Experience-centric validation must also be fair, repeatable, and comparable. Test conditions should therefore be controlled through harmonized methods, synchronized measurements, representative service scenarios, consistent device conditions, and neutral test configurations. To be effective in practice, QoE validation must also be scalable. That requires standardized environments, automated testing, centralized analytics, and validation based on real commercial devices and real application behavior, not only synthetic traffic. How Accuver Enables Scalable QoE Validation Accuver supports this transition through an integrated validation framework designed for real-world network environments.XCAL enables reliable field testing and service-level measurement under live network conditions. It supports QoE evaluation not only for voice and video calls, but also for OTT and messaging applications such as WhatsApp and other app-based services. It can be deployed across mobility scenarios, 24/7 continuous monitoring, indoor locations, and non-terrestrial network (NTN) scenarios. XCAL also incorporates Accuver’s VQML™ technology, which delivers real-time objective video quality assessment based on machine learning. XCAL-Manager strengthens this framework with centralized control, automation, and real-time monitoring for large-scale operations. It supports repeatable testing, statistical comparison across devices and network environments, and automation that reduces time and manpower. XCAP extends this workflow with advanced post-processing and QoE analytics, helping teams correlate network behavior with actual service outcomes and user experience. Its AI-based root cause analysis capabilities also provide guidance on likely causes and recommended follow-up actions. Together, these capabilities support continuous monitoring, multi-device validation, service benchmarking, and AI-based video quality assessment across diverse deployment environments. Closing the Gap Between Network Performance and Real ExperienceExperience-centric validation is becoming essential across diverse markets and use cases. It is increasingly relevant for nationwide benchmarking, regulatory assessment, device evaluation, service launch verification, software comparison, mobility scenarios, and large-scale operational monitoring. QoE-driven validation is no longer experimental. It is becoming a practical requirement for understanding how network quality is actually delivered to end users. As networks evolve, so must the definition of quality. Network performance shows what a network is capable of, but user experience determines the quality users actually receive. Accuver helps operators, vendors, and ecosystem partners close this gap through an integrated approach that combines standardized testing, automated measurement, and service-level analytics across real-world network environments.
Apr 24, 2026
-
- Bridging Lab Emulation and Field Probing for Repeatable NTN Validation
- The wireless communication landscape is undergoing a radical shift as Non-Terrestrial Networks (NTN) move from theory to reality. We have entered an era of \"coverage without boundaries,\" driven by an unprecedented scale of satellite deployment. As of early 2026, the number of active Low Earth Orbit (LEO) satellites has surged past 12,500, creating a dense celestial network designed to eliminate global coverage gaps. This orbital infrastructure now supports over 10 million satellite broadband subscribers worldwide, while the emerging \"Direct-to-Device\" (D2D) market is projected to connect a potential audience of over 2 billion people through global cellular integration. However, the leap to space comes with unique technical hurdles. The extreme altitudes of Low Earth Orbit (LEO) introduce massive propagation delays, while the high velocity of satellites creates significant Doppler shifts that can disrupt traditional mobile protocols. Ensuring seamless connectivity between these satellites and ground devices requires a rigorous, dual-phase testing strategy―beginning with high-fidelity simulation in a controlled lab environment and concluding with extensive optimization under real-world field conditions. Accuver is proud to introduce a complete end-to-end NTN test suite designed to empower UE manufacturers, base station developers, and network operators to navigate this high-stakes frontier with confidence. NTN Satellite Link Simulation & Analysis In the lab, the primary challenge lies in replicating the physical realities of space without the prohibitive expense of an actual launch. XCAT-SPACE, Accuver’s 3GPP-based channel emulator, is specifically engineered to simulate wireless channels for satellite and aerospace. By connecting an NTN terminal and a base station simulator to XCAT-SPACE, users can recreate a \"NTN channel environment\" that accurately reflects Doppler shift effects and large-scale time delays.XCAT-SPACE enables controlled and repeatable NTN validation, allowing developers to test their systems against thousands of orbital scenarios in a fraction of the time. This is achieved by precisely simulating LEO-based satellite link conditions―including dynamic propagation delays, complex Doppler effects, orbital mobility, and multi-satellite visibility―ensuring every aspect of the satellite link is rigorously accounted for.The system provides dynamic satellite mobility based on actual orbits. Users can manually configure altitude, trajectory, and terminal movement paths, or achieve even higher precision by automatically importing TLE (Two-Line Element) orbit data. This flexibility allows for comprehensive 5G NR NTN terminal testing and D2D LTE end-to-end validation. For those requiring a perfectly isolated environment, pairing XCAT-SPACE with Accuver’s XCAT-SmartShield or XCAT-Shield Box provides a high-fidelity Over-the-Air (OTA) testing setup. These highly controlled conditions closely approximate wired connections, minimizing external RF uncertainty while preserving essential OTA characteristics. By combining satellite channel emulation with controlled OTA testing, Lab validation supports accurate and repeatable evaluation of NTN devices prior to Field verification. To translate this simulation into meaningful intelligence, XCAP, a post-processing solution, delivers specialized NTN analysis. Since satellite base stations are constantly in motion, XCAP uses 3D map visualization and automated TLE (Two-Line Element) data to correlate RF KPIs with precise satellite positions, azimuth, and elevation at the moment of measurement. This provides a clear performance baseline for 5G NR NTN and D2D solutions across major chipsets. Managing these complex testing cycles is streamlined by XCAP-AMS, a web-based automation platform. By centralizing system control and test reporting into an intuitive web UI, XCAP-AMS eliminates location dependency and reduces operational complexity. Together, this ecosystem―from XCAT-SPACE’s high-fidelity emulation to XCAP’s orbital insights and XCAP-AMS’s centralized management―provides a seamless, repeatable path for NTN device evaluation prior to field verification. 24/7 Unmanned Satellite D2C Monitoring Solution Field verification is the essential step in validating NTN performance under real orbital and network conditions. Accuver enables this through a 24/7 unmanned satellite D2C monitoring solution , designed to capture RF performance, service availability, and mobility behavior across distributed locations using live LEO satellites. At the heart of field operations are specialized measurement probes tailored for mission-critical NTN environments. For deployments in regions where terrestrial networks are unavailable―such as mountainous areas, deserts, or polar zones―the XR-Emb provides a rugged, IP54-rated solution. It ensures stable, automated testing (Ping, PS Call, SMS) in extreme outdoor conditions, supporting real-time status monitoring and failover handling for emergency or remote operations. For multi-UE monitoring, the XR-Pu6 enables continuous 24/7 benchmarking of up to six devices simultaneously. This ensures that operators never miss critical testing opportunities caused by unpredictable satellite pass times, providing a robust verification of satellite coverage and D2C (Direct-to-Cell) performance in the field. These distributed field units are centrally managed by XCAL-Manager, a server platform that eliminates the need for on-site engineers in remote or inaccessible areas. Operators can remotely distribute measurement schedules, monitor satellite links in real-time, and receive automated alarms for network anomalies, significantly reducing OPEX. All measurement data from these multiple sites is then aggregated via XCAP-AMS for consistent data handling and unified platform management. For large-scale or geographically distributed deployments, XCAP serves as the centralized engine for deep-dive analysis. This post-processing solution correlates RF KPIs with real-time satellite dynamics―including azimuth, elevation, Doppler shifts, and free space path loss―derived from TLE-based orbit information. This end-to-end field ecosystem ensures that NTN services are rigorously monitored and optimized in the real world, from the remote edge to the central cloud. Unified NTN Validation Workflow Accuver’s NTN solution provides:ㆍSatellite link simulation, controlled OTA testing, and baseline analysis in the LabㆍContinuous 24/7 unmanned D2C monitoring in the FieldㆍCentralized operation, data aggregation, and integrated analysisㆍConsistent KPI correlation across Lab and Field environments Together, these capabilities support a single, structured NTN validation workflow from simulation to live satellite operation. Conclusion NTN validation requires both controlled simulation and real-satellite verification. Accuver delivers a structured, end-to-end NTN validation solution that enables reliable deployment, efficient troubleshooting, and continuous optimization of satellite-based networks.
Jan 19, 2026
-
- XCAP-Based Connectivity Characterization for D2C and NTN Environments
- Analyzing communication performance in Direct-to-Cell (D2C) and NTN environments is inherently complex due to continuously changing satellite orbit, geometry, and RF conditions throughout a satellite pass. Interpreting UE measurement logs solely at the KPI level is insufficient to explain why connectivity is established, maintained, or lost. Effective analysis requires correlation of measurement data with satellite motion and observation conditions along common time and spatial axes.XCAP provides an analysis environment that correlates UE measurement data with satellite orbit, geometry, and Doppler behavior, enabling condition-based interpretation of connectivity behavior in NTN environments. This approach allows complex satellite connectivity phenomena to be analyzed beyond standalone KPI outcomes, focusing instead on the conditions under which they occur.1. Satellite KPI VisualizationXCAP automatically reconstructs satellite position, orbit, and observation KPIs for past measurements based on recorded satellite communication data. This enables examination of satellite environment conditions and communication quality at the exact time of measurement within a unified analysis view.Such visualization allows RF KPIs to be interpreted not as isolated performance values, but in the context of the satellite’s elevation and azimuth at the time of observation. As a result, identical KPI values can be distinguished based on differing satellite geometry conditions, supporting more accurate interpretation of connectivity behavior.- 3D Satellite Map : Visualizes time-based satellite orbit movement together with communication measurement data- Polar Phase Map : Displays satellite trajectory using Elevation and Azimuth for observation condition analysis- RF KPI Summary : Provides RSRP, SINR, Handover, and other major RF KPIs based on measurement logs- Satellite KPI Summary : Shows changes in tracking KPIs observed during the measurement period2. 5G NTN Satellite Test AnalysisXCAP analyzes UE connectivity behavior as satellites enter and move through the field of view, identifying which satellite the UE was connected to at each moment and under what conditions connectivity was retained or lost. By correlating log data with time-varying satellite geometry, the analysis characterizes connectivity behavior under realistic D2C and satellite mobility scenarios.Connectivity events such as service loss, RSRP degradation, and handover are aligned with satellite trajectory, enabling recurring event patterns to be identified along specific orbital segments rather than treated as isolated occurrences. This supports interpretation of UE connectivity behavior as a continuous process across a satellite pass. - Classification of RRC Measurement Report events by time, location, and event type - Analysis of handover delay and mobility-related conditions - Evaluation of satellite link retention time - Examination of link variability caused by satellite movement or environmental factors3. Doppler Effect AnalysisLEO satellites introduce significant Doppler frequency shifts due to high orbital velocity. XCAP provides dedicated analysis capabilities to evaluate Doppler variation and its impact on connectivity stability.Doppler variation is analyzed as a function of satellite geometry, enabling differentiation between Doppler-induced effects and RF performance changes driven by propagation or environmental factors. Alignment of measured KPIs with TLE-based orbital models further allows comparison between expected and observed performance trends along a satellite pass. - Analysis of Doppler frequency shift during satellite communication - Correlation of signal variation with satellite Elevation and Azimuth - Presentation of satellite observation KPIs aligned with Doppler behavior - KPI prediction and comparison using TLE-based orbital models - GPS-based orbit mapping for geometry-to-KPI correlationConclusionXCAP treats UE connectivity behavior in satellite-based networks as a function of orbital motion, geometry, and Doppler conditions rather than isolated KPI outcomes. This enables more precise interpretation of NTN and Direct-to-Cell connectivity characteristics, supporting condition-based understanding of connectivity behavior in dynamic satellite environments.
Nov 24, 2025
-
- Transforming In-Building Benchmarking: Automated Multi-Terminal Analysis Powered by XCAP
- In-building benchmarking often relies on data collected from multiple operators and mixed terminal environments. When measurements lack consistent metadata or synchronization, post-processing becomes slow, manual, and error-proneㅡmaking it difficult to generate unified and repeatable building-wide KPI results, particularly in multi-operator scenarios. Customer Challenge Traditional in-building workflows force engineers to manually align logs, classify floors, and prepare operator comparison reports. Multi-device sessionsㅡeach with different measurement modes, timestamps, or metadataㅡfurther increase complexity and reduce efficiency. Producing a consistent, building-level analysis therefore demands significant manual effort and is difficult to scale. XCAP Solution XCAP eliminates these inefficiencies by automating core in-building analysis tasks. The platform consolidates logs from diverse terminals, aligns them to a unified building structure, and generates standardized outputs within minutes. With automated classification, comparison, and KPI processing, XCAP delivers a scalable, repeatable, and operator-agnostic indoor testing workflow. Key Capabilities1. Get In-building Data Imports floor plans and in-building statistics from another log model and applies them to sessions that lack in-building metadata.- Supports mixed terminal environments- Time Offset option aligns logs with minor timestamp differences- Same-time validation ensures data integrity 2. Automated Floor Classification Automatically detects and separates measurements by floor, reducing manual review and accelerating analysis for multi-story buildings. 3. Multi-Operator Delta Comparison Generates reference-based delta coverage and differential KPI charts, enabling fast and accurate operator-to-operator evaluation on a unified layout. 4. Spatial Binning Creates virtual analysis grids for zone-level KPI evaluation (RSRP, RSRQ, SINR), improving readability and precision for location-based comparisons. 5. Unified KPI Statistics Provides building-level and floor-level summaries, including:- Technology distribution (5G SA/NSA, LTE)- Signal strength and quality indicators- Floor-specific coverage visualization Conclusion XCAP streamlines in-building benchmarking by reducing post-processing time, standardizing reporting across diverse logs, and improving the accuracy of multi-operator comparison. With automated data integration and consistent, repeatable reporting, engineering teams can identify coverage gaps and performance issues more quicklyㅡallowing them to focus on network optimization rather than manual log alignment.
Nov 24, 2025
-
- Connectivity, and the Future of Vehicle Safety: From Euro NCAP Incentives to Global Mass Rollout
- The automotive industry is entering a new phase in which connectivity is no longer viewed as an optional feature but as a critical enabler of road safety. With Euro NCAP’s decision to include connectivity in its safety rating framework starting in the near future, connected vehicle technologies are gaining formal recognition as part of a vehicle’s overall safety performance. This upcoming change is expected to accelerate the adoption of Vehicle-to-Everything (V2X) technologies, placing them at the center of global automotive strategies. Background: Connectivity and Vision ZeroThe European Union’s Vision Zero initiative, which aims to eliminate road fatalities by 2050, has made connectivity a cornerstone of its strategy. By enabling vehicles to share and receive real-time hazard information, connectivity reduces the likelihood of accidents caused by unforeseen road conditions, limited visibility, or delayed human reactions. Euro NCAP, a widely influential vehicle safety assessment program, has announced that connectivity will be incorporated into its star rating system. While not yet enforced, this policy change provides a clear signal to automakers: future ratings will reward vehicles equipped with connectivity features, and consumer demand will follow.Industry Implications OEMs1. Incentive to integrate connectivity features to achieve higher Euro NCAP ratings.2. Easier internal justification for investment since higher ratings influence sales.3. Need to ensure interoperability and participation in shared data ecosystems. Regulators and Road Authorities1. Gain access to real-time hazard and traffic data from connected vehicles.2. Enhanced ability to manage infrastructure safety (e.g., roadworks, weather, wrong-way driving). Customers1. Receive earlier warnings of hazards such as slippery roads, obstacles, or congestion.2. Benefit from safer vehicles without relying on paid services or third-party apps. Industry Ecosystem1. Establishes a data-sharing culture where safety information flows across brands.2. Accelerates market readiness for advanced applications (e.g., emergency vehicle alerts, end-of-queue warnings, sensor data fusion). This announcement sets the stage for rapid adoption. Historically, once Euro NCAP introduces new assessment categories, they quickly become industry standards. Connectivity is expected to follow the same trajectory, from incentive, to widespread adoption, to potential regulation.Accuver’s Role in the Connectivity EcosystemAccuver contributes to the evolving connectivity and V2X ecosystem by providing comprehensive, end-to-end solutions that bridge today’s testing needs with tomorrow’s deployment challenges:- V2N Solutions: Developed in collaboration with leading automotive electronics companies, Accuver enables secure and scalable Vehicle-to-Network integration for connected services.- V2X Modules: Provide reliable, standards-compliant connectivity for vehicles, enabling seamless communication across V2V, V2I, and V2N use cases.- V2X Test Solutions: Cover both physical layer and application layer validation, ensuring interoperability and performance under both real-world and lab conditions.- On-Board Units (OBUs): Extend connectivity to vehicles without integrated V2X modules and support Vulnerable Road Users (VRUs), ensuring broader ecosystem inclusion.- eCall Testing Automation: Automates the manual eCall validation process, delivering higher efficiency, repeatability, and accuracy in ensuring compliance and functional reliability.By offering these solutions, Accuver helps automakers, regulators, and technology providers validate, deploy, and scale connected safety systems. This ensures that connectivity is not only a rating requirement but also a reliable, interoperable, and future-proof component of the road safety ecosystem. ConclusionConnectivity has not yet been fully implemented into Euro NCAP’s rating system, but its planned inclusion signals a clear direction for the industry. V2X technologies are poised to become a core component of vehicle safety, with profound implications for automakers, regulators, and consumers. Accuver’s role is to accelerate this transition. Through V2X modules, OBUs, and comprehensive testing platforms, Accuver equips the industry with the tools required to validate technologies today and prepare for their integration into global safety frameworks tomorrow. By enabling reliable, interoperable, and scalable deployments, Accuver turns policy announcements into measurable road safety outcomes, fully aligned with the long-term goals of Vision Zero.
Oct 22, 2025
-
- [Case Study] XCAL-VQML Deployed at Major Network Vendor’s R&D Center
- The rapid growth of video-based communication, ranging from streaming services to enterprise conferencing, has made video quality assurance a critical requirement for operators and telecommunication equipment vendors. Unlike traditional KPIs such as throughput or latency, video quality is inherently subjective and influenced by multiple factors at device, service platform, and network levels. - How does the network affect actual video quality as perceived by end users?Traditional testing approaches, which rely on physical cameras or manual MOS evaluations, made it difficult to:- Eliminate environmental variables such as lighting or device handling.As a result, the R&D team struggled to build confidence in their ability to benchmark video service quality under real-world conditions accurately.XCAL-VQML OverviewAccuver provided the XCAL-VQML solution, an AI-based video quality assessment framework designed to deliver accurate MOS values without requiring original reference videos.Key capabilities included:AI-powered MOS Prediction:Supports widely used services such as YouTube, WhatsApp, WeChat, Skype, Microsoft Teams, etc., reflecting actual end-user experiences.Controlled Measurement Environment:OutcomeThe deployment produced tangible results:- Repeatable MOS values were achieved, proving that XCAL-VQML could reliably measure how the network impacts perceived video quality.These results demonstrate that XCAL-VQML produces reliable and reproducible video quality scores, even under varying device or application conditions. - Understand the real impact of network conditions on video quality.- Accelerate innovation in video communication in the mobile network.ConclusionFor this usage, the deployment of XCAL-VQML transformed a critical challenge into a breakthrough success. What began as doubts about how to measure video quality ended with a proven framework for reliable, scalable testing.
Sep 25, 2025
-
- [Case Study] XCAL-Ranger: Continuous 24/7 Measurement Across Train, NTN, and Private 5G
- With the rapid evolution of 5G, private networks in industrial environments and NTN communication, the demand for automated, robust, and scalable monitoring solutions is increasing worldwide. Ensuring reliable connectivity is now a critical requirement not only for consumer satisfaction but also for mission-critical applications across transportation, satellite, and smart manufacturing sectors. XCAL-Ranger addresses these emerging needs by providing continuous, 24/7 monitoring and control in even the most challenging environments. 1. Continuous Network Quality Monitoring in Transportation (Rail, Metro, Maritime)Transportation systems such as trains, subways, and ships require stable connectivity to ensure both passenger satisfaction and operational safety. XCAL-Ranger enables continuous and automated measurement of network quality by being mounted directly onto moving vehicles. Challenges- Harsh environments such as tunnels, underground stations, and offshore conditions can impact measurement stability- Maintaining reliable installation and stable power supply on moving vehicle- Data synchronization and remote monitoring may require robust Backhaul connectivityApplication- Mounted in trains or subways, it collects service quality data while moving through tunnels, stations, and high-speed tracks- Installed on ships or ferries, it monitors coastal and offshore coverage, detecting areas of weak or unstable connectivity- Data can be integrated into passenger information systems, safety applications, or QoS dashboards for operatorsBenefits- Identify coverage gaps and service blind spots in real-time- Support network optimization projects by correlating measurement results with passenger complaints- Supports compliance with regulatory standards while enhancing passenger experience- Ensures robust, stable, and 24/7 monitoring and control even in harsh and mobile environments2. Automated Testing of Direct-to-Device (D2D) Satellite Communications with LEODirect-to-Device (D2D) satellite communication with Low Earth Orbit (LEO) constellations enables smartphones and IoT devices to connect directly to satellites. Such communication windows are short and dynamic, requiring automated, scheduled testing. Challenges- Satellite pass times are short and require precise scheduling for meaningful testing- Environmental factors such as weather or urban obstructions can interfere with satellite signal acquisition- Logging and analyzing intermittent test data requires advanced automation and coordinationApplication- XCAL-Ranger is configured to periodically attempt satellite connections whenever a LEO satellite passes overhead- Automated tests include signal acquisition, call attempts, and data session initiation with direct-to-device satellites- Logs are uploaded remotely for performance evaluation of LEO network readinessBenefits- Provides continuous validation of satellite coverage in test locations without human intervention- Enables R&D; teams and operators to benchmark satellite service performance- Reduces missed test opportunities caused by unpredictable satellite pass timings- Guarantees robust, stable, and 24/7 automated testing of satellite communication, even under unpredictable conditions3. Assurance of Private 5G Networks in Smart FactoriesPrivate 5G networks are increasingly deployed in industrial environments to support automation, robotics, and mission-critical communications. Ensuring stable network performance in such dynamic environments are essential. Challenges- Factory environments are subject to heavy interference from machinery and structural obstacles- Maintaining continuous monitoring across large and complex sites can be resource-intensive- Security and privacy concerns may arise when integrating monitoring solutions into operational networksApplication- XCAL-Ranger is deployed across a smart factory floor to run continuous performance checks- Automated test scripts validate connectivity, latency, and application service performance for AGVs, robots, and wireless sensors- Device status and performance data are centrally monitored through the XCAL-Manager platformBenefits- Guarantees that 5G-enabled devices operate seamlessly in production environments- Reduces downtime by proactively detecting network degradation- Provides auditable network performance reports for enterprise customers and regulators- Delivers robust, stable, and 24/7 monitoring and control, ensuring reliability in demanding industrial settings XCAL-Ranger transforms traditional, labor-intensive network testing into a fully automated, scalable, and reliable monitoring system. Whether in transportation systems, satellitecommunications, or smart factories, XCAL-Ranger ensures robust, stable, and around-the-clock monitoring and control even in the most challenging environments making next-generation connectivity truly dependable.
Sep 24, 2025
-
- A Comparative and Measurement-Based Study on Real-Time Network KPI Extraction Methods for 5G…
- Turkcell, Turkiye’s leading telecom provider, has advanced its 5G research using Accuver’s XCAL to evaluate real-time KPI extraction from 5G networks. This study highlights XCAL’s accuracy, fast refresh rate, and stable performance in measuring key indicators like RSRP, RSRQ, and SINR.XCAL’s advanced features enabled precise and reliable analysis, offering a key competitive advantage in 5G performance evaluation. The full paper is available on arXiv for those seeking more insights.We sincerely thank Turkcell, one of our key customers, for their continued research efforts in advancing 5G innovation with XCAL.
Jun 11, 2025
-
- [White Papers] AI-powered RCA
- Table of contents1. Introduction 2. What is AI RCA? 3. Technology applied to model. 4. Learning and evaluation 5. XCAP-Cloud with AI Powered RCA6. Use Cases 7. Future Directions *Under R&D collaboration with Korean MNOs IntroductionWith the rapid development of wireless communication technology, ultra-high data transmission speeds and connections to various devices increase, the communication environment is becoming more diverse and complex. Accurate and rapid response to communication system failures resulting from this diversity and complexity is essential. To address these market demands, we provide automated wireless network optimization testing solutions as well as logic-based RCA solutions that identify the causes of various defects that occur in mobile communication networks and provide appropriate solutions.Our logic-based RCA solution utilizes wireless network communication protocol transmission/reception information and terminal status information to accurately identify and resolve problems through structured data and rule-based analysis. However, in this advanced communication system, parameter settings for each analysis rule are complex, and it is difficult to consider characteristics of the field situation, limiting rapid response.To overcome these limitations, we developed a machine learning-based RCA solution. By utilizing the latest machine learning technology to learn subtle differences in the network environment hidden in the vast amount of data collected from mobile communication networks, large-scale data can be quickly analyzed and diagnosed based on the data without relying on individual subjectivity. This is expected to contribute to improving the stability of communication systems. What is AI Powered RCA? Our solution is a machine learning-based RCA solution that utilizes our automated testing solution to perform root cause labeling using raw data obtained from network access failure and service interruption log samples. The training dataset contains the network\'s signal level and quality indicators, as well as network quality indicator metrics such as data throughput, latency, and packet loss rate for each layer.Figure1. AI RCA concept diagramThis training dataset consists of approximately 1 million log data, including network issues that occurred in various environments during field testing. This data is collected through a variety of methods, including field testing, simulation testing, and laboratory testing, to reflect the complexity of network problems. To address the complexity of the problem presented by strong correlations between key indicators, our model minimizes similarities between data characteristics and learns each root cause individually to enable accurate classification and understanding.Additionally, machine learning has the characteristic of being capable of continuous learning and improvement. This means our solutions can continuously optimize and improve models to respond to new challenges that arise during real-world operations. This offers great advantages in maintaining reliability in a rapidly changing communications environment.Additionally, AI\'s automated decision-making capabilities help quickly process and diagnose large amounts of data. Our model supports efficient and accurate communication system problem solving while minimizing individual subjectivity through data-based judgment.These technical advantages allow our solutions to leverage the powerful analytical power of machine learning to help improve network reliability and improve availability and performance. Figure2. Examples of data set Technology applied to AI Model We adopted a gradient boosting ensemble model using XGBoost and developed a powerful tool for effective root cause diagnosis. XGBoost is applicable to both classification and regression problems and is particularly characterized by excellent performance for a variety of data sizes and types.Figure3. XGBoost concept diagram XGBoost features provide excellent performance for a variety of data sizes and types. This is very useful as we deal with large amounts of network issue data from a variety of environments. The model learns useful patterns from large amounts of data and can effectively identify root causes. Additionally, XGBoost uses parallel processing and optimized data structures to provide fast learning and prediction speeds. This is a big advantage of XGBoost\'s fast learning and prediction capabilities to quickly respond to various problems that occur in large-scale networks.For root cause diagnosis, prioritizing each characteristic and creating each XGBoost model based on this increases the interpretability of the model and provides a clear understanding of the characteristics of each root cause. Through these feature priorities, the model learns the importance of features for each root cause and enables effective response to the complexity of the problem.In this way, our model using XGBoost combines strong prediction ability with fast response speed to achieve efficient root cause diagnosis. Leaning and evaluation process Figure 4 shows the learning and evaluation process. First, the data is purified through data preprocessing. Duplicate data is removed, and outliers and missing data are replaced with the most prevalent value in each data set. Lastly, for data imbalance, down-sampling using Euclidean distance calculation and up-sampling using SMOTE are performed to balance the data.In the Euclidean distance calculation method, the distance of points other than the root cause label is compared one-to-one based on the center point in the distribution of the root cause label. After comparison, points that are judged to be too far from the distribution of the root cause label are removed, leaving only the points that exist as close to the boundary as possible. The SMOTE method synthesizes adjacent minority class samples between majority class samples. This increases the number of samples of minority classes, helping the model learn better and recognize minority classes better.Figure4. Training process and evaluation processAfter performing this preprocessing process, an XGBoost model according to each priority is created and trained and verified. During verification, a grid search technique is used to find the most appropriate hyperparameters for the model. If you input the data set you want to test into the learned RCA solution, you can get results where the root cause label predicted by the model matches the actual root cause label.The evaluation results are as follows: It was derived as the average accuracy value of each model. Total countSuccess countFail count Accuracy 5G-NR PS 27365242433122 88.59% 5G-NR Voice29903 25376 4527 84.86% LTE PS90505 82813 7692 91.50% LTE Voice29501 26958 2543 91.38% Total177274 159390 17884 89.91% Figure5. AI model evaluation results XCAP-Cloud with AI-powered RCA AI-powered RCA is provided by XCAP-Cloud, a cloud-based mobile network analysis solution. We use test equipment to collect data generated from the telecommunications carrier\'s mobile communication network. Collected data is uploaded to the server in log form. Users can define rules to identify specific patterns in logs and send them to the AI model when those patterns are found. Logs must be interpreted before being fed into an AI model. Log interpretation involves understanding the contents of the log and extracting KPIs. Interpreted logs and extracted KPIs are sent to the AI model through grpc. grpc is a protocol for efficient and reliable data transmission. ARCA infers the root cause based on the received data.Inference results can be checked using various visual tools provided by XCAP-Cloud. Visual tools help you intuitively understand inference results. Figure6. XCAP-Cloud The accuracy of AI prediction results extracted in real time from the XCAP-Cloud system equipped with an AI-powered RCA solution was observed to be 97%. Figure7. Real-time AI prediction accuracy Use Cases All issues that may arise in the 5G/LTE environment are categorized and managed through RCA, and each event is labeled to help easily identify the root cause. VoNR Call Setup Failure CaseVoice services using 5G RAN, 5G Core, and IMS are called Voice over New Radio-VoNR. NR UEs can perform voice services directly on the NR network without falling back to the LTE network. VoNR Call Setup Failure can occur for a variety of reasons. In the initial network construction stage, Cell Search failure, PDCCH Decoding error, IMS Registration failure, etc. are the main causes that can cause problems in which the terminal cannot connect to the network or register with the IMS server. This solution can quickly classify the problem by extracting the cause of cells that cause many setup failures. VoNR Call Drop CaseAs a mobile communication system, even if the initial setup is successful and the call is connected normally, a call drop may occur when entering the cell edge or when handover occurs due to RF deterioration or when the settings of the source cell and target cell cannot maintain connectivity. can. In addition, even though information about neighboring cells is searched periodically, when a call must be continued without finding a suitable cell, a large amount of RTP packets is lost, and the network reclaims radio link resources to cause a call drop. can. This solution can help you accurately analyze call drops. By additionally checking the packet data and Layer3 messages provided within XCAP-Cloud, you can quickly identify problems and take appropriate action. Figure8. RCA Workflow NR FTP Low Throughput CaseNR FTP Low Throughput CaseAfter the normal call setup process is performed in 5G NR, you may experience quality issues in data calls such as FTP and HTTP with processing speeds lower than expected.Typically, degraded RF performance may indicate low throughput, while normal RF performance may indicate parameters related to throughput and capacity. It can be caused by various reasons such as UL/DL bandwidth, MCS, Layer, Rank Index, etc.This solution can help with accurate analysis by extracting the cause of low RB allocation that occurs in the network and the resulting low throughput cases. Future Directions We aim to provide intuitive and versatile solutions to diagnose wireless network problems quickly and accurately.A successful AI model must not only achieve high accuracy, precision, and recall, but also ensure reliable prediction performance at a level that actual customers can use as wireless network analysis indicators. To achieve this, AI models must learn the know-how of highly skilled wireless network analysis experts and continuously evolve.Our goal of a wireless network analysis know-how training system is to build a customer-tailored AI model learning infrastructure to provide a system that allows customers to directly discover data sets and upgrade AI models. Through this, concerns about personal information and data leaks can be resolved, and AI models that meet customer needs can be built more effectively.In addition, if only data from the wireless network connection section of the mobile and base station is used, the root cause of the failure due to problems with the upper layer access probe or core probe may be unclear. Therefore, there is a need to develop it into a comprehensive learning model from end to end. We will continue to take on this challenge without stopping.Figure9. Customer-tailored AI model learning system
Jun 05, 2024
