Automation Framework | Domestic Network Testing

Search Blog About us
  • Products
  • Solutions
  • Services
  • Events
  • Knowledge

Roaming & Core Network

Risk Management

Network Security

Testing & Monitoring

Engagement & Experience

5G

Internet of Things (IoT)

VoLTE

MVNO

Cable MSO

5G

Service & Network Assurance

Check our Services

Meet our team in the next event

Check out our exclusive insightful content

What are you looking for?

Automation Framework for accelerated service assurance capabilities

To face today’s extremely complex networks, like IoT and 5G, network virtualization, a multitude of devices, protocols, and new and legacy services, all running in parallel, Mobileum developed the Automation Framework, a tool to reduce the challenges with network design, technology integration, deployment, operation, and maintenance, thus minimizing the risks of network or service failure. AF enables lab and production teams to automate manual testing and monitoring processes at all stages of the network lifecycle, from design to deployment and operations. It includes the capability to run variants of existing test cases (5G, IoT, voice, data, messaging, etc.), and allows power users to define new test cases or scenarios by simply using keyword-driven scripting on top of a group of testing building blocks.

AF augments end-to-end active test data with input from third-party tools to quickly troubleshoot multi-vendor networks and complex service issues, thus guaranteeing service performance and availability.
Automation Framework Mobileum

Boost your continuous testing with CI/CD/CT

Mobileum’s Automation Framework can work standalone or be easily integrated into larger automation processes such as CI/CD/CT pipelines, where the addition of a continuous testing component is vital. To provide even more flexibility, our AF works in tandem with the proven Mobileum's SITE testing scenarios using RESTful APIs that allow users to automate the system and extract data generated from periodic tests and automation tasks. With the SITE RESTFul API and the Application Framework, users can:
  • Automate tasks from third-party systems based on user input or automated process, e.g. after a software upgrade
  • Pull data and result files from the SITE system
  • Integrate the SITE platform into their operational process, e.g. create chat-bots, build web-applications for performance monitoring, etc.
Continuous Integration Continuous Deployment

SITE Automation Framework

Accelerate innovation, improve customer experience, and reduce operational costs
Download Datasheet

Orchestrate and execute even the most complex test scenarios

Manual processes can no longer address increasingly more complex products and networks. With virtualization, different building blocks from different vendors can be combined and software upgrades and roll-outs are delivered at a faster pace to constantly deploy new services. AF supports automated end-to-end testing strategies, allowing production or lab automation-testing tasks, such as:
  • Automate manual processes, e.g. health or status check process, Method of Procedure (MOP)
  • Run active testing, periodic or ad-hoc
  • Trigger service acceptance test procedures
  • Design and execute user acceptance testing
  • Integrate and share data between 3rd party systems via RESTful APIs
Automation Framework use cases

How does Automation Framework work?

With Mobileum's AF, engineers can automate a wide range of operational, testing, and troubleshooting tasks.

Mobileum's Automation Framework provides among other features:
  • Keyword-driven test implementation with proprietary and open-source libraries
  • RESTful API Integration with 3rd Party Tools
  • Web Application automation with Selenium
  • Leverage SITE's end-to-end active testing capabilities (5G performance testing, IoT testing, etc.) 
Automation Framework solution

Keyword-driven scripting for flexible automated testing

Mobileum’s Automation Framework provides a wide range of low-level building blocks to create various automation tasks using simple, keyword-driven scripting, thus achieving more concise, maintainable, and flexible testing.

Leveraging more than 30 years of SITE expertise, AF offers a library of keywords associated with actions or functions, which can be used and reused to build a wide range of test scenarios. AF also accepts keywords from well-known open-source libraries provided by Robot Framework. Own libraries can be created. Existing test cases can be simply parametrized and run ad-hoc or periodically depending on the use case.

The key advantages of the SITE Automation Framework are:
  • Create their own, keyword-driven automation test tasks
  • Define expected output values and map verdicts to outputs
  • Customize reports and KPIs 
  • Access a wide range of libraries to build automation tasks
  • A state-of-the-art web interface to parametrize and schedule already defined automation test cases
  • Integrate the automation tasks with third-party systems using SITEs RESTFul API

See how Mobileum can help protect & grow your business

Over 900 Telecom companies, in more than 150 countries, are scaling their business with Mobileum solutions.
Request a demo Request a meeting

Simple and collaborative automated testing with third-party tools

To successfully deploy and run today’s networks, operators need to rely on an ecosystem of technologies, often using multi-vendor implementations and multiple testing tools incapable of aggregating results into one single version on performance. This scenario creates an operational overhead as engineers interact with disparate tools individually for performance analysis, troubleshooting, or any other monitoring task.

SITE's Automation Framework enables users to integrate third-party tools, systems, and platforms into their automation process, simply using RESTful APIs calls and SITEs's RESTful APIs as part of the automation task.

Key advantages of AF's collaborative automated testing:
  • Easily integrate RESTful API calls in the automation tasks, e.g. augment E2E test data with passive traces
  • Provide system abstraction with its own SITE RESTful API towards the third-party platform, e.g. chatbot integration
  • Reduce troubleshooting times by providing more data to engineers
Automation Framework integrating with third-party tools

Automated PCAP file analysis with RoboShark

Mobileum's RoboShark fully automates PCAP analysis in SITE and SiC deployments, by eliminating complex, time-consuming, repetitive, and error-prone manual drill-down analysis,  thus decreasing OPEX. It automatically searches for test cases with PCAP, dissects the PCAP for relevant information, generates KPIs, and triggers alarms. How:
  • Write your Wireshark analysis into an automation script (once)
  • Define matching filter for tests (once)
  • Enable RoboShark (once) 

RoboShark will then automatically and periodically:
  • Search for all new matching tests with PCAP
  • Apply filters
  • Analyze the PCAP files from tests
  • Compare values
  • Generate KPIs
  • Allow for reporting of aggregated results or trigger alarms 
 

Automation Framework and Active Testing Capabilities

Leverage Mobileum's SITE end-to-end active testing capabilities

Mobileum's SITE is an all-in-one testing and monitoring solution, covering all services and technologies from a single platform. Our new Automation Framework includes the capability to create and deploy variants of existing SITE test cases, such as:
  • 5G performance testing
  • IoT and eSIM Testing
  • Voice, data and messaging testing
  • IMS service testing
  • Emergency services testing 

Mobileum's SITE generates real-time traffic into the network to emulate the real subscriber behavior. Probes are connected to our analytics platform and placed strategically throughout the network to provide geographical coverage, fault localization, and alarms.

Know more
Automation Framework and Active Testing Capabilities

SITE is an integral part of MAS, an E2E service assurance solution

The SITE Active Testing Platform is part of Mobileum Assurance Solution (MAS), an intelligent platform that supports DevOps and CI/CD/CT, optimizing root cause analysis and enabling operators to perform network upgrades and fully test new releases, automated as needed, in the lab, in the production network before deployment, and then to re-test them in the network to ensure quality and performance, avoiding glitches before any customer impact.

MAS gives 360° insights on service quality from both customer experience and network performance by generating a cross-correlation analysis across the network, user KPIs and service KPIs. It provides the complete customer experience view with 24/7 real-time analytics of individual subscriber digital activity.

6 key benefits of Mobileum’s Automation Framework solution

Enrich data from your active E2E Testing
Enrich data from your active E2E Testing
Aggregate relevant information from core network elements or other monitoring tools to ensure quality across the service delivery chain.
Create virtually any test scenario
Create any test scenario
Address any testing use case using keyword-based scripting wiht SITE Libraries and Robot Framework to create test cases.
Automation Framework API
Automate or integrate via RESTful API
The AF and SITE provide tools to automate third-party systems while opening its own RESTful API to allow automation from the outside.
Full access to SITE’s test interface
Full access to SITE’s test interface
Create test scenarios across all technologies from 2G to LTE, IoT, and 5G over radio access, smartphones, or core network interfaces, as well as fixed line and IP.
Tailored for all users and departments
Tailored for all users and departments
Power users can configure and modify test scenario scripts and quickly perform ad-hoc testing using a Web UI by parametrizing and executing existing test definitions.
Comprehensive results and KPIs
Comprehensive results and KPIs
Get insights into service availability and performance, network status, regressions results, and service stability across the entire service delivery path.

Leveraging other products in our Portfolio

5G Performance Testing
5G was specifically designed to meet IoT needs, whereas 2G, 3G and 4G were never developed with IoT in mind. It brings two key attributes which neither NB-IoT nor LTE-can deliver; they are: low latency and ultra-reliability. Know more about our 5G testing solutions and how they support IoT environments.
Know more
Smartphone Experience
For the ongoing monitoring of communication service providers (CSP) customer's experience and continued end-to-end testing of your 5G services, Mobileum test automation supports flagship 5G smartphone performance when it comes to measuring, monitoring and benchmarking network services and APP performance using 5G enabled devices. 
Know more
eSIM assurance
IoT & eSIM Testing
With eSIM there is no need to physically install or replace potentially millions of SIM cards.  Mobileum ensures eSIM functionality for connected cars, other M2M devices as well as consumer devices. It verifies service availability and performance via remote over-the-air services testing that ensures the provisioning and enabling/disabling of operator profiles. 
Know more