1 of 100

ONES-3.0

Open Networking Enterprise Suite (ONES)

Introduction and Overview

Open Networking Enterprise Suite (ONES) is a Network Orchestration, Visibility, and Assurance solution for multi-vendor and multi-NOS operated Network Infrastructure. ONES provides a one-stop solution from delivering deep visibility into your datacenter networks to extending 24x7 support functions for SONiC. It also hosts a powerful analytics engine that assists users to identify network issues and troubleshoot their networks, in case of common network anomalies and disruptions.

ONES uses Auto-discovery for SONiC devices and a YAML or CSV-based template for adding non-SONiC devices during the onboarding process and continuously collects streaming telemetry data from them to provide insights on:

Data Center Inventory
Network State
Platform and System Health
Control and Data Plane resource Utilisation

ONES monitors various control and data plane metrics to provide these insights.

Rule Engine

ONESv3.0 application has the capability to trigger notifications via Slack app notifications when certain user-defined threshold values are breached.

In data centre operations, a rule engine with alerts for various metrics is essential for proactive monitoring and management of critical components and services. Rule Engine pushes the configured rule notification in case any device breaches the threshold value configured under the rule to SLACK Channel, Zendesk Support and ServiceNow Ticketing Service integration

Let's see the different types of rule engine metrics for specific Entity/features in a data centre environment

CPU and Memory Utilisation
Fan and PSU LED status
Traffic Bandwidth
ASIC Routes

ONES Orchestration

ONES orchestration provide network admins to automate the fabric configuration using configuration templates for provisioning physical interfaces, layer 3 configuration for building IP-CLOS fabric using

BGP as a routing protocol including BGP-unnumbered
Symmetric/Asymmetric IRB
BGP Peering with PO
L2/L3 MC-LAG

ONES orchestration not only configures the fabric but also make sure the Fabric is operational by doing verifying the configuration at every stage.

ONES provides north bound API access for configurations originating from external orchestration tools.

Data Lake

A data lake is a centralized repository that allows you to store vast amounts of structured, semi-structured, and unstructured data in its raw format. Unlike traditional data warehouses where data is stored in a structured manner, a data lake retains the data in its native format until it's needed for analysis or processing. ONES provide the capability to store the RAW data of all the Metrics to Cloud and then user will be able to use that RAW data for any deployment or any other use cases.

Here are key components and characteristics of a ONE DL.

Storage of Diverse Data Types: A data lake can store various types of data, including structured data (like relational databases), semi-structured data (like JSON, XML), and unstructured data (like documents, images, videos). This flexibility allows organizations to ingest and store data from different sources without the need for extensive preprocessing.
Scalable and Cost-Effective Storage: Data lakes are typically built on scalable storage systems, such as cloud-based object storage (e.g., Amazon S3, Azure Data Lake Storage) or Splunk . These systems can efficiently handle large volumes of data and offer cost-effective storage solutions.
Schema-on-Read Approach: In contrast to traditional data warehouses that use a schema-on-write approach (where data must be structured and conform to a predefined schema before storage), data lakes adopt a schema-on-read approach. This means that data is stored in its original form, and the schema is applied at the time of data retrieval or analysis. This flexibility allows users to apply different schemas and interpretations to the same dataset based on their analytical needs.

In summary, ONE DL provides a flexible and scalable platform for storing, managing, and analyzing diverse data types at scale. By leveraging a schema-on-read approach and supporting various analytics tools, ONE DL facilitate advanced data analytics and enable organizations to derive valuable insights from their data assets. However, proper governance, security, and metadata management are crucial to ensure the usability, reliability, and integrity of data lakes.

ONES Time Scale Metric Calculation

Overview

ONES Agent pushes all the telemetry at every 20 seconds to the ONES Collector, so DB will have the values of every 20sec, Further as per time series selection ONES-UI plots the Graph with different average values.

Below are the Average values Calculated by ONES-UI as per Time-Scale:

ONES Rule Engine

Overview

In data center operations, a rule engine with alerts for various metrics is essential for proactive monitoring and management of critical components and services. Let's discuss the need for rule engine alerts for specific metrics in a data centre environment

CPU and Memory Utilisation
Fan and PSU LED status
SSD Memory Utilization, Health and Temperature Status
Traffic Bandwidth
ASIC Routes
Health Services
Device Down alerts
BGP Neighbour Down alter
Component failure
Interface Flap Alerts
Traffic Errors and Discard Counters
PFC Counters
Device Queue Counters

Rule engine alerts ensure efficient resource utilization, timely troubleshooting, early detection of potential issues, and overall operational stability within the data centre environment.

Notification

ONES-App is capable of triggering breached threshold values to

Slack Channel
Zendesk Support
ServiceNow

Rules are categorized based on the metric hierarchy

Device Level
Interface Level

List of all the Metrics Supported by Rule Engine with possible units and measured value a user can use

ONE DL

Data Lake

Here are key components and characteristics of a ONE DL 1.0.0

Storage of Diverse Data Types: A data lake can store various types of data, including structured data (like relational databases), semi-structured data (like JSON, XML), and unstructured data (like documents, images, videos). This flexibility allows organizations to ingest and store data from different sources without the need for extensive preprocessing.
Scalable and Cost-Effective Storage: Data lakes are typically built on scalable storage systems, such as cloud-based object storage (e.g., Amazon S3, Azure Data Lake Storage) or Splunk . These systems can efficiently handle large volumes of data and offer cost-effective storage solutions.
Schema-on-Read Approach: In contrast to traditional data warehouses that use a schema-on-write approach (where data must be structured and conform to a predefined schema before storage), data lakes adopt a schema-on-read approach. This means that data is stored in its original form, and the schema is applied at the time of data retrieval or analysis. This flexibility allows users to apply different schemas and interpretations to the same dataset based on their analytical needs.

In summary, ONE DL provides a flexible and scalable platform for storing, managing, and analyzing diverse data types at scale. By leveraging a schema-on-read approach and supporting various analytics tools, ONES DL facilitate advanced data analytics and enable organizations to derive valuable insights from their data assets. However, proper governance, security, and metadata management are crucial to ensure the usability, reliability, and integrity of data lakes.

ONES Cloud Service Integration

As of now ONES support 2 different platforms where customer can get the RAW data

Splunk
Amazon S3

Users can control the behaviour of the Catalog

Users will have the option to tune the frequency of streaming the metric to the cloud platform, user will have the option to tune frequency starting from 1 minute to 60 minutes.

Users can select/unselect the Network state metrics using the above catalogue option

ONES Supportability

AVIZ Support Overview

Network Assurance helps the NetOps team validate policy and security compliance checks before making a change in network configuration, an intelligent set of proactive and predictive techniques that validate the Network for readiness without error, conflicts, and disruptions

Aviz Support team is located across four timezones offering 24x7 SONiC and related product support for multi-vendor switches and ASICs. Using our support portal, we offer you to

Collaborate with our SONiC experts to expedite your evaluations
Speed up your SONiC troubleshooting SLAs to as low as 15 minutes regardless of the underlying Switch/ASIC platform
Minimize operational delays by centralizing issues across multiple platforms

Users can reach out to customer support on

Supports Options are available:

Integrated Chat
Submit a Ticket
Send an email to support@aviznetworks.com

Refer to the "" section of this document for more details

ONES Supportability

To connect with customer support users can choose the support option available on ONES-UI

ONES 3.0 Multisite

One single solution to monitor all the data centre availability and one-click access to sites.

The ONES rule engine enables the detection of incidents and the generation of alerts, but this information is limited to the specific site managed by the corresponding controller. While this data is valuable for data center administrators to address and resolve issues, enterprise-level administrators or executives interested in the overall health of the entire network must access individual ONES instances at each data center to view the status. This process can be inefficient and cumbersome.

To solve this, ONES 3.0 Multisite provides a solution by offering a geospatial representation of anomalies across multiple sites, spread over different geographical locations, giving a comprehensive view of network health. ONES instances from data centers around the world can register with a central ONES 3.0 Multisite application. Once registered, the multisite system regularly polls each site for key data, such as the number of managed devices (endpoints) and critical alerts, and presents this information on a map, displaying individual sites and their last contact times. Additionally, ONES Multisite allows users to log in to individual data centers to access more detailed information if needed.

For a quicker glance about the health conditions, different colors and blinking patterns are used,

Green blink : Site is reachable with no critical alerts
Red blink : Site is reachable but there are critical alerts
Red : Site is not reachable

Supported Switch Platforms and NOS

SONiC Supported Broadcom Platforms:

Speed

Vendor (Models)

Accton (AS4625, AS4630), Celestica (DS1000), Supermicro (G3748), Micas(M2-W6510-48GT4V)

10/25G

Accton (AS5812, AS5835, AS7326), Celestica(DS2000), Dell (5212, 5248), Micas(M2-W6510-48V8C)

SONiC Supported Cisco Platforms:

Speed

Models

SONiC Supported Marvell Platforms:

Speed

Vendor (Models)

SONiC Supported NVIDIA Platforms:

Speed

Models

Vendor NOS Support:

Cumulus Linux, Arista EOS & Cisco NX-OS platforms are considered by ONES as Agent-less and supports metrics available using NVUE and EOS APIs

Vendor

NOS

Version

Agent-based vs Agent-less

SONiC-based switches require ONES Agents (Agent-based) to be installed on the switch being monitored, as a pre-requisite for ONES Telemetry and orchestrator-based functions to work.

ONES Telemetry Agent
ONES Orchestrator Agent

Proprietary NOS like Arista EOS, Cumulus, and Cisco NX-OS does not require an ONES Agent and instead leverage the (Agent-less) feature. OpenConfig extends APIs that provide Network Telemetry information about the resources being monitored via (gRPC Network Management Interface) protocol to the ONES Application

NX-OS expose its own way of metric collection using GRPC

ONES does not support Orchestrator-based functions on Proprietary NOS (non-SONiC).

Agent requirements

SSH access
SONiC versions beyond 202012 or 202111 are supported
Only x86 intel-based architectures are supported

ONES Installation

Installation Pre-requisites

Installation Overview

ONES Installation follows the below steps in the order sequence of:

License Readiness
Preparing and Installing ONES Application machine
Installing ONES Agents on SONiC Switches for Orchestrator and Telemetry
Enabling OpenConfig on non-SONiC Switches for Telemetry

License Readiness

After installation of ONES application user needs to contact AVIZ support to generate a trail license, trail license works for 8 devices and upto 30 days a customer can use.

ONES Application License (As per device count)

Trail license support feature

Telemetry Visibility (Monitor, inventory, analytics)
Add/remove Non-SONiC devices via YAML or CSV
Support (Zendesk)- Ability to open a ticket with inventory dump
Syslog access, Console/SSH access for device

To obtain a license, contact support@aviznetworks.com providing the below details;

License Duration - In Years (1-5)
Devices Count - 8, 16, 32, 64, 128, 256, 512 or 1024
ONES installation ID
Email ID: (For Account creation)

Users can get the ONES installation ID on the ONES-UI Login page after the installation

System Hardware Requirements – ONES Application

In the current release, ONES can support managing up to 1024 devices. For ONES Application Installation, the system hardware requirements vary based on the number of devices to manage;

Devices

Processor and Cores

RAM

Storage

System Software Requirements - ONES Application

Libraries

Task

Command

Validation

ONES Application package will take care of this prerequisite at the time of installation, Package verify the availability of the dependencies first then execute the application scripts

Note* Script do not take care about the update to latest version of ubuntu

Customer Firewall Configuration (Ports to be opened)

Ports to be open from Agent(Source) to ONES controller(Destination)

These ports has to be enable on ONES Controller

ONES Service

Port Numbers

Ports to be open from ONES controller(source) to Agent(Destination)

These ports has to be enable on Device(Switch)

ONES Service

Port Numbers

Ports to be open on ONES Server for ONES Services

ONES Service

Port Numbers

Ports to be open for HTTPS Access

HTTPS port has to be enable if a firewall is present in between User-machine and ONES-Controller

ONES Service

Port Numbers

These port numbers should be available to use and all ports must be allowed in the firewall if the Database server and devices are in the different DMZ zone

sudo iptables -L // This command can be used to verify the used ports

Network Switch (Managed Node) Configuration Requirement

SSH is enabled
Network Reachability from ONES Application
OpenConfig feature is enabled (for non-SONiC Switches)

Browser Requirements for ONES Web User Interface access

Google Chrome version 107 or later
Mozilla Firefox version 106 or later

ONES Multisite

Ubuntu 18.0 or later can be used for Multisite app
ONES Multisite has to be installed on separate server
ONES Multisite use TCP port 443
Reachability between ONES sites and Multisite instance.

Download ONES Package

User can download the Latest version of ONES on Support Portal.

Please refer to the link https://support.aviznetworks.com/hc/en-us/articles/10268234313997-ONES-Image-Download for downloading latest version of ONES Application

NOTE: You are required to sign-up on https://support.aviznetworks.com/hc/en-us for getting access to the download page.

Work with Aviz Sales/Support contact to create an account on Aviz Networks Support Portal
Login to with your account credentials
Click on the Downloads section, under ONES, click to download ONES Release 3.0
- File to install on Ubuntu
  - ONES 3.0 Installation package

Installing ONES Application

These steps will guide a user how to install a tar-ball package on base Linux based machine

ONES Application system - Installation Steps

Enable super-user mode

user@ones-application:~$ sudo su

Extract the contents of the downloaded ONES Installer tar.gz file

root@ones-application:~$ tar -xvf ONES-3.0.0.tar.bz2

Go to ONES-3.0 folder on the server machine

root@ones-aplication:~$ cd ONES-3.0

Run ones-installer.sh to Install the ONES application function

root@ones-application:~/ONES-3.0$ ./ones-installer.sh

The installer file automatically detects & processes fresh installation or upgrade to the new version

While upgrading there is no dependency of prevision version files, Once the upgrade process is completed, user manually have to delete the previous version files/Packages from the device, Script do not touch old version files

By default, the installer does not provide any license, user needs to contact AVIZ support Team.
ONESv3.0 support SSL certificate integration
1. User can choose YES if the User wants to integrate their own SSL certificate
  Note* Replace the Private key & certificate path to correct location

ONESv3.0 support certificate-based authentication between ONES App and devices for GNMI and Auto-discovery

For agent auto-discovery agent will act as a client and the collector as a server. For normal gnmi communication, the agent will act as a server and the collector as a client. Need certificates based on this.

The user needs to provide the certificate path and replace the key name with the path of the certificate to be used here

ONES Application support IP-based Access & FQDN Access

Enter the ONES App URL: https:// #Replace the input with IP or FQDN

IP based

FQDN based

ONESv3.0 support password-based(MD5) authentication between ONES App and devices for GNMI and Auto-discovery
1. User can choose yes if need password based authentication
2. User can choose no if there no requirement of authentication

Users cannot simultaneously select both certificate-based authentication and password-based authentication between the agent and the ONES application. They must choose one authentication method at a time for securing communication between the agent and the ONES app if required.

Installation begins

Access ONES Application Web GUI from a supported browser using https://<host-ip/FQDN>

Activation:

For a Trail license, the user needs to reach out to AVIZ Support
For Activation, the user can choose Activate License if the user has an activation key of any subscription

Users can activate the ONES Application first time just after installation(first-time ONES application shows the page to activate the license

After evaluating ONES application, the user will have the option to activate the license anytime from the License Page

1. Activate License

2. Activate Key

Use Default credentials as below;
- Username: superadmin
- Password : Admin@123

Password should contain:-

Minimum Password Length - 8 characters

Maximum Password Length - 24 characters

Character Support - Alpha Numeric

Special Characters - (# @ $ ! & % only)

Character Rule - At least one Upper Case and one special character

After Resetting the password use new credentials to login
You will see the default Monitor Page with a Topology view

1. Upgrade License

After Trail use, if the user wishes to upgrade new Subscription-based license, so user can navigate to the below page.

Account >> License >> Upgrade License

Click Upgrade License & Enter the subscription-based key

If Switches Deployment is large so user needs to enable the large config inside Database Config File

Copy the postgresql.config file outside to do changes

edit the file and uncomment few lines to activate Large config and save the changes

Copy the changes to DB config file

Restart the ones-collector-db

ONE-DL cloud Deployment

Using this section user can install ONES-DL backend AWS

Provisioning an EC2 Instance

AWS EC2 Instance Sizing for Event Ingestion

For efficient event ingestion, it's crucial to select the right EC2 instance type based on your event volume:

200K events/sec: Start with a minimum of an m5.4xlarge instance.
Up to 400K events/sec: Scale up to an m5.8xlarge instance.
Up to 600K events/sec: Opt for an m5.12xlarge instance.

Install Docker

Install Docker Compose

Install ONE-DL

Copy the ONE-DL package to AWS Instance
Untar the ONE-DL package
Modify the .env file with given input

Installing ONES Agents 3.0

Overview

ONES requires user to install the below agents on SONiC NOS to allow Network Orchestration and Visibility

ONES Orchestrator Agent for Network Orchestration
ONES Telemetry Agent for Telemetry Data Streaming (Network Visibility)
ONES Server_Agent for GPU Telemetry Data Streaming

Server_Agent GPU telemetry is only supported on intel Gaudy platform.

ONES Agent 3.0 Version allow the user to add a new controller IP and to change the authentication between controller and agent without doing the complete installation again.

NOTE: for non-SONiC switches,

OpenConfig feature on its NOS needs to be enabled for Network Visibility (Telemetry Data Streaming)
Network Orchestration is not supported

SONiC NOS upgrade scenario - Impact on ONES Agents

SONiC NOS Upgrade could be done either via
- ONES UI (Inventory-->Devices)
  - Instead of using FM - Orchestrator Agent

ONES Telemetry Agent Installation

ONES Agent v3.0 support Agent Auto discovery

ONESv3.0 Agent support auto-discovery feature
ONESv3.0 Agent support to send telemetry on multiple controllers (Max 2)
Restrict IP feature can be enabled/disabled
Only Collector upgrade after Deployment is possible now
Password-based authentication is supported
Using the Restrict IP feature agent will discover the ONES Controller and will update the entry on the ONES App with all the feature metrics
Need to add a few inputs while installing the agent
1. Controller IP //To restrict the telemetry streaming
2. Device Credentials
3. Layer

Installation

On the Application machine, go to ONES-3.0/ones_t_agent folder

root@ones-application:~$ cd /ONES-3.0/ones_t_agent

Installation (Agent Install on multiple switches at the same time)

Enter device details (Management IP, Username and Password ) in device_info.csv

root@ones-application/ONES-3.0/ones_t_agent:~$ vi device_info.csv

The user needs to add all the required details in the CSV file, This CSV file will be used to push this information to agent.conf(/etc/sonic/agent.conf) file to every switch and ones-agent on the switch will pick the details from agent.conf file and will register itself to ONES controller with all the given parameters this helps a NetOps engineer to directly add a CSV file containing all the details, The Engineer needs not to add one by one devices on the controller which actually is time-consuming

The user must maintain the layer names exactly as specified above (case-sensitive). If the user inputs names that differ from these, they may encounter issues when using the ONES application.

Save the File

Executing the installation script can be used for installing a telemetry agent on one or more devices in the data centre.

The installer file automatically detects & will process fresh installation or upgrade to the new version

While upgrading, all the previous files will automatically get deleted on the Switch

If users want to use the certificate for GNMI & Auto-Registration, so users need to put the certificate in directory gnmi-certs(for GNMI) & auto-reg-certs(for Agent Auto Registration)

root@ones-application/ONES-3.0/ones_t_agent:~$ ./ones_agent_parallel_installer.sh

Users can use ONES-Agent as an integrated service in SONiC OS or can use it as an independent third-party container.

Users can choose this option to only update one more controller IP without doing the complete agent installation.

Scripts asks to put the Controller IP to use auto-discovery feature

User can only add 2 Controller IP to restrict the telemetry streaming

User can choose the restriction to send telemetry to collector IP only

It's important to restrict collector IP as No in case the running network has NAT translation from private to public IP for ONES server access from the device.

User can enable password based authentication between agnet and collector

Installation Begin

Now Agent will only stream the metrics to the given controller & will autoregister on the ONES-App

The user needs to make sure, The devices have a unique name, otherwise, there will issue while plotting the full topology view(Topology Page).

ONES Server Agent Installation

Server Agent v3.0 support:

Only Intel Guadi platform is supported in ONESv3.0

ONES Orchestration Agent Installation

On the ONES Application server, go to ONES-3.0/ones_fm_agent

root@ones-application:~$ cd /ONES-3.0/ones_fm_agent

Installation (Agent Install on multiple switches at the same time)

Agent Less Telemetry

Network Device Configuration Interfaces

Cumulus (NVUE API)

Cumulus Networks offers the NVUE (Network Virtualization Utility Engine) API, providing an abstraction layer over traditional configuration mechanisms. This allows for a more intuitive and standardized approach to network configuration and management, echoing modern software development practices.

Cumulus(NVUE API)

Cumulus switch with version >4.4 to start streaming to ONES Controller via NVUE API

Enable gNMI in Cumulus

netq config add agent gnmi-enable true
netq config add agent opta-enable false
netq config add agent gnmi-port 9339
netq config restart agent
netq config status agent

netq config add agent gnmi-port 50052
netq config restart agent
netq config status agent

cumulus@cumulus:mgmt:~$ cat /etc/netq/netq.yml
netq-agent:
is-gnmi-enabled: true
is-opta-enabled: false
netq-gnmi:
gnmi_port: 9339

Enable NVUE API in Cumulus

ONES IS not using NCLU. ONES Application only use NVUE API from OS version 4.4, less than that NCLU code is not enabled for ONES. [For ONES 1.1 testing 4.4 and 5.2 version]

Cumulus 5.x not fully support NCLU, only NVUE.

CISCO NXOS (GRPC)

CISCO NXOS support its own way to stream telemetry data using GRPC, we can enable GRPC and can get offered metrics from the device

Enable GRPC

GRPC Verification

Adding New Controller

ONES Agent configuration file allows user to add new collector(controller) after the agent installation if required

Overview

To redirect agent telemetry data to a different ONES collector without reinstalling the agent, simply re-run the script with the "Only controller IP addition" option enabled. This process automatically registers the device with the new ONES application and starts the telemetry data stream.

Installing ONES Multisite

These steps will guide you on how to install the ONES-Multisite

ONES Multisite Application - Installation Steps

Enable super-user mode

user@ones:~$ sudo su

Extract the contents of the downloaded ONES Installer tar.gz file

aviz@aviz % ssh -i ones-dl-qa.pem ubuntu@34.215.5.89
Welcome to Ubuntu 22.04.3 LTS (GNU/Linux 6.2.0-1018-aws x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/pro

  System information as of Thu Mar  7 06:17:12 UTC 2024

  System load:  0.01513671875      Processes:                224
  Usage of /:   1.0% of 247.92GB   Users logged in:          1
ZOOKEEPER_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
KAFKA_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
SCHEMA_REGISTRY_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
INSTANCE_ID=i-06e36f82c35173cc9
VPC_ID=vpc-09a64a3439e9c1022
REGION=us-west-2
SG_ID=sg-0057cdb5b97e1d218
~
".env" 7L, 323B                                                                                                                                     1,1           All
  Memory usage: 0%                 IPv4 address for docker0: 172.17.0.1
  Swap usage:   0%                 IPv4 address for ens5:    172.31.28.5


Expanded Security Maintenance for Applications is not enabled.

39 updates can be applied immediately.
25 of these updates are standard security updates.
To see these additional updates run: apt list --upgradable

7 additional security updates can be applied with ESM Apps.
Learn more about enabling ESM Apps service at https://ubuntu.com/esm


Last login: Thu Mar  7 06:10:37 2024 from 18.237.140.163
ubuntu@ip-172-31-28-5:~$
ubuntu@ip-172-31-28-5:~$ pwd
/home/ubuntu
ubuntu@ip-172-31-28-5:~$ cd ONES-DL-CLOUD/
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ pwd
/home/ubuntu/ONES-DL-CLOUD
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ ls
one-dl.tar.gz
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ tar -xvf one-dl.tar.gz
docker-compose.yml
one-dl-multitenant-installer.sh
.env
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ vi .env
ZOOKEEPER_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
KAFKA_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
SCHEMA_REGISTRY_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
INSTANCE_ID=i-06e36f82c35173cc9
VPC_ID=vpc-09a64a3439e9c1022
REGION=us-west-2
SG_ID=sg-0057cdb5b97e1d218

ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ cat .env
ZOOKEEPER_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
KAFKA_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
SCHEMA_REGISTRY_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
INSTANCE_ID=i-06e36f82c35173cc9
VPC_ID=vpc-09a64a3439e9c1022
REGION=us-west-2
SG_ID=sg-0057cdb5b97e1d218

ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ cp .env .env-backup
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ cat .env-backup
ZOOKEEPER_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
KAFKA_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
SCHEMA_REGISTRY_SERVER_VALUE=ec2-35-93-19-159.us-west-2.compute.amazonaws.com
INSTANCE_ID=i-06e36f82c35173cc9
VPC_ID=vpc-09a64a3439e9c1022
REGION=us-west-2
SG_ID=sg-0057cdb5b97e1d218

ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ ls
docker-compose.yml  one-dl-multitenant-installer.sh  one-dl.tar.gz

ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ ./one-dl-multitenant-installer.sh
SHELL=/bin/bash
REGION=us-west-2
KAFKA_SERVER_VALUE=ec2-34-215-5-89.us-west-2.compute.amazonaws.com
PWD=/home/ubuntu/ONES-DL-CLOUD
LOGNAME=ubuntu
XDG_SESSION_TYPE=tty
SCHEMA_REGISTRY_SERVER_VALUE=ec2-34-215-5-89.us-west-2.compute.amazonaws.com
MOTD_SHOWN=pam
HOME=/home/ubuntu
LANG=C.UTF-8
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:
VPC_ID=vpc-09a64a3439e9c1022
LC_TERMINAL=iTerm2
SSH_CONNECTION=43.224.130.156 61180 172.31.28.5 22
LESSCLOSE=/usr/bin/lesspipe %s %s
XDG_SESSION_CLASS=user
TERM=xterm-256color
LESSOPEN=| /usr/bin/lesspipe %s
USER=ubuntu
SG_ID=sg-04c3752b777d8f77e
LC_TERMINAL_VERSION=3.4.16
SHLVL=2
XDG_SESSION_ID=5
LC_CTYPE=C.UTF-8
XDG_RUNTIME_DIR=/run/user/1000
SSH_CLIENT=43.224.130.156 61180 22
XDG_DATA_DIRS=/usr/local/share:/usr/share:/var/lib/snapd/desktop
ZOOKEEPER_SERVER_VALUE=ec2-34-215-5-89.us-west-2.compute.amazonaws.com
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
INSTANCE_ID=i-01300eb6edb18273b
DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
SSH_TTY=/dev/pts/1
OLDPWD=/home/ubuntu
_=/usr/bin/env
us-west-2 i-01300eb6edb18273b vpc-09a64a3439e9c1022 sg-04c3752b777d8f77e
Error response from daemon: No such container: zookeeper
Error response from daemon: No such container: kafka
Error response from daemon: No such container: schema-registry
Error response from daemon: No such container: kafka-connect
Error response from daemon: No such container: zookeeper
Error response from daemon: No such container: kafka
Error response from daemon: No such container: schema-registry
Error response from daemon: No such container: kafka-connect
{
    "Return": true,
    "SecurityGroupRules": [
        {
            "SecurityGroupRuleId": "sgr-07f887d736a7c773c",
            "GroupId": "sg-04c3752b777d8f77e",
            "GroupOwnerId": "259789323334",
            "IsEgress": false,
            "IpProtocol": "tcp",
            "FromPort": 29092,
            "ToPort": 29092,
            "CidrIpv4": "0.0.0.0/0"
        }
    ]
}
{
    "Return": true,
    "SecurityGroupRules": [
        {
            "SecurityGroupRuleId": "sgr-0d446cf43dbf8c55a",
            "GroupId": "sg-04c3752b777d8f77e",
            "GroupOwnerId": "259789323334",
            "IsEgress": false,
            "IpProtocol": "tcp",
            "FromPort": 9092,
            "ToPort": 9092,
            "CidrIpv4": "0.0.0.0/0"
        }
    ]
}
{
    "Return": true,
    "SecurityGroupRules": [
        {
            "SecurityGroupRuleId": "sgr-08d752b5cbfea8b1c",
            "GroupId": "sg-04c3752b777d8f77e",
            "GroupOwnerId": "259789323334",
            "IsEgress": false,
            "IpProtocol": "tcp",
            "FromPort": 2181,
            "ToPort": 2181,
            "CidrIpv4": "0.0.0.0/0"
        }
    ]
}
{
    "Return": true,
    "SecurityGroupRules": [
        {
            "SecurityGroupRuleId": "sgr-058962812f2650b4e",
            "GroupId": "sg-04c3752b777d8f77e",
            "GroupOwnerId": "259789323334",
            "IsEgress": false,
            "IpProtocol": "tcp",
            "FromPort": 8083,
            "ToPort": 8083,
            "CidrIpv4": "0.0.0.0/0"
        }
    ]
}
{
    "Return": true,
    "SecurityGroupRules": [
        {
            "SecurityGroupRuleId": "sgr-03a801549ac17a74d",
            "GroupId": "sg-04c3752b777d8f77e",
            "GroupOwnerId": "259789323334",
            "IsEgress": false,
            "IpProtocol": "tcp",
            "FromPort": 8081,
            "ToPort": 8081,
            "CidrIpv4": "0.0.0.0/0"
        }
    ]
}
{
    "Return": true,
    "SecurityGroupRules": [
        {
            "SecurityGroupRuleId": "sgr-01ae4abe9d99c0086",
            "GroupId": "sg-04c3752b777d8f77e",
            "GroupOwnerId": "259789323334",
            "IsEgress": false,
            "IpProtocol": "tcp",
            "FromPort": 8181,
            "ToPort": 8181,
            "CidrIpv4": "0.0.0.0/0"
        }
    ]
}
[+] Running 10/10
 ✔ zookeeper 9 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                         5.1s
   ✔ 23828d760c7b Pull complete                                                                                                                                  0.6s
   ✔ e2670537dceb Pull complete                                                                                                                                  0.5s
   ✔ 3c059ccfa418 Pull complete                                                                                                                                  0.6s
   ✔ a23d33d59f2a Pull complete                                                                                                                                  0.7s
   ✔ 842a648f5439 Pull complete                                                                                                                                  0.9s
   ✔ 278244c5561f Pull complete                                                                                                                                  0.9s
   ✔ 0ab51e87b8dc Pull complete                                                                                                                                  1.0s
   ✔ 26ff518a75d1 Pull complete                                                                                                                                  1.4s
   ✔ 050c7bc3a5c4 Pull complete                                                                                                                                  1.1s
[+] Running 1/1
 ✔ Container zookeeper  Started                                                                                                                                  4.2s
[+] Running 12/12
 ✔ kafka 11 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                          9.4s
   ✔ fe36fc382320 Pull complete                                                                                                                                  0.7s
   ✔ 4250354b4fb7 Pull complete                                                                                                                                  2.1s
   ✔ c4c5f447179d Pull complete                                                                                                                                  0.3s
   ✔ 17fe3a92262f Pull complete                                                                                                                                  0.6s
   ✔ 5420596c14ab Pull complete                                                                                                                                  1.1s
   ✔ 0e55377ebe37 Pull complete                                                                                                                                  0.9s
   ✔ da7039bb2113 Pull complete                                                                                                                                  1.1s
   ✔ d389b3791c2e Pull complete                                                                                                                                  1.4s
   ✔ c24709eccb2a Pull complete                                                                                                                                  1.4s
   ✔ ad79ffd84e00 Pull complete                                                                                                                                  2.4s
   ✔ 218229bf30d9 Pull complete                                                                                                                                  1.7s
[+] Running 1/1
 ✔ Container kafka  Started                                                                                                                                      5.7s
[+] Running 12/12
 ✔ schema-registry 11 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                               17.9s
   ✔ fe36fc382320 Already exists                                                                                                                                 0.0s
   ✔ 4250354b4fb7 Already exists                                                                                                                                 0.0s
   ✔ c4c5f447179d Already exists                                                                                                                                 0.0s
   ✔ 17fe3a92262f Already exists                                                                                                                                 0.0s
   ✔ 5420596c14ab Already exists                                                                                                                                 0.0s
   ✔ 0e55377ebe37 Already exists                                                                                                                                 0.0s
   ✔ da7039bb2113 Already exists                                                                                                                                 0.0s
   ✔ d389b3791c2e Already exists                                                                                                                                 0.0s
   ✔ c24709eccb2a Already exists                                                                                                                                 0.0s
   ✔ e69ded016b1a Pull complete                                                                                                                                  8.9s
   ✔ 83e8ec805f43 Pull complete                                                                                                                                  0.3s
[+] Running 1/1
 ✔ Container schema-registry  Started                                                                                                                           18.7s
[+] Running 21/21
 ✔ kafka-connect 20 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                        18.1s
   ✔ a49367d57626 Pull complete                                                                                                                                  0.7s
   ✔ eeec2f37f4a0 Pull complete                                                                                                                                  2.8s
   ✔ ae805807db54 Pull complete                                                                                                                                  1.4s
   ✔ c553584e96cc Pull complete                                                                                                                                  1.1s
   ✔ 28769e081b94 Pull complete                                                                                                                                  2.4s
   ✔ 151cf144f79d Pull complete                                                                                                                                  1.9s
   ✔ 04292bb11042 Pull complete                                                                                                                                  2.3s
   ✔ c2e0c70921ea Pull complete                                                                                                                                  2.7s
   ✔ e8d7f71a6ca4 Pull complete                                                                                                                                  2.9s
   ✔ eb27eb7b8f05 Pull complete                                                                                                                                  4.7s
   ✔ 9bb8b7d5f6a0 Pull complete                                                                                                                                  3.3s
   ✔ 302eaef771e0 Pull complete                                                                                                                                 11.7s
   ✔ 1d0d5b44b6f1 Pull complete                                                                                                                                  3.8s
   ✔ 22df7873ee50 Pull complete                                                                                                                                  4.4s
   ✔ 4f4fb700ef54 Pull complete                                                                                                                                  4.7s
   ✔ 972adc085ab6 Pull complete                                                                                                                                  7.0s
   ✔ c4f994822767 Pull complete                                                                                                                                  6.1s
   ✔ 70547799762d Pull complete                                                                                                                                  7.0s
   ✔ 3f0c034e271c Pull complete                                                                                                                                  7.5s
   ✔ b6195a937e7b Pull complete                                                                                                                                  7.7s
[+] Running 1/1
 ✔ Container kafka-connect  Started                                                                                                                              4.6s
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$
ubuntu@ip-172-31-28-5:~/ONES-DL-CLOUD$ sudo su
root@ip-172-31-28-5:/home/ubuntu/ONES-DL-CLOUD# docker ps
CONTAINER ID   IMAGE                             COMMAND                  CREATED              STATUS                             PORTS     NAMES
ab8aa46cc746   avizdock/kafka-connect:latest     "/etc/confluent/dock…"   28 seconds ago       Up 23 seconds (health: starting)             kafka-connect
346522f4baf5   confluentinc/cp-schema-registry   "/etc/confluent/dock…"   About a minute ago   Up About a minute                            schema-registry
23c50c44bc5b   confluentinc/cp-kafka:latest      "/etc/confluent/dock…"   2 minutes ago        Up 2 minutes                                 kafka
633eba10034d   zookeeper                         "/docker-entrypoint.…"   3 minutes ago        Up 3 minutes                                 zookeeper
root@ip-172-31-28-5:/home/ubuntu/ONES-DL-CLOUD#

root@aviz:/home/aviz/GA_3.0/ones-1725445069-onprem# ./ones-installer.sh
Installing Open Networking Enterprise Suite (ONES)
..................................................
Installing prerequisites for ONES application
....................
....................
....................
....................
Installing sshpass...
dpkg: warning: downgrading sshpass from 1.09-1 to 1.06-1
(Reading database ... 116659 files and directories currently installed.)
Preparing to unpack .../sshpass_1.06-1_amd64.deb ...
Unpacking sshpass (1.06-1) over (1.09-1) ...
Setting up sshpass (1.06-1) ...
Processing triggers for man-db (2.10.2-1) ...
ONES is getting installed for the first time, choose appropriate options when prompted...
....................
Installing ONES application...

Do you want to install domain SSL certificate(if not, installation will proceed with a self signed certificate)? [y/n]: y
Enter the path to the private key file: /home/aviz/server.pem
Enter the path to the certificate file: /home/aviz/server.crt.pem
Do you want to enable ONE-DL feature? [y/n]: n
Do you want to enable DB backup feature? [y/n]: y
Where do you want to store the backups? [local/remote]: remote    
Please make sure the remote server is reachable via SSH
Enter the remote machine IP: 10.0.0.1    
Enter the remote machine username: admin
Enter the remote machine password: 
Enter the backup directory: ~/backups   
Backup is being done in 10.0.0.1 at ~/backups
Enter the number of backups (between 1 and 100) to retain (Older backups will be deleted): 5   
Enter the backup interval in seconds (3600 seconds or higher): 86400     
Do you want to enable certificate based authentication between ONES controller and devices? [y/n]: n
Enter the ONES App URL for Rule-Engine Alert [https://<host-ip or domain>]: https://10.20.0.80
Do you want to enable agent authentication ? [y/n]: y
Enter the ones-agent username: admin
Enter the ones-agent password: YourPaSsWoRd
Setting up the environment and loading essential dockers...
2bb80ba200dd: Loading layer [==================================================>]  68.32MB/68.32MB
2a9822159dc0: Loading layer [==================================================>]  2.048kB/2.048kB
2db080db4c83: Loading layer [==================================================>]  143.2MB/143.2MB
5f70bf18a086: Loading layer [==================================================>]  1.024kB/1.024kB
Loaded image: avizdock/ones-collector:v3.0.0
f99617b4857d: Loading layer [==================================================>]  2.081GB/2.081GB
598cad3fc7f2: Loading layer [==================================================>]  4.096kB/4.096kB
a2cac5263de0: Loading layer [==================================================>]  1.536kB/1.536kB
4d9c9e7cdef2: Loading layer [==================================================>]  3.584kB/3.584kB
a76669129b6a: Loading layer [==================================================>]   98.3kB/98.3kB
5f70bf18a086: Loading layer [==================================================>]  1.024kB/1.024kB
85f57de39b33: Loading layer [==================================================>]   7.68kB/7.68kB
21cdd2e0b4ef: Loading layer [==================================================>]  2.048kB/2.048kB
12f4e967e13f: Loading layer [==================================================>]  10.75kB/10.75kB
5e93cea4ec38: Loading layer [==================================================>]  11.26kB/11.26kB
ce0cf0b53390: Loading layer [==================================================>]  77.59MB/77.59MB
0344a1894c78: Loading layer [==================================================>]  161.2MB/161.2MB
Loaded image: avizdock/timescaledb:latest
ones-collector-db-data
0280eb3c2596: Loading layer [==================================================>]  1.536kB/1.536kB
6dde90cacd10: Loading layer [==================================================>]  86.02kB/86.02kB
2aa52ba420da: Loading layer [==================================================>]  296.4MB/296.4MB
be57349b17a3: Loading layer [==================================================>]  6.353MB/6.353MB
0ec41b6d891c: Loading layer [==================================================>]  2.349MB/2.349MB
d5f95e6a3021: Loading layer [==================================================>]  115.2MB/115.2MB
05f76cb3b696: Loading layer [==================================================>]  6.619MB/6.619MB
2511c56b8490: Loading layer [==================================================>]  5.766MB/5.766MB
Loaded image: avizdock/ones-ui:v3.0.0
ones-ui-data
952d1ba246e9: Loading layer [==================================================>]  1.536kB/1.536kB
aa5bb983ae7a: Loading layer [==================================================>]  3.072kB/3.072kB
29500ccb4fdd: Loading layer [==================================================>]    243MB/243MB
0d1d24f6d697: Loading layer [==================================================>]  223.8MB/223.8MB
370ce41daeb2: Loading layer [==================================================>]  6.291MB/6.291MB
53f7f3605d6c: Loading layer [==================================================>]  2.992MB/2.992MB
05dc8de6e8f6: Loading layer [==================================================>]  158.2kB/158.2kB
Loaded image: avizdock/pty-server:v3.0.0
64a5ccd06307: Loading layer [==================================================>]  2.048kB/2.048kB
ca4c2e6e9d9e: Loading layer [==================================================>]  1.203MB/1.203MB
5296c36b9ebf: Loading layer [==================================================>]  862.7MB/862.7MB
5943159c673a: Loading layer [==================================================>]  41.97MB/41.97MB
Loaded image: avizdock/ones-gateway:v3.0.0
4f28916f37e9: Loading layer [==================================================>]  129.5MB/129.5MB
2a5df58ba97f: Loading layer [==================================================>]  29.52MB/29.52MB
c7fd29476165: Loading layer [==================================================>]  156.6MB/156.6MB
c7e74d262dff: Loading layer [==================================================>]  38.24MB/38.24MB
e851c0af7c3d: Loading layer [==================================================>]  359.7MB/359.7MB
2ef53f757b83: Loading layer [==================================================>]  40.77MB/40.77MB
bc8e8be8d143: Loading layer [==================================================>]  2.048kB/2.048kB
83fa77e03e24: Loading layer [==================================================>]  59.91MB/59.91MB
5f70bf18a086: Loading layer [==================================================>]  1.024kB/1.024kB
d0feb9122054: Loading layer [==================================================>]   2.56kB/2.56kB
7219b0fcbd58: Loading layer [==================================================>]   2.56kB/2.56kB
c529643b8d45: Loading layer [==================================================>]  527.4MB/527.4MB
d69f335ef8e6: Loading layer [==================================================>]  44.73MB/44.73MB
1644861feacd: Loading layer [==================================================>]  145.9kB/145.9kB
Loaded image: avizdock/ones-fm:v3.0.0
d4fc045c9e3a: Loading layer [==================================================>]  7.667MB/7.667MB
b150abefba25: Loading layer [==================================================>]  12.29kB/12.29kB
93cb05de897b: Loading layer [==================================================>]  1.536kB/1.536kB
fb7197bcca0b: Loading layer [==================================================>]  234.3MB/234.3MB
0beddd8d6be2: Loading layer [==================================================>]  61.95kB/61.95kB
8b559dcbd8b1: Loading layer [==================================================>]  2.048kB/2.048kB
ba2a62a232e7: Loading layer [==================================================>]  3.072kB/3.072kB
0087bbc00356: Loading layer [==================================================>]  18.94kB/18.94kB
bec2427aa484: Loading layer [==================================================>]  3.072kB/3.072kB
Loaded image: avizdock/postgres:14
ones-fm-db-data
ones-fm-data
Loaded image: avizdock/docker:v3.0.0
bf63823f8c99: Loading layer [==================================================>]  84.18MB/84.18MB
162b992dedca: Loading layer [==================================================>]  3.395MB/3.395MB
4aa7ea28d987: Loading layer [==================================================>]  43.34MB/43.34MB
dc9851b6350b: Loading layer [==================================================>]  4.608kB/4.608kB
b1b299295e53: Loading layer [==================================================>]  12.08MB/12.08MB
739c25f0a755: Loading layer [==================================================>]  1.536kB/1.536kB
51a99d985dad: Loading layer [==================================================>]  29.31MB/29.31MB
e8605c9dadf3: Loading layer [==================================================>]   2.56kB/2.56kB
e3c514881f8f: Loading layer [==================================================>]  34.07MB/34.07MB
e437f061681a: Loading layer [==================================================>]  8.192kB/8.192kB
Loaded image: avizdock/ones-db-backup:v3.0.0
Loaded image: avizdock/zookeeper:v3.0.0
Loaded image: avizdock/kafka:v3.0.0
Loaded image: avizdock/schemaregistry:v3.0.0
Loaded image: avizdock/kafka-connect:v3.0.0
Loaded image: avizdock/ksqldb-server:v3.0.0
76367d75676f: Loading layer [==================================================>]  7.369MB/7.369MB
a5406ed65f11: Loading layer [==================================================>]  282.7MB/282.7MB
58f70dbfa845: Loading layer [==================================================>]  2.048kB/2.048kB
f757d9533757: Loading layer [==================================================>]  100.4MB/100.4MB
5f70bf18a086: Loading layer [==================================================>]  1.024kB/1.024kB
Loaded image: avizdock/ones-stream-processor:v3.0.0
5204d88907ef: Loading layer [==================================================>]  68.32MB/68.32MB
920be4d9d898: Loading layer [==================================================>]  2.048kB/2.048kB
ff7ff3cef7fa: Loading layer [==================================================>]  108.9MB/108.9MB
5f70bf18a086: Loading layer [==================================================>]  1.024kB/1.024kB
Loaded image: avizdock/apiserver:v3.0.0
277a036e29bd: Loading layer [==================================================>]  76.38MB/76.38MB
5f70bf18a086: Loading layer [==================================================>]  1.024kB/1.024kB
Loaded image: avizdock/ones-rule-service:v3.0.0
ones-rule-db-data
046c8b6d5bab6b2c21b5763abebdd37fe58fc215bcd1a961317d6be8d3b59e44
Cleaning up existing containers..
Bringing up ONES app containers
Bringing up ONES-collector-db container in no recreate mode and ONES-fm-db
[+] Running 1/1
 ⠿ Container ones-collector-db  Started                                                                                                                               4.5s
[+] Running 2/2
 ⠿ Container ones-rule-service-db  Started                                                                                                                            0.7s
 ⠿ Container ones-fm-db            Started                                                                                                                            0.7s
[+] Running 1/1
 ⠿ Container zookeeper  Started                                                                                                                                       1.5s
NAME                   COMMAND                  SERVICE             STATUS              PORTS
ones-collector-db      "/docker-entrypoint.…"   collector-db        running             8008/tcp, 0.0.0.0:5432->5432/tcp, :::5432->5432/tcp, 8081/tcp
ones-fm-db             "docker-entrypoint.s…"   fm-db               running             0.0.0.0:2345->5432/tcp, :::2345->5432/tcp
ones-rule-service-db   "docker-entrypoint.s…"   rule-service-db     running             0.0.0.0:2456->5432/tcp, :::2456->5432/tcp
zookeeper              "/etc/confluent/dock…"   zookeeper           running             2888/tcp, 0.0.0.0:2181->2181/tcp, :::2181->2181/tcp, 3888/tcp
please wait for collector-db, rule-service-db and fm-db to initialize
[+] Running 2/2.........................................................................................................
 ⠿ Container zookeeper  Running                                                                                                                                       0.0s
 ⠿ Container broker     Started                                                                                                                                       0.7s

ones-collector-db
...........................................................................................................................................................................[+] Running 5/5......................................................
 ⠿ Container zookeeper        Running                                                                                                                                 0.0s
 ⠿ Container broker           Running                                                                                                                                 0.0s
 ⠿ Container schema-registry  Started                                                                                                                                 0.8s
 ⠿ Container ksqldb-server    Started                                                                                                                                 0.8s
 ⠿ Container kafka-connect    Started                                                                                                                                 1.3s
............................................................
[+] Running 4/4
 ⠿ Container ones-gateway    Started                                                                                                                                  1.9s
 ⠿ Container zookeeper       Running                                                                                                                                  0.0s
 ⠿ Container broker          Running                                                                                                                                  0.0s
 ⠿ Container ones-collector  Started                                                                                                                                  2.5s
[+] Running 17/17...........................................
 ⠿ Container ones-pty-server       Started                                                                                                                            2.0s
 ⠿ Container api-server            Started                                                                                                                            2.4s
 ⠿ Container ones-ui               Started                                                                                                                            2.2s
 ⠿ Container docker                Started                                                                                                                            2.4s
 ⠿ Container ones-rule-service     Started                                                                                                                            1.9s
 ⠿ Container ones-collector-db     Running                                                                                                                            0.0s
 ⠿ Container ones-rule-service-db  Running                                                                                                                            0.0s
 ⠿ Container ones-fm-db            Running                                                                                                                            0.0s
 ⠿ Container zookeeper             Running                                                                                                                            0.0s
 ⠿ Container ones-gateway          Running                                                                                                                            0.0s
 ⠿ Container ones-fm               Started                                                                                                                            2.3s
 ⠿ Container broker                Running                                                                                                                            0.0s
 ⠿ Container ksqldb-server         Running                                                                                                                            0.0s
 ⠿ Container schema-registry       Running                                                                                                                            0.0s
 ⠿ Container stream-processor      Started                                                                                                                            2.1s
 ⠿ Container ones-collector        Running                                                                                                                            0.0s
 ⠿ Container kafka-connect         Running                                                                                                                            0.0s
NAME                   COMMAND                  SERVICE             STATUS              PORTS
api-server             "java -jar /app/apis…"   api-server          running             0.0.0.0:8080->8080/tcp, :::8080->8080/tcp
broker                 "/etc/confluent/dock…"   broker              running             0.0.0.0:9092->9092/tcp, :::9092->9092/tcp, 0.0.0.0:9101->9101/tcp, :::9101->9101/tcp, 0.0.0.0:29092->29092/tcp, :::29092->29092/tcp
docker                 "python3 app.py"         docker              running
kafka-connect          "/etc/confluent/dock…"   kafka-connect       running (healthy)   0.0.0.0:8083->8083/tcp, :::8083->8083/tcp, 9092/tcp
ksqldb-server          "/etc/confluent/dock…"   ksqldb-server       running             0.0.0.0:8088->8088/tcp, :::8088->8088/tcp
ones-collector         "java -jar -XX:MaxGC…"   collector           running             8093/tcp, 0.0.0.0:50053->50053/tcp, :::50053->50053/tcp
ones-collector-db      "/docker-entrypoint.…"   collector-db        running             8008/tcp, 0.0.0.0:5432->5432/tcp, :::5432->5432/tcp, 8081/tcp
ones-fm                "/bin/sh -c '{ gunic…"   fm                  running             0.0.0.0:8787->8080/tcp, :::8787->8080/tcp
ones-fm-db             "docker-entrypoint.s…"   fm-db               running             0.0.0.0:2345->5432/tcp, :::2345->5432/tcp
ones-gateway           "./gnmi-gateway -Tar…"   gateway             running             0.0.0.0:9339->9339/tcp, :::9339->9339/tcp
ones-pty-server        "docker-entrypoint.s…"   pty-server          running             0.0.0.0:8885->8885/tcp, :::8885->8885/tcp
ones-rule-service      "java -jar /app/rule…"   rule-service        running             8080/tcp
ones-rule-service-db   "docker-entrypoint.s…"   rule-service-db     running             0.0.0.0:2456->5432/tcp, :::2456->5432/tcp
ones-ui                "docker-entrypoint.s…"   ui                  running             0.0.0.0:443->443/tcp, :::443->443/tcp, 3002/tcp
schema-registry        "/etc/confluent/dock…"   schema-registry     running             0.0.0.0:8081->8081/tcp, :::8081->8081/tcp
stream-processor       "java -jar /app/stre…"   stream-processor    running             8080/tcp
zookeeper              "/etc/confluent/dock…"   zookeeper           running             2888/tcp, 0.0.0.0:2181->2181/tcp, :::2181->2181/tcp, 3888/tcp
Finishing up ONES Installation...
............................................................Installed ONES application successfully...
....................
Open the ONES application  at https://10.20.0.80

Do you want to update the username/password for password authentication? (yes/no): no
Does the ONES-agent is integrated with SONiC NOS? (yes/no): no
Do you want to add only Collector IP for auto-discovery and skip the agent installation? (yes/no): no
Enter the ip address of collectors to auto-discover. Do not enter more than 2. Eg - 10.1.1.10,10.2.2.5 : 10.20.0.87
Do you want to restrict access only to the provided collector IP?
Note: Providing Yes will restrict access to agent only with the provided collector IP Address
Enter yes/no: Yes
Do you want to enable password authentication? (yes/no): yes
Enter the new username: admin
Enter the new password: YourPaSsWoRd
e2ef8a51359d: Loading layer [==================================================>]  72.54MB/72.54MB
ae2d55769c5e: Loading layer [==================================================>]  7.401MB/7.401MB
3054512b6f71: Loading layer [==================================================>]  31.35MB/31.35MB
997b8e79e84f: Loading layer [==================================================>]   5.12kB/5.12kB
e6c5004ee77f: Loading layer [==================================================>]   11.7MB/11.7MB
867f2af1b281: Loading layer [==================================================>]   2.56kB/2.56kB
86fee8a2d43f: Loading layer [==================================================>]  31.45MB/31.45MB
4a2339f45f2a: Loading layer [==================================================>]   42.7MB/42.7MB
274d02d0f011: Loading layer [==================================================>]  1.421MB/1.421MB
Loaded image: avizdock/agent_installer:latest
Docker image 'avizdock/agent_installer' is loaded.
06275757da6600fb25d31f1e4c195116d52729e0d80db1aa8064474c5e858ae5
Docker container 'agent_installer' is running.
Selecting ‘Yes’ will exclusively initiate the day-2 deployment of the Ones-Agent,
involving a reconfiguration of the existing agent to establish communication with the specified collector(s).
Choosing ‘No’ will initiate the deployment of the Ones-Agent as an independent third-party container.
The default values for rackid, brickid, and azid are all set to 0.
[{'ip': '10.20.2.12', 'user': 'admin', 'passwd': 'YourPaSsWoRd', 'layer': 'Leaf', 'region': 'San_Jose_Lab', 'type': 'Sonic', 'groupid': '', 'azid': '1', 'brickid': '1', 'rackid': '1', 'installation_instance': 1, 'agentip': '10.20.2.12', 'collectorip': '10.20.0.80', 'restrict_collector_ip': 'no', 'password_authentication': 'yes', 'username': 'admin', 'encpass': 'e08d855d42cc2e488592731e', 'enciv': '5b3e16bb25581d5e0934683617dbc445'}]
###############Connecting to switch###############
Connection to switch 10.20.2.12 successful.....................
Looking for previous installation........................
avizdock/ones-agent:v3.0.0
Previous installation found commencing uninstallation on the device 10.20.2.12........
stop ones-agent docker on the device 10.20.2.12........
docker stopped successfully on the device 10.20.2.12........
remove ones-agent docker on the device 10.20.2.12........
docker removed successfully on the device 10.20.2.12........
remove redundant ones-agent docker container on the device 10.20.2.12........
No redundant ones-agent container found on the device 10.20.2.12........
remove docker ones-agent images from DUT on the device 10.20.2.12........
docker image removed successfully on the device 10.20.2.12........
Removing work directory on the device 10.20.2.12........
removed work directory successfully on the device 10.20.2.12........
#####ones-agent uninstalltion completed from device=########## 10.20.2.12

Creating work directory  on the device 10.20.2.12........
Work Directory ones-agent_1725877821_191873 created successfully on the device 10.20.2.12 .............
Copying ones_agent_start.sh to directory ones-agent_1725877821_191873 on the device 10.20.2.12 .............
Copying ones_agent_start.sh to directory ones-agent_1725877821_191873 successful on the device 10.20.2.12 .............
ones_agent_start.sh file copied to /usr/bin successfully on the device 10.20.2.12........
Copying ones_agent_ip_rule.sh to directory ones-agent_1725877821_191873 on the device 10.20.2.12 .............
Copying ones_agent_ip_rule.sh to directory ones-agent_1725877821_191873 successful on the device 10.20.2.12 .............
ones_agent_ip_rule.sh file copied to /usr/bin successfully on the device 10.20.2.12........
Copying ones-agent.service to directory ones-agent_1725877821_191873 on the device 10.20.2.12 .............
Copying ones-agent.service to directory ones-agent_1725877821_191873 successful on the device 10.20.2.12 .............

Installation proceeding with NoTls mode
Copying agent.conf to directory ones-agent_1725877821_191873 successful on the device 10.20.2.12 .............
agent.conf copied to /etc/sonic successfully on the device 10.20.2.12........
Copying ones-agent.tar to directory ones-agent_1725877821_191873 on the device 10.20.2.12 .............
Copying ones-agent.tar to directory ones-agent_1725877821_191873 on the device 10.20.2.12 .............
Loading Docker image on the device 10.20.2.12 ###########################################
Docker image loaded successfully on the device 10.20.2.12........
Getting name of the loaded image
image = ##avizdock/ones-agent:v3.0.0##
Running docker.....................
docker run -it -v /var/run/docker.sock:/var/run/docker.sock -v /host/reboot-cause:/host/reboot-cause -v /etc/sonic:/etc/sonic -v /var/run/redis:/var/run/redis -v /var/run:/var/hostrun --log-driver local --log-opt max-size=5m --log-opt max-file=3 --cpu-period=100000 --cpu-quota=50000 --net=host --privileged -dt --name ones-agent avizdock/ones-agent:v3.0.0
b'969e2e65db674b594c7ced6f789b2b44ef7a8b556d28499a90c94ba4125b5c00\n'
Loading Service file on the device 10.20.2.12........
Service file loaded successfully on the device 10.20.2.12##################
Enabling ones-agent.service 10.20.2.12 ##################
Enabled ones-agent as service successfully on the device 10.20.2.12 ##################
Starting ones-agent service on the device 10.20.2.12........
Made ones-agent immune to booting on the device 10.20.2.12########################
Copying ones-agent.tar file
ones-agent.tar file copied successfully on the device 10.20.2.12........
Copying agent.conf file
agent.conf file copied successfully on the device 10.20.2.12........
Copying ones-agent.service file
ones-agent.service file copied successfully on the device 10.20.2.12........
Copying ones_agent_ip_rule.sh file
ones_agent_ip_rule.sh file copied successfully on the device 10.20.2.12........
Copying ones_agent_start.sh file
ones_agent_start.sh file copied successfully on the device 10.20.2.12........
##################################################################
Status of ones-agent.service is -      Active: active (running) since Mon 2024-09-09 16:03:52 IST; 1min 35s ago

removing backup files
removed backup directory successfully on the device 10.20.2.12........
Deployment of ones-agent to switch 10.20.2.12 is successful
╒══════════════╤══════════╕
│ IP Address   │ Result   │
╞══════════════╪══════════╡
│ 10.20.2.12   │ Pass     │
╘══════════════╧══════════╛
agent_installer

Docker agent_installer has been stopped
agent_installer

Docker agent_installer has been removed
Untagged: avizdock/agent_installer:latest
Deleted: sha256:180765aed1eba26b8d30d3bef983682a2b36a3507b7655c6e614f22dbbf80007
Deleted: sha256:7912382f54799a2f35358528c441af6bb745ba6fe6cb040a7be48347ff7e80a3
Deleted: sha256:fe33139b53a0b2b401d44f57a74ff789beb4a3a38792f80a793cc01611bab9e7
Deleted: sha256:38e2eba240dfe04c6d027aafc1954c84fc1eadeb3e4fd9d1e9a8ad7100686d7f
Deleted: sha256:53fdc4ec83b42d7060b4143da9ffbf9dd55e3bfa6fb4843bfacec19dcbd80e4b
Deleted: sha256:11b1633cb703032b065434387b48194f3e97a57aaddc61a31aa2918a1fd32780
Deleted: sha256:aa353210edce17d0370066fc6184cff9e2a9197884e6f43a0ad1fd32b630f8de
Deleted: sha256:b23b2f4af61d8cc745c6bea66be93bd59b97c3971c36466ae4ea345f52fdfc67
Deleted: sha256:b55ff4d1eb4dd15edbc9ffc15b1bd5771cd09c371b0e7c44cbcbd5c5f62ec76a
Deleted: sha256:e2ef8a51359d088511d34c725305c220294a1fcd5fe5e5dbe4d698c7239ce2c9

Docker avizdock/agent_installer image has been removed

ONES-3.0

Open Networking Enterprise Suite (ONES)

Introduction and Overview

Rule Engine

ONES Orchestration

Data Lake

Here are key components and characteristics of a ONE DL.

ONES Time Scale Metric Calculation

Overview

Below are the Average values Calculated by ONES-UI as per Time-Scale:

ONES Rule Engine

Overview

Notification

Rules are categorized based on the metric hierarchy

List of all the Metrics Supported by Rule Engine with possible units and measured value a user can use

ONE DL

Data Lake

Here are key components and characteristics of a ONE DL 1.0.0

ONES Cloud Service Integration

Users can control the behaviour of the Catalog

ONES Supportability

AVIZ Support Overview

ONES Supportability

ONES 3.0 Multisite

For a quicker glance about the health conditions, different colors and blinking patterns are used,

Supported Switch Platforms and NOS

SONiC Supported Broadcom Platforms:

SONiC Supported Cisco Platforms:

SONiC Supported Marvell Platforms:

SONiC Supported NVIDIA Platforms:

Vendor NOS Support:

Agent-based vs Agent-less

Agent requirements

ONES Installation

Installation Pre-requisites

Installation Overview

License Readiness

Trail license support feature

System Hardware Requirements – ONES Application

System Software Requirements - ONES Application

Customer Firewall Configuration (Ports to be opened)

Ports to be open from Agent(Source) to ONES controller(Destination)

Ports to be open from ONES controller(source) to Agent(Destination)

Ports to be open on ONES Server for ONES Services

Ports to be open for HTTPS Access

Network Switch (Managed Node) Configuration Requirement

Browser Requirements for ONES Web User Interface access

ONES Multisite

Download ONES Package

Installing ONES Application

Activation:

1. Activate License

2. Activate Key

Login To ONES

1. Upgrade License

If Switches Deployment is large so user needs to enable the large config inside Database Config File

ONE-DL cloud Deployment

Provisioning an EC2 Instance

AWS EC2 Instance Sizing for Event Ingestion

Install Docker

Install Docker Compose

Install ONE-DL

Installing ONES Agents 3.0

Overview

SONiC NOS upgrade scenario - Impact on ONES Agents

ONES Telemetry Agent Installation

ONES Agent v3.0 support Agent Auto discovery

Installation

Installation (Agent Install on multiple switches at the same time)

Installation Begin

ONES Server Agent Installation

Server Agent v3.0 support:

ONES Orchestration Agent Installation

Installation (Agent Install on multiple switches at the same time)

Agent Less Telemetry

Network Device Configuration Interfaces

Cumulus (NVUE API)

Cumulus(NVUE API)

Enable gNMI in Cumulus

Enable NVUE API in Cumulus