Verify Port Auto-negotiation
test_autoneg_001
Yes
Verify physical port operational down/up
test_ports_002
No
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify port configuration across reboot
test_ports_005
No
Verify Port Information for status, description and transceiver infornation
test_ports_006
Yes
Verify Port Counters for framesize 128
test_ports_009_14
Yes
Verify Port transceiver information
test_ports_020
Yes
Verify FEC Configuration for RS and None
test_ports_fec_001
Yes
Dynamic port breakout with supported breakout modes between leaf1 and leaf2
test_port_breakout_001
Yes
Verify that ping works properly when using LACP
test_ping_011
No
Verifying IPv4 (1518) MTU
test_mtu_001
Yes
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
This section verifies the mandatory functions for management operation in a Fabric
This category covers the validation of mandatory features and functions required for data center deployments.
Verify Platform CPU and Process Status
test_platform_003
Yes
Verify Platform PSU
test_platform_004
Yes
Verify Platform Tech-Support
test_platform_005
Yes
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify Platform Information
test_platform_001
Yes
Verify Platform Health Status
test_platform_002
Yes
Verify that IP address can be configured over routed port
test_IP_002
No
Verify SVI and routed ports can be admin down or up
test_IP_005
No
Verify connected route gets created for the SVI subnet in the ip route table.
test_IP_006
No
Verify IP interface is operational for SVI with LACP portchannel members
test_IP_011
No
Verify ip address can be configured over routed PCH.
test_IP_014
No
Verify BGP AS configuration works properly
test_bgp_001
No
Verify BGP peering happens with nodes in same AS and iBGP neighbor table gets updated properly
test_bgp_002
No
Verify BGP peering happens with nodes in different AS and eBGP neighbor table gets updated properly
test_bgp_003
No
Verify BGP route learning using eBGP with routes injected from IXIA
test_bgp_004
No
Verify BGP route removal using eBGP with routes withdrawn from IXIA
test_bgp_005
No
Verify BGP route relearn over different neighbor when interface is shutdown
test_bgp_006
No
Verify unnumbered functionality with iBGP
test_qual_bgp_001
Yes
Verify unnumbered functionality with eBGP
test_qual_bgp_002
Yes
Verify BGP route redistribution in DUT
test_qual_bgp_003
No
Verify BGP6 functionality
test_qual_bgp_004
No
Verify BGPV6 Functionality in DUT
test_qual_bgp_ebgp_004
No
Verify BGP AS-PATH prepend functionality
test_qual_bgp_007
No
Verify BGP route map match prefix list, access-list deny and permit functionality
test_qual_bgp_008
No
Verify BGP route map match AS-PATH permit and deny functionality
test_qual_bgp_009
No
Verify BGP route map match community list permit and deny functionality
test_qual_bgp_010
No
Verify BGP max MED functionality
test_qual_bgp_011
No
Verify BGP maximum prefix limit per peer functionality
test_qual_bgp_013
No
Verify BGP communities functionality
test_qual_bgp_014
No
Verify BGP regexp match single and multi AS permit & deny action using AS-path access lists
test_qual_bgp_015
No
Verify BGP regexp match any AS permit and deny action using AS-path access lists
test_qual_bgp_016
No
Verify BGP regexp match range of BGP communities functionality
test_qual_bgp_017
No
Verify BGP peering working with BGP listen range
test_qual_bgp_019
No
Verify VRF functionality
test_qual_vrf
Yes
Verify VLAN 1 support for Host connectivity
test_qual_vlan1
Yes
Verify IPV6 neighbor discovery
test_qual_ipv6_neighbor
No
Verify L3 DROP ACL functionality with matching source IP and source port
test_acl_001
No
Verify L3 DROP ACL functionality with matching destination IP and destination port
test_acl_002
No
Verify L3 DROP ACL functionality with matching SIP, DIP, SPORT, DPORT
test_acl_003
No
Verify L3 DROP ACL with ACL rule having subnet mask
test_acl_004
No
Verify L3 DROP ACL est acl rule with protocol = TCP
test_acl_005
No
Verify L3 DROP ACL - Test acl rule with protocol = UDP
test_acl_006
No
Verify L3 PERMIT ACL functionality with matching source IP and source port
test_acl_007
No
Verify L3 PERMIT ACL functionality with matching destination IP and destination port
test_acl_008
No
Verify L3 PERMIT ACL functionality with matching SIP, DIP, SPORT, DPORT
test_acl_009
No
Verify L3 PERMIT ACL with ACL rule having subnet mask
test_acl_010
No
Verify L3 PERMIT ACL - Test acl rule with protocol = TCP
test_acl_011
No
Verify L3 PERMIT ACL - Test acl rule with protocol = UDP
test_acl_012
No
Verify Drop ACL (IPv6) for matching source IPv6/L4 address and source IPv6L4 port
test_qual_ip6_acl_001
No
Verify Drop ACL (IPv6) for matching destination IPv6/L4 port and source IPv6L4 port
test_qual_ip6_acl_002
No
Verify drop ACL - matching IPv6 params subnet, dst, src ports combined
test_qual_ip6_acl_003
No
Verify PERMIT ACL (IPv6) for matching source IPv6/L4 address and source IPv6L4 port
test_qual_ip6_acl_004
No
Verify Permit ACL (IPv6) for matching destination IPv6/L4 port and source IPv6L4 port
test_qual_ip6_acl_005
No
Verify drop ACL - matching IPv6 params subnet, dst, src ports combined
test_qual_ip6_acl_006
No
Verify whether static ARP entry can be configured
test_arp_003
No
Verify that the DUT will respond to an ARP Request for the SVI interface
test_arp_007
No
Verify whether clear ARP entries works properly
test_arp_011
No
Verify whether ARP entries are flushed after some time
test_arp_012
Yes
Verify eBGP multi-AS config, adjacency, route convergence and data path using router interface
test_bgp_netops_001
No
eBGP Multi-AS Route Convergence and data path using loopback
test_bgp_netops_002
No
BGP Node Drain - Add route-map to remove and restore SPINE node 1 and 2 using Community list
test_bgp_netops_003_004
No
Test Link drain - Apply Route-Map permit
test_bgp_netops_005_006
No
Node drain: with IPv6 Traffic Test Node Drain (Spine 1 and Spine 2) for IPv6 Traffic/Prefixes
test_bgp_netops_007
No
Link drain with IPv6 Traffic Test Link Drain for IPv6 Traffic/Prefixes
test_bgp_netops_008
No
Node drain using prefix-lists
test_bgp_netops_009
No
Test Link Drain with Prefix Lists
test_bgp_netops_010
No
Node drain/restore using AS path prepend list
test_bgp_netops_011_012
No
Link drain using AS path prepend
test_bgp_netops_014
No
MC-LAG L3 validation using port-channel configuration
test_mclag_layer3_steady_state
Yes
MC-LAG L3 validation, Bring down the member link of SPINE01
test_mclag_layer3_member_link_down
Yes
MC-LAG L3 keepalive link down
test_mclag_layer3_keepalive_link_down
Yes
MCLAG-L3 Active Reboot
test_mclag_layer3_active_reboot
Yes
MCLAG-L3 Standby Reboot
test_mclag_layer3_standby_reboot
Yes
Apply QoS with DSCP-0 to TC-0 mapping
test_dscp_0_tc_0
Yes
Apply QoS with DSCP-8 to TC-1 mapping
test_dscp_8_tc_1
Yes
Apply QoS with DSCP-16 to TC-2 mapping
test_dscp_16_tc_2
Yes
Apply QoS with DSCP-24 to TC-3 mapping
test_dscp_24_tc_3
Yes
Apply QoS with DSCP-32 to TC-4
mapping
test_dscp_32_tc_4
Yes
Apply QoS with DSCP-40 to TC-5 mapping
test_dscp_40_tc_5
Yes
Apply QoS with DSCP-48 to TC-6 mapping
test_dscp_48_tc_6
Yes
Apply QoS with DSCP-56 to TC-7 mapping
test_dscp_56_tc_7
Yes
Validate whether the DUT applies QoS using DOT1P-0 to TC-0 mapping
test_dot1p0_tc0
Yes
Validate whether the DUT applies QoS using DOT1P-1 to TC-1 mapping
test_dot1p1_tc1
Yes
Validate whether the DUT applies QoS using DOT1P-2 to TC-2 mapping
test_dot1p2_tc2
Yes
Validate whether the DUT applies QoS using DOT1P-3 to TC-3 mapping
test_dot1p3_tc3
Yes
Validate whether the DUT applies QoS using DOT1P-4 to TC-4 mapping
test_dot1p4_tc4
Yes
Validate whether the DUT applies QoS using DOT1P-5 to TC-5 mapping
test_dot1p5_tc5
Yes
Validate whether the DUT applies QoS using DOT1P-6 to TC-6 mapping
test_dot1p6_tc6
Yes
Validate whether the DUT applies QoS using DOT1P-7 to TC-7 mapping
test_dot1p7_tc7
Yes
Verify basic EVPN VxLAN functionality
test_evpn_vxlan_feature
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 16K routes
test_bgp_unnumbered_evpn_vxlan_inter_vlan_scale_16k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 32K routes
test_bgp_unnumbered_evpn_vxlan_inter_vlan_scale_32k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 64K routes
test_bgp_unnumbered_evpn_vxlan_inter_vlan_scale_64k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 128K routes
test_bgp_unnumbered_evpn_vxlan_inter_vlan_scale_128k
Yes
Configure BGP L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 16K routes
test_bgp_numbered_evpn_vxlan_inter_vlan_scale_16k
Yes
Configure BGP L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 32K routes
test_bgp_numbered_evpn_vxlan_inter_vlan_scale_32k
Yes
Configure BGP L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 64K routes
test_bgp_numbered_evpn_vxlan_inter_vlan_scale_64k
Yes
Configure BGP L3 EVPN-VXLAN and send L3 inter-VLAN traffic for 128K routes
test_bgp_numbered_evpn_vxlan_inter_vlan_scale_128k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN
test_bgp_evpn_vxlan_l3_ecmp_with_node_drain
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN
test_bgp_evpn_vxlan_l3_ecmp_with_link_drain
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN
test_bgp_evpn_vxlan_with_sag
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 intra-VLAN traffic for 16K routes
test_bgp_unnumbered_evpn_vxlan_intra_vlan_scale_16k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 intra-VLAN traffic for 32K routes
test_bgp_unnumbered_evpn_vxlan_intra_vlan_scale_32k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 intra-VLAN traffic for 64K routes
test_bgp_unnumbered_evpn_vxlan_intra_vlan_scale_64k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 intra-VLAN traffic for 128K routes
test_bgp_unnumbered_evpn_vxlan_intra_vlan_scale_128k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN
test_evpn_vxlan_l2_traffic
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 16K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_16k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 32K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_32k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 64K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_64k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 128K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_128k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN
test_evpn_vxlan_l3_inter_vlan
Yes
Configure EVPN-VXLAN and send bidirectional traffic with inter-VLAN for 16K routes
test_bgp_evpn_vxlan_l2_inter_vlan_scale_16k
Yes
Configure EVPN-VXLAN and send bidirectional traffic with inter-VLAN for 32K routes
test_bgp_evpn_vxlan_l2_inter_vlan_scale_32k
Yes
Configure EVPN-VXLAN and send bidirectional traffic with inter-VLAN for 64K routes
test_bgp_evpn_vxlan_l2_inter_vlan_scale_64k
Yes
Configure EVPN-VXLAN and send bidirectional traffic with inter-VLAN for 128K routes
test_bgp_evpn_vxlan_l2_inter_vlan_scale_128k
Yes
Configure BGP unnumbered L3 EVPN-VXLAN and send L3 inter-VLAN traffic with reboot
test_bgp_l3_evpn_vxlan_route_reboot
Yes
QoS DWRR scheduling algorithm with the default configuration
test_qos_dwrr_happy_baseline
Yes
Calculate the congestion buffer size based on the frame size
test_single_queue_congestion_buffer_frame_size
Yes
Buffer test with multiple congested queues
test_buffer_test_multiple_congested_queues
Yes
DHCP relay static MAC functionality
test_dhcp_relay_static_mac_functionality
No
DHCP relay static mac functionality with SVI interface
test_dhcp_relay_svi_functionality
No
DHCP relay functionality after a warm reboot of the relay agent
test_dhcp_relay_warmreboot
No
Restart dhcp relay docker
test_dhcp_relay_restart
No
Verify DHCP relay with the client and server using trunk VLAN configuration
test_dhcp_relay_vlan_tagged
No
DHCP relay server not available
test_dhcp_relay_server_not_available
No
DHCP relay with multiple DHCP servers
test_run_dhcp_relay_multi_server_test
No
Test VRRP steady state configuration
test_vrrp_steady_state_with_reboot
Yes
Test VRRP interface tracking functionality
test_vrrp_interface_tracking
Yes
Test VRRP priority change scenario
test_vrrp_change_priotity
Yes
Test VRRP configuration with non-preemptive mode enabled.
test_vrrp_non_preemptive
Yes
Test VRRP behavior during link down scenario
test_vrrp_link_down
Yes
Test configuration and behavior of multiple VRRP instances on the same VLAN.
test_vrrp_multiple_instance
Yes
Test VRRP functionality in a VRF-aware environment.
test_vrrp_with_vrf_with_reboot
Yes
Inject and withdraw 80000 type-5 routes
test_inject_withdrawal_type5_routes
Yes
Inject 80000 type-5 routes and restart bgp container on the DUT
test_vxlan_vrf_bgp_docker_restart
Yes
Restart swss docker on remote leaf to simulate VTEP failure and verify convergence
test_vxlan_vrf_swss_docker_restart
Yes
Inject 80000 type-5 routes and reboot the peer
test_vxlan_type5_routes_peer_reboot
Yes
VM mobility
test_vmotion
Yes
IPv6 host routes scale to 64k route (iBGP)
test_v6_host_routes_scale_ibgp_64k
Yes
Interface description CLI
test_interface_description
No
IPv6 link-local address and PortChannel interface
test_ipv6_portchannel_linklocal
Yes
IPv6 link-local address and VLAN interface
test_ipv6_vlan_linklocal
IPv6 route injection and withdrawal with BGP unnumbered
test_bgpu_v6_inject_withdraw_255
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify that ping works over ECMP
test_ping_013
No
Verify that IP address can be configured over SVI
test_IP_001
No
Verify ERSPAN by configuring a mirror from ACL match to destination IP in ingress directions
test_port_span_003
Yes
Verify whether SNMP configurations
test_snmp_config
No
Verify SNMP Get/GetNext/Walk requests MIBS: ENTITY, IF-MIB, IP-MIB,
test_snmp_commands
No
Verify Config load for incremental configuration
test_config_load
No
Verify IPv6 address configuration on Front Panel (Data) ports
test_front_panel_ports_ipv6
No
Verify config reload to restore configuration
test_cfg_backup_restore
No
Verify syslogs are generated properly on link down/up
test_syslog_002
No
Verify syslogs are generated properly on LACP UP/Down
test_syslog_004
No
Verify SSH from host to SONIC on management interface
test_ssh_001
No
Verify SSH from host to SVI interface and routed port
test_ssh_002
No
Verify whether the session is successfully closed right after SSH disconnect from the client.
test_ssh_003
No
Verify Tacacs+ with AAA authentication
test_tacacs_001
No
Verify NTP server works as clock source correctly
test_ntp_007
No
Verify timezone can be manually configured.
test_timezone_001
No
Verify ping from SONIC SVI interface and routed port
test_ping_001
No
Verify that ping works properly with multiple parameter combination
test_ping_009
No
Verify that SONiC Version and serial information can be retrieved via SNMP_WALK command
test_snmp_walk_version_serial
No
Verify that SONiC interface index information can be retrieved via SNMP_WALK command
test_snmp_walk_inf_index
No
Verify that SONiC interface name information can be retrieved via SNMP_WALK command
test_snmp_walk_inf_name
No
Verify that SONiC interface admin and oper status info can be retrieved via SNMP_WALK command
test_snmp_walk_inf_admin_oper
No
Verify that SONiC interface type info can be retrieved via SNMP_WALK command
test_snmp_walk_inf_type
No
Verify that tagged ports vlan id can be retrieved using the SNMP_WALK command
test_snmp_walk_vlan_tagged_ports
No
Verify that untagged ports vlan id can be retrieved using the SNMP_WALK command
test_snmp_walk_vlan_untagged_ports
No
Verify that LLDP neighbor info. can be retrieved via SNMP_WALK command
test_snmp_walk_lldp
No
Verify that routing information can be retrieved via SNMP_WALK command
test_snmp_walk_ip_routing_info
No
Verify that SONiC IP interface index and netmask info can be retrieved via SNMP_WALK command
test_snmp_walk_ip_inf_index_and_netmask
No
SNMP walk to loopback interface to retrieve the interface index and netmask
test_snmp_walk_to_loopback_to_get_intfindex_netmask
No
SNMP walk to loopback interface to retrieve the mac address
test_snmp_walk_to_loopback_to_get_macaddress
No
SSH over SVI interface
test_ssh_004
No
Verify syslog capture in TCP dumps on link down/up events
test_syslog_tcp_dump
No
TACACS passkey is encrypted in the configuration
test_tacacs_passkey_encryption
No
Verify that a configured time zone is synchronized with the system time
test_frr_timezone_sync
No
NTP configuration with mgmt VRF
test_ntp_vrf
No
MGMT VRF configuration
test_mgmt_vrf
No
SSH using control plane ACL
test_ctrlplane_acl_ssh
No
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify SPAN with source ports (and LAG) to the destination port in ingress/egress/both directions.
test_port_span_001
Yes
Verify ERSPAN by configuring a mirror with the list of source ports/LAG to destination IP in ingress/egress/both directions
test_port_span_002
Yes
Verify MTU functionality for Jumboframe packets
test_ports_mtu_002
Yes
Enable LLDP globally and disable per-port basis
test_lldp_001
No
Verify that user can enable/disable LLDP globally
test_lldp_002
No
Verify LLDP neighbors are learnt properly with proper ChassisID, portID, system name, system
test_lldp_013
No
Verify LACP member addition and removal
test_lacp_003
No
Verify LACP functionality across reboot
test_lacp_005
No
Verify LACP functionality after link failover/failback of physical interface
test_lacp_011
No
Verify LACP functionality after removal and addition of port-channel member
test_lacp_012
No
Verify whether user can create/delete VLAN
test_vlan_001
No
Verify whether user can add/modify/delete ports to the VLAN as tagged/untagged members
test_vlan_002
No
Verify the ability to configure a port as untagged VLAN member
test_vlan_004
No
Verify the ability to configure a port as tagged VLAN member
test_vlan_005
No
Verify that the user can configure port-channel interface as untagged VLAN member
test_vlan_007
No
Verify that the user can configure port-channel interface as tagged VLAN members
test_vlan_008
No
Warm Reboot - Device configuration impact for VLAN Config
test_vlan_011
Yes
Verify whether user can configure port as untagged member of a VLAN
test_vlan_014
No
Verify whether known unicast traffic is forwarded to the destination port-channel
test_vlan_016
No
EVPN_VXLAN Configuration and show commands
test_bgp4_evpn_vxlan_001
Yes
EVPN VXLAN for known unicast, BUM traffic (eBGP) with RIF
test_bgp4_evpn_vxlan_002
Yes
EVPN VXLAN for known unicast, BUM traffic (eBGP) with SVI
test_bgp4_evpn_vxlan_003
Yes
EVPN VXLAN for known unicast traffic (eBGP) with link events and router failure - RIF
test_bgp4_evpn_vxlan_005
Yes
EVPN VXLAN for known unicast traffic (eBGP) with link events and router failure - SVI
test_bgp4_evpn_vxlan_006
Yes
EVPN VXLAN for known unicast traffic (eBGP) with link events and router failure - RPCH
test_bgp4_evpn_vxlan_007
Yes
Asymmetric IRB with EVPN eBGP
test_bgp4_evpn_vxlan_015
Yes
Asymmetric IRB with EVPN iBGP
test_bgp4_evpn_vxlan_016
Yes
MC-LAG L2 validation using port-channel configuration
test_mclag_layer2_steady_state
Yes
MC-LAG L2 validation, Bring down the member link of SPINE01
test_mclag_layer2_member_link_down
Yes
MC-LAG L2 keepalive link down
test_mclag_layer2_peer_link_down
Yes
MCLAG-L2Active Reboot
test_mclag_layer2_active_reboot
Yes
MCLAG-L2 Standby Reboot
test_mclag_layer2_standby_reboot
Yes
Storm control CLI
test_storm_control_cli_verification
Yes
DUT throws proper error for invalid storm-control input
test_storm_control_invalid_input
Yes
Storm control with broadcast traffic
test_storm_control_broadcast
Yes
Storm control with unknown-unicast traffic
test_storm_control_unknown_unicast
Yes
Storm control with unknown-multicast traffic
test_storm_control_unknown_multicast
Yes
Storm control configuration and behavior
during warm-reboot
test_storm_control_warm_reboot
Yes
Configure STP on the devices check for loop free topology with root bridge selection
test_configure_stp_validate
Yes
Enable STP, ensure loop-free topology, configure priority and spine set as root bridge
test_stp_priority
Yes
Edge port transition to forwarding state with portfast enabled
test_port_fast
Yes
Create a static LAG and verify the traffic flow
test_pch_creation
Yes
Add delete members to static LAG and verify the traffic flow
test_pch_sec_member_add_del
Yes
Static LAG recovers after restarting the teamd container
test_lag_docker_teamd_reboot
Yes
Static LAG entry in redis
test_create_pch_check_rediscli
Yes
Static LAG member entry in redis
test_mem_pch_rediscli_check
Yes
Shut and no shut the static LAG
test_shut_noshut_pch
Yes
