| Description | Test Case ID | PD | Topology |
|---|---|---|---|
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify Platform Information
test_platform_001
Yes
Verify Platform Health Status
test_platform_002
Yes
Verify Platform CPU and Process Status
test_platform_003
Yes
Verify Platform PSU
test_platform_004
Yes
Verify Platform Tech-Support
test_platform_005
Yes
This category covers the validation of mandatory features and functions required for data center deployments.
| Description | Test Case ID | PD | Topology |
|---|---|---|---|
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
| Description | Test Case ID | PD | Topology |
|---|
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify that ping works properly when using LACP | test_ping_011 | No |
Verifying IPv4 (1518) MTU | test_mtu_001 | Yes |
Verify MTU functionality for Jumboframe packets | test_ports_mtu_002 | Yes |
Enable LLDP globally and disable per-port basis | test_lldp_001 | No |
Verify that user can enable/disable LLDP globally | test_lldp_002 | No |
Verify LLDP neighbors are learnt properly with proper ChassisID, portID, system name, system | test_lldp_013 | No |
Verify LACP member addition and removal | test_lacp_003 | No |
Verify LACP functionality across reboot | test_lacp_005 | No |
Verify LACP functionality after link failover/failback of physical interface | test_lacp_011 | No |
Verify LACP functionality after removal and addition of port-channel member | test_lacp_012 | No |
Verify whether user can create/delete VLAN | test_vlan_001 | No |
Verify whether user can add/modify/delete ports to the VLAN as tagged/untagged members | test_vlan_002 | No |
Verify the ability to configure a port as untagged VLAN member | test_vlan_004 | No |
Verify the ability to configure a port as tagged VLAN member | test_vlan_005 | No |
Verify that the user can configure port-channel interface as untagged VLAN member | test_vlan_007 | No |
Verify that the user can configure port-channel interface as tagged VLAN members | test_vlan_008 | No |
Warm Reboot - Device configuration impact for VLAN Config | test_vlan_011 | Yes |
Verify whether user can configure port as untagged member of a VLAN | test_vlan_014 | No |
Verify whether known unicast traffic is forwarded to the destination port-channel | test_vlan_016 | No |
EVPN_VXLAN Configuration and show commands | test_bgp4_evpn_vxlan_001 | Yes |
EVPN VXLAN for known unicast, BUM traffic (eBGP) with RIF | test_bgp4_evpn_vxlan_002 | Yes |
EVPN VXLAN for known unicast, BUM traffic (eBGP) with SVI | test_bgp4_evpn_vxlan_003 | Yes |
EVPN VXLAN for known unicast traffic (eBGP) with link events and router failure - RIF | test_bgp4_evpn_vxlan_005 | Yes |
EVPN VXLAN for known unicast traffic (eBGP) with link events and router failure - SVI | test_bgp4_evpn_vxlan_006 | Yes |
EVPN VXLAN for known unicast traffic (eBGP) with link events and router failure - RPCH | test_bgp4_evpn_vxlan_007 | Yes |
Asymmetric IRB with EVPN eBGP | test_bgp4_evpn_vxlan_015 | Yes |
Asymmetric IRB with EVPN iBGP | test_bgp4_evpn_vxlan_016 | Yes |
MC-LAG L2 validation using port-channel configuration | test_mclag_layer2_steady_state | Yes |
MC-LAG L2 validation, Bring down the member link of SPINE01 | test_mclag_layer2_member_link_down | Yes |
MC-LAG L2 keepalive link down | test_mclag_layer2_peer_link_down | Yes |
MCLAG-L2Active Reboot | test_mclag_layer2_active_reboot | Yes |
MCLAG-L2 Standby Reboot | test_mclag_layer2_standby_reboot | Yes |
Storm control CLI | test_storm_control_cli_verification | Yes |
DUT throws proper error for invalid storm-control input | test_storm_control_invalid_input | Yes |
Storm control with broadcast traffic | test_storm_control_broadcast | Yes |
Storm control with unknown-unicast traffic | test_storm_control_unknown_unicast | Yes |
Storm control with unknown-multicast traffic | test_storm_control_unknown_multicast | Yes |
Storm control configuration and behavior during warm-reboot | test_storm_control_warm_reboot | Yes |
Configure STP on the devices check for loop free topology with root bridge selection | test_configure_stp_validate | Yes |
Enable STP, ensure loop-free topology, configure priority and spine set as root bridge | test_stp_priority | Yes |
Edge port transition to forwarding state with portfast enabled | test_port_fast | Yes |
Create a static LAG and verify the traffic flow | test_pch_creation | Yes |
Add delete members to static LAG and verify the traffic flow | test_pch_sec_member_add_del
| Yes |
Static LAG recovers after restarting the teamd container | test_lag_docker_teamd_reboot | Yes |
Static LAG entry in redis | test_create_pch_check_rediscli | Yes |
Static LAG member entry in redis | test_mem_pch_rediscli_check | Yes |
Shut and no shut the static LAG | test_shut_noshut_pch | Yes |
Verify Port Auto-negotiation
test_autoneg_001
Yes
Verify physical port operational down/up
test_ports_002
No
Verify port configuration across reboot
test_ports_005
No
Verify Port Information for status, description and transceiver infornation
test_ports_006
Yes
Verify Port Counters for framesize 128
test_ports_009_14
Yes
Verify Port transceiver information
test_ports_020
Yes
Verify FEC Configuration for RS and None
test_ports_fec_001
Yes
Dynamic port breakout with supported breakout modes between leaf1 and leaf2
test_port_breakout_001
Yes
| Description | Test Case ID | PD | Topology |
|---|---|---|---|
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
This section verifies the mandatory functions for management operation in a Fabric
| Description | Test Case ID | PD | Topology |
|---|---|---|---|
PD(Platform dependent) means that FTAS is designed to work with specific hardware and software configurations and may not be compatible with other platforms.
Verify that ping works over ECMP
test_ping_013
No
Verify that IP address can be configured over SVI
test_IP_001
No
Verify that IP address can be configured over routed port
test_IP_002
No
Verify SVI and routed ports can be admin down or up
test_IP_005
No
Verify connected route gets created for the SVI subnet in the ip route table.
test_IP_006
No
Verify IP interface is operational for SVI with LACP portchannel members
test_IP_011
No
Verify ip address can be configured over routed PCH.
test_IP_014
No
Verify BGP AS configuration works properly
test_bgp_001
No
Verify BGP peering happens with nodes in same AS and iBGP neighbor table gets updated properly
test_bgp_002
No
Verify BGP peering happens with nodes in different AS and eBGP neighbor table gets updated properly
test_bgp_003
No
Verify BGP route learning using eBGP with routes injected from IXIA
test_bgp_004
No
Verify BGP route removal using eBGP with routes withdrawn from IXIA
test_bgp_005
No
Verify BGP route relearn over different neighbor when interface is shutdown
test_bgp_006
No
Verify unnumbered functionality with iBGP
test_qual_bgp_001
Yes
Verify unnumbered functionality with eBGP
test_qual_bgp_002
Yes
Verify BGP route redistribution in DUT
test_qual_bgp_003
No
Verify BGP6 functionality
test_qual_bgp_004
No
Verify BGPV6 Functionality in DUT
test_qual_bgp_ebgp_004
No
Verify BGP AS-PATH prepend functionality
test_qual_bgp_007
No
Verify BGP route map match prefix list, access-list deny and permit functionality
test_qual_bgp_008
No
Verify BGP route map match AS-PATH permit and deny functionality
test_qual_bgp_009
No
Verify BGP route map match community list permit and deny functionality
test_qual_bgp_010
No
Verify BGP max MED functionality
test_qual_bgp_011
No
Verify BGP maximum prefix limit per peer functionality
test_qual_bgp_013
No
Verify BGP communities functionality
test_qual_bgp_014
No
Verify BGP regexp match single and multi AS permit & deny action using AS-path access lists
test_qual_bgp_015
No
Verify BGP regexp match any AS permit and deny action using AS-path access lists
test_qual_bgp_016
No
Verify BGP regexp match range of BGP communities functionality
test_qual_bgp_017
No
Verify BGP peering working with BGP listen range
test_qual_bgp_019
No
Verify VRF functionality
test_qual_vrf
Yes
Verify VLAN 1 support for Host connectivity
test_qual_vlan1
Yes
Verify IPV6 neighbor discovery
test_qual_ipv6_neighbor
No
Verify L3 DROP ACL functionality with matching source IP and source port
test_acl_001
No
Verify L3 DROP ACL functionality with matching destination IP and destination port
test_acl_002
No
Verify L3 DROP ACL functionality with matching SIP, DIP, SPORT, DPORT
test_acl_003
No
Verify L3 DROP ACL with ACL rule having subnet mask
test_acl_004
No
Verify L3 DROP ACL est acl rule with protocol = TCP
test_acl_005
No
Verify L3 DROP ACL - Test acl rule with protocol = UDP
test_acl_006
No
Verify L3 PERMIT ACL functionality with matching source IP and source port
test_acl_007
No
Verify L3 PERMIT ACL functionality with matching destination IP and destination port
test_acl_008
No
Verify L3 PERMIT ACL functionality with matching SIP, DIP, SPORT, DPORT
test_acl_009
No
Verify L3 PERMIT ACL with ACL rule having subnet mask
test_acl_010
No
Verify L3 PERMIT ACL - Test acl rule with protocol = TCP
test_acl_011
No
Verify L3 PERMIT ACL - Test acl rule with protocol = UDP
test_acl_012
No
Verify Drop ACL (IPv6) for matching source IPv6/L4 address and source IPv6L4 port
test_qual_ip6_acl_001
No
Verify Drop ACL (IPv6) for matching destination IPv6/L4 port and source IPv6L4 port
test_qual_ip6_acl_002
No
Verify drop ACL - matching IPv6 params subnet, dst, src ports combined
test_qual_ip6_acl_003
No
Verify PERMIT ACL (IPv6) for matching source IPv6/L4 address and source IPv6L4 port
test_qual_ip6_acl_004
No
Verify Permit ACL (IPv6) for matching destination IPv6/L4 port and source IPv6L4 port
test_qual_ip6_acl_005
No
Verify drop ACL - matching IPv6 params subnet, dst, src ports combined
test_qual_ip6_acl_006
No
Verify whether static ARP entry can be configured
test_arp_003
No
Verify that the DUT will respond to an ARP Request for the SVI interface
test_arp_007
No
Verify whether clear ARP entries works properly
test_arp_011
No
Verify whether ARP entries are flushed after some time
test_arp_012
Yes
Verify eBGP multi-AS config, adjacency, route convergence and data path using router interface
test_bgp_netops_001
No
eBGP Multi-AS Route Convergence and data path using loopback
test_bgp_netops_002
No
BGP Node Drain - Add route-map to remove and restore SPINE node 1 and 2 using Community list
test_bgp_netops_003_004
No
Test Link drain - Apply Route-Map permit
test_bgp_netops_005_006
No
Node drain: with IPv6 Traffic Test Node Drain (Spine 1 and Spine 2) for IPv6 Traffic/Prefixes
test_bgp_netops_007
No
Link drain with IPv6 Traffic Test Link Drain for IPv6 Traffic/Prefixes
test_bgp_netops_008
No
Node drain using prefix-lists
test_bgp_netops_009
No
Test Link Drain with Prefix Lists
test_bgp_netops_010
No
Node drain/restore using AS path prepend list
test_bgp_netops_011_012
No
Link drain using AS path prepend
test_bgp_netops_014
No
MC-LAG L3 validation using port-channel configuration
test_mclag_layer3_steady_state
Yes
MC-LAG L3 validation, Bring down the member link of SPINE01
test_mclag_layer3_member_link_down
Yes
MC-LAG L3 keepalive link down
test_mclag_layer3_keepalive_link_down
Yes
MCLAG-L3 Active Reboot
test_mclag_layer3_active_reboot
Yes
MCLAG-L3 Standby Reboot
test_mclag_layer3_standby_reboot
Yes
Symmetric IRB with EVPN eBGP-RIF with s1_as_num=3000, s2_as_num=4000
test_bgp4_evpn_vxlan_009
Yes
Symmetric IRB with EVPN iBGP-RIF with s1_as_num=5000, s2_as_num=5000
test_bgp4_evpn_vxlan_010
Yes
Symmetric IRB with EVPN iBGP-SVI with s1_as_num=5000, s2_as_num=5000
test_bgp4_evpn_vxlan_012
Yes
Symmetric IRB with EVPN eBGP-RPCH with s1_as_num=3000, s2_as_num=4000
test_bgp4_evpn_vxlan_013
Yes
Symmetric IRB with EVPN iBGP-RPCH with s1_as_num=5000, s2_as_num=5000
test_bgp4_evpn_vxlan_014
Yes
Apply QoS with DSCP-0 to TC-0 mapping
test_dscp_0_tc_0
Yes
Apply QoS with DSCP-8 to TC-1 mapping
test_dscp_8_tc_1
Yes
Apply QoS with DSCP-16 to TC-2 mapping
test_dscp_16_tc_2
Yes
Apply QoS with DSCP-24 to TC-3 mapping
test_dscp_24_tc_3
Yes
Apply QoS with DSCP-32 to TC-4
mapping
test_dscp_32_tc_4
Yes
Apply QoS with DSCP-40 to TC-5 mapping
test_dscp_40_tc_5
Yes
Apply QoS with DSCP-48 to TC-6 mapping
test_dscp_48_tc_6
Yes
Apply QoS with DSCP-56 to TC-7 mapping
test_dscp_56_tc_7
Yes
Validate whether the DUT applies QoS using DOT1P-0 to TC-0 mapping
test_dot1p0_tc0
Yes
Validate whether the DUT applies QoS using DOT1P-1 to TC-1 mapping
test_dot1p1_tc1
Yes
Validate whether the DUT applies QoS using DOT1P-2 to TC-2 mapping
test_dot1p2_tc2
Yes
Validate whether the DUT applies QoS using DOT1P-3 to TC-3 mapping
test_dot1p3_tc3
Yes
Validate whether the DUT applies QoS using DOT1P-4 to TC-4 mapping
test_dot1p4_tc4
Yes
Validate whether the DUT applies QoS using DOT1P-5 to TC-5 mapping
test_dot1p5_tc5
Yes
Validate whether the DUT applies QoS using DOT1P-6 to TC-6 mapping
test_dot1p6_tc6
Yes
Validate whether the DUT applies QoS using DOT1P-7 to TC-7 mapping
test_dot1p7_tc7
Yes
Verify basic EVPN VxLAN functionality
test_evpn_vxlan_feature
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN
test_evpn_vxlan_l3_traffic
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 16K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_16k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 32K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_32k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 64K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_64k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with intra-VLAN for 128K routes
test_bgp_evpn_vxlan_l3_intra_vlan_scale_128k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN
test_evpn_vxlan_l3_inter_vlan
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN for 16K routes
test_bgp_evpn_vxlan_inter_vlan_scale_16k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN for 32K routes
test_bgp_evpn_vxlan_inter_vlan_scale_32k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN for 64K routes
test_bgp_evpn_vxlan_inter_vlan_scale_64k
Yes
Configure EVPN-VXLAN and send bidirectional L3 traffic with inter-VLAN for 128K routes
test_bgp_evpn_vxlan_inter_vlan_scale_128k
Yes
Verify SPAN with source ports (and LAG) to the destination port in ingress/egress/both directions.
test_port_span_001
Yes
Verify ERSPAN by configuring a mirror with the list of source ports/LAG to destination IP in ingress/egress/both directions
test_port_span_002
Yes
Verify ERSPAN by configuring a mirror from ACL match to destination IP in ingress directions
test_port_span_003
Yes
Verify whether SNMP configurations
test_snmp_config
No
Verify SNMP Get/GetNext/Walk requests MIBS: ENTITY, IF-MIB, IP-MIB,
test_snmp_commands
No
Verify Config load for incremental configuration
test_config_load
No
Verify IPv6 address configuration on Front Panel (Data) ports
test_front_panel_ports_ipv6
No
Verify config reload to restore configuration
test_cfg_backup_restore
No
Verify syslogs are generated properly on link down/up
test_syslog_002
No
Verify syslogs are generated properly on LACP UP/Down
test_syslog_004
No
Verify SSH from host to SONIC on management interface
test_ssh_001
No
Verify SSH from host to SVI interface and routed port
test_ssh_002
No
Verify whether the session is successfully closed right after SSH disconnect from the client.
test_ssh_003
No
Verify Tacacs+ with AAA authentication
test_tacacs_001
No
Verify NTP server works as clock source correctly
test_ntp_007
No
Verify timezone can be manually configured.
test_timezone_001
No
Verify ping from SONIC SVI interface and routed port
test_ping_001
No
Verify that ping works properly with multiple parameter combination
test_ping_009
No
Verify that SONiC Version and serial information can be retrieved via SNMP_WALK command
test_snmp_walk_version_serial
No
Verify that SONiC interface index information can be retrieved via SNMP_WALK command
test_snmp_walk_inf_index
No
Verify that SONiC interface name information can be retrieved via SNMP_WALK command
test_snmp_walk_inf_name
No
Verify that SONiC interface admin and oper status info can be retrieved via SNMP_WALK command
test_snmp_walk_inf_admin_oper
No
Verify that SONiC interface type info can be retrieved via SNMP_WALK command
test_snmp_walk_inf_type
No
Verify that tagged ports vlan id can be retrieved using the SNMP_WALK command
test_snmp_walk_vlan_tagged_ports
No
Verify that untagged ports vlan id can be retrieved using the SNMP_WALK command
test_snmp_walk_vlan_untagged_ports
No
Verify that LLDP neighbor info. can be retrieved via SNMP_WALK command
test_snmp_walk_lldp
No
Verify that routing information can be retrieved via SNMP_WALK command
test_snmp_walk_ip_routing_info
No
Verify that SONiC IP interface index and netmask info can be retrieved via SNMP_WALK command
test_snmp_walk_ip_inf_index_and_netmask
No
