[HEALTH] 4.23/main Health Check, please don't merge this!

[sureshanaparti]

Description

This is a dummy PR to kick smoketests on 4.23/main branch.

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)
• Build/CI
• Test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

• Major
• Minor

Bug Severity

• BLOCKER
• Critical
• Major
• Minor
• Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

[sureshanaparti]

@blueorangutan package

[blueorangutan]

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 17.60%. Comparing base (34b8870) to head (23389c2).

Additional details and impacted files

@@            Coverage Diff            @@
##               main   #12198   +/-   ##
=========================================
  Coverage     17.60%   17.60%           
- Complexity    15668    15669    +1     
=========================================
  Files          5915     5915           
  Lines        529963   529963           
  Branches      64734    64734           
=========================================
+ Hits          93300    93309    +9     
+ Misses       426194   426186    -8     
+ Partials      10469    10468    -1     

Flag	Coverage Δ
uitests	3.58% <ø> (ø)
unittests	18.67% <ø> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15929

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-14947)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 59536 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14947-kvm-ubuntu22.zip
Smoke tests completed. 147 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_deployVMInSharedNetwork	Error	280.43	test_network.py
test_01_primary_storage_nfs	Error	0.17	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	Error	0.28	test_primary_storage.py
test_01_primary_storage_scope_change	Error	0.13	test_primary_storage_scope.py

[blueorangutan]

[SF] Trillian test result (tid-14942)
Environment: kvm-ol9 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 72211 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14942-kvm-ol9.zip
Smoke tests completed. 146 look OK, 4 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_uservm_host_control_state	Failure	18.27	test_host_control_state.py
ContextSuite context=TestHostControlState>:teardown	Error	31.83	test_host_control_state.py
test_01_vpn_usage	Error	1.09	test_usage.py
test_01_secure_vm_migration	Error	369.21	test_vm_life_cycle.py
test_02_unsecure_vm_migration	Error	0.02	test_vm_life_cycle.py
test_03_secured_to_nonsecured_vm_migration	Error	0.01	test_vm_life_cycle.py
test_04_nonsecured_to_secured_vm_migration	Error	0.01	test_vm_life_cycle.py
test_hostha_enable_ha_when_host_disabled	Error	1.84	test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance	Error	304.11	test_hostha_kvm.py

[blueorangutan]

[SF] Trillian test result (tid-14939)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 73773 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14939-xcpng82.zip
Smoke tests completed. 137 look OK, 13 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	141.31	test_events_resource.py
ContextSuite context=TestIpv4Routing>:setup	Error	0.00	test_ipv4_routing.py
test_03_deploy_and_scale_kubernetes_cluster	Failure	71.73	test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster	Failure	205.72	test_kubernetes_clusters.py
test_12_test_deploy_cluster_different_offerings_per_node_type	Failure	144.27	test_kubernetes_clusters.py
test_04_list_domains_level_filter	Failure	0.06	test_list_domains.py
test_05_list_domains_no_filter	Failure	0.03	test_list_domains.py
test_01_non_strict_host_anti_affinity	Failure	262.56	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	56.14	test_nonstrict_affinity_group.py
test_01_add_primary_storage_disabled_host	Error	15.56	test_primary_storage.py
test_01_primary_storage_iscsi	Error	3.98	test_primary_storage.py
test_01_primary_storage_nfs	Error	0.19	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	Error	0.36	test_primary_storage.py
test_01_scale_vm	Error	383.26	test_scale_vm.py
test_04_scale_vm_with_user_account	Error	385.21	test_scale_vm.py
test_05_scale_vm_dont_allow_disk_offering_change	Error	393.10	test_scale_vm.py
test_01_sys_vm_start	Failure	0.07	test_secondary_storage.py
test_02_list_snapshots_with_removed_data_store	Error	11.58	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	11.58	test_snapshots.py
test_01_ssl_offloading_isolated_network	Failure	821.77	test_ssl_offloading.py
test_01_deploy_vm_on_specific_host	Error	0.10	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	0.11	test_vm_deployment_planner.py
test_08_migrate_vm	Error	0.06	test_vm_life_cycle.py
test_11_destroy_vm_and_volumes	Error	17.70	test_vm_life_cycle.py
test_01_migrate_vm_strict_tags_success	Error	0.19	test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure	Error	0.41	test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success	Error	0.22	test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure	Error	0.20	test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success	Error	0.24	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Error	0.27	test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags	Error	0.20	test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags	Error	2.46	test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success	Error	0.22	test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success	Error	2.54	test_vm_strict_host_tags.py
test_05_deploy_vm_on_specific_host_with_strict_tags_failure	Failure	0.20	test_vm_strict_host_tags.py

[blueorangutan]

[SF] Trillian test result (tid-14940)
Environment: vmware-80u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 84128 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14940-vmware-80u3.zip
Smoke tests completed. 146 look OK, 4 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_08_arping_in_ssvm	Failure	5.20	test_diagnostics.py
ContextSuite context=TestClusterDRS>:setup	Error	0.00	test_cluster_drs.py
test_08_upgrade_kubernetes_ha_cluster	Failure	3693.65	test_kubernetes_clusters.py
test_13_test_add_external_nodes_to_cluster	Error	1799.98	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	Error	1935.64	test_kubernetes_clusters.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_usage.py
test_01_snapshot_usage	Error	19.56	test_usage.py
test_01_vpn_usage	Error	1.12	test_usage.py

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15977

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-14961)

[blueorangutan]

[SF] Trillian test result (tid-14959)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 56036 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14959-kvm-ol8.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_02_unsecure_vm_migration	Error	408.90	test_vm_life_cycle.py
test_02_unsecure_vm_migration	Error	408.91	test_vm_life_cycle.py
test_03_secured_to_nonsecured_vm_migration	Error	0.01	test_vm_life_cycle.py
test_04_nonsecured_to_secured_vm_migration	Error	0.01	test_vm_life_cycle.py

[blueorangutan]

[SF] Trillian test result (tid-14960)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 60242 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14960-kvm-ubuntu22.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_hostha_enable_ha_when_host_disabled	Error	0.88	test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance	Error	305.28	test_hostha_kvm.py

[blueorangutan]

[SF] Trillian test result (tid-14962)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 68110 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14962-xcpng82.zip
Smoke tests completed. 144 look OK, 6 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	200.41	test_events_resource.py
test_01_non_strict_host_anti_affinity	Error	141.37	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	45.55	test_nonstrict_affinity_group.py
test_02_list_snapshots_with_removed_data_store	Error	37.98	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	37.98	test_snapshots.py
test_01_vpn_usage	Error	1.08	test_usage.py
test_11_destroy_vm_and_volumes	Error	19.70	test_vm_life_cycle.py
test_01_migrate_vm_strict_tags_success	Error	47.44	test_vm_strict_host_tags.py

[blueorangutan]

[SF] Trillian test result (tid-14964)
Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 53575 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14964-vmware-70u3.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_vpn_usage	Error	1.09	test_usage.py

[blueorangutan]

[SF] Trillian test result (tid-14938)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 340546 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t14938-kvm-ol8.zip
Component tests completed. 87 look OK, 87 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_verify_ipv6_network	Failure	296.59	test_network_ipv6.py
test_02_verify_ipv6_network_redundant	Failure	163.12	test_network_ipv6.py
test_03_verify_upgraded_ipv6_network	Failure	320.47	test_network_ipv6.py
test_04_verify_upgraded_ipv6_network_redundant	Failure	335.88	test_network_ipv6.py
ContextSuite context=TestDeployVMs>:setup	Error	0.00	test_dhcp_dns_offload.py
test_01_acquire_public_ip_in_isolated_network	Failure	60.07	test_acquire_specified_public_ip.py
test_02_acquire_public_ip_in_vpc	Failure	41.91	test_acquire_specified_public_ip.py
test_17_add_nic_different_zone	Error	115.32	test_add_remove_network.py
ContextSuite context=TestFailureScenariosAddNetworkToVM>:teardown	Error	10.61	test_add_remove_network.py
ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:teardown	Error	6.51	test_add_remove_network.py
ContextSuite context=TestUpdateVirtualMachineNIC>:teardown	Error	158.09	test_add_remove_network.py
test_03_1_egress_fr3	Failure	728.47	test_egress_fw_rules.py
test_07_1_egress_fr7	Failure	729.91	test_egress_fw_rules.py
test_07_egress_fr7	Failure	789.46	test_egress_fw_rules.py
test_04_reoccuring_snapshot_rules	Error	4329.76	test_base_image_updation.py
ContextSuite context=TestDataPersistency>:teardown	Error	368.36	test_blocker_bugs.py
test_01_create_template	Error	283.13	test_blocker_bugs.py
test_10_create_policy_enable_disable_vpn	Failure	154.51	test_haproxy.py
test_01_Browser_volume_Life_cycle_tpath	Failure	7961.78	test_browse_volumes.py
test_04_Browser_Upload_Volume_Negative_Scenarios_TPath	Failure	11474.76	test_browse_volumes.py
test_05_Browser_Upload_Volume_MultiSSVM_Scenarios_TPath	Failure	0.02	test_browse_volumes.py
test_09_Browser_Upload_Volume_PostURL_with_Deleted_Uploadvolume_Details	Error	3660.14	test_browse_volumes.py
test_11_migrate_upload_volume	Failure	7451.73	test_browse_volumes.py
test_13_Browser_Upload_Volume_volume_resource_limits	Failure	3661.03	test_browse_volumes.py
test_14_Browser_Upload_Volume_secondary_storage_resource_limits	Failure	3725.18	test_browse_volumes.py
test_15_Browser_Upload_Volume_primary_storage_resource_limits	Failure	3660.96	test_browse_volumes.py
test_browser_upload_volume_incomplete	Failure	3753.44	test_browse_volumes.py
ContextSuite context=TestConfigDrive>:setup	Error	0.00	test_configdrive.py
runTest	Error	0.00	test_edgezone_supportedoperations.py
runTest	Error	0.00	test_edgezone_supportedoperations.py
test_05_create_delete_lbrule_forvpc	Error	55.99	test_escalations_ipaddresses.py
test_07_assign_remove_lbrule_toinstance	Failure	62.20	test_escalations_ipaddresses.py
test_07_assign_remove_lbrule_toinstance	Error	62.22	test_escalations_ipaddresses.py
test_10_create_delete_portforwarding_forvpc	Error	43.47	test_escalations_ipaddresses.py
test_15_enable_disable_staticnat_forvpc	Error	53.92	test_escalations_ipaddresses.py
ContextSuite context=TestIpAddresses>:teardown	Error	4.20	test_escalations_ipaddresses.py
test_04_create_vpc_with_networkdomain	Failure	0.03	test_escalations_networks.py
test_14_list_public_ipaddress_by_associated_networkid	Failure	0.02	test_escalations_networks.py
test_15_list_privategateway_byvpcid	Failure	44.08	test_escalations_networks.py
test_17_restart_vpc	Failure	0.02	test_escalations_networks.py
test_18_create_list_vpn_gateway	Failure	0.02	test_escalations_networks.py
test_21_listNetworkacls_by_privategateway_aclid	Error	40.90	test_escalations_networks.py
ContextSuite context=TestNetworks_2>:teardown	Error	41.97	test_escalations_networks.py
test_03_data_volume_resize	Error	88.53	test_escalations_volumes.py
test_04_custom_volume_resize	Error	89.31	test_escalations_volumes.py
test_06_volume_snapshot_policy_hourly	Error	82.26	test_escalations_volumes.py
test_07_volume_snapshot_policy_daily	Error	93.33	test_escalations_volumes.py
test_08_volume_snapshot_policy_weekly	Error	83.96	test_escalations_volumes.py
test_09_volume_snapshot_policy_monthly	Error	88.30	test_escalations_volumes.py
test_10_volume_snapshots_pagination	Error	92.72	test_escalations_volumes.py
test_11_volume_extract	Error	77.32	test_escalations_volumes.py
test_12_volume_upload	Error	60.02	test_escalations_volumes.py
test_13_volume_custom_disk_size	Failure	92.51	test_escalations_volumes.py
test_03_delete_vm	Failure	861.58	test_mm_domain_limits.py
test_add_PF_rule_2_SHARED	Failure	71.21	test_multiple_ips_per_nic.py
test_add_PF_rule_3_VPC	Error	669.63	test_multiple_ips_per_nic.py
test_add_PF_rule_3_VPC	Error	669.67	test_multiple_ips_per_nic.py
test_add_static_nat_rule_1_ISOLATED	Error	451.62	test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHARED	Failure	360.15	test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHARED	Error	360.17	test_multiple_ips_per_nic.py
test_add_static_nat_rule_3_VPC	Error	91.69	test_multiple_ips_per_nic.py
test_delete_PF_nat_rule_2_SHARED	Error	77.89	test_multiple_ips_per_nic.py
test_disable_static_nat_1_ISOLATED	Error	388.46	test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHARED	Error	609.38	test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHARED	Error	609.43	test_multiple_ips_per_nic.py
test_disable_static_nat_3_VPC	Error	74.00	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_1_ISOLATED	Error	62.62	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED	Error	360.57	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED	Error	360.60	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_3_VPC	Error	375.19	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_3_VPC	Error	375.21	test_multiple_ips_per_nic.py
ContextSuite context=TestNetworkRules>:teardown	Error	376.30	test_multiple_ips_per_nic.py
test_delete_vm_1_ISOLATED	Error	88.62	test_multiple_ips_per_nic.py
test_delete_vm_2_SHARED	Error	68.44	test_multiple_ips_per_nic.py
test_delete_vm_3_VPC	Error	308.96	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_1_ISOLATED	Error	87.03	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_2_SHARED	Error	82.10	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_3_VPC	Error	308.13	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_1_ISOLATED	Error	147.73	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_2_SHARED	Error	69.92	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_3_VPC	Error	91.44	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_3_VPC	Error	91.45	test_multiple_ips_per_nic.py
test_reboot_router_VM_1_ISOLATED	Error	666.47	test_multiple_ips_per_nic.py
test_reboot_router_VM_1_ISOLATED	Error	666.52	test_multiple_ips_per_nic.py
test_reboot_router_VM_2_SHARED	Error	667.63	test_multiple_ips_per_nic.py
test_reboot_router_VM_3_VPC	Error	129.54	test_multiple_ips_per_nic.py
test_recover_vm_1_ISOLATED	Error	119.28	test_multiple_ips_per_nic.py
test_recover_vm_2_SHARED	Error	69.40	test_multiple_ips_per_nic.py
test_recover_vm_3_VPC	Error	308.58	test_multiple_ips_per_nic.py
test_02_created_shared_guest_network	Error	4.76	test_multiple_physical_network_creation.py
test_02_created_shared_guest_network	Error	4.76	test_multiple_physical_network_creation.py
test_01_acquire_public_ips_in_isolated_network_with_single_vr	Error	5.77	test_multiple_subnets_in_isolated_network.py
test_03_acquire_public_ips_in_vpc_with_single_vr	Error	314.70	test_multiple_subnets_in_vpc.py
test_04_acquire_public_ips_in_vpc_with_redundant_vrs	Failure	596.70	test_multiple_subnets_in_vpc_rvr.py
test_01_create_isolated_network_with_mtu	Failure	437.38	test_network_mtu.py
test_02_update_isolated_network_with_mtu	Failure	375.90	test_network_mtu.py
test_01_verify_vpc_dns	Error	58.09	test_network_vpc_custom_dns.py
test_01_createVM_snapshotTemplate	Error	1.58	test_snapshots.py
ContextSuite context=TestSnapshotEvents>:setup	Error	13.01	test_snapshots.py
test_02_snapshot_data_disk	Error	5.08	test_snapshots.py
test_03_snapshot_detachedDisk	Error	4.78	test_snapshots.py
test_04_delete_snapshot	Error	5.17	test_snapshots.py
test_12_disableZone_admin_deployVM	Error	1.22	test_organization_states.py
test_13_disableZone_admin_stop_startVM	Error	32.71	test_organization_states.py
test_15_disableZone_user_stop_startVM	Error	125.52	test_organization_states.py
test_22_disablePod_admin_deployVM	Error	1.18	test_organization_states.py
test_23_disablePod_admin_stop_startVM	Error	3.18	test_organization_states.py
test_25_disablePod_user_stop_startVM	Error	7.32	test_organization_states.py
test_43_disableHost_admin_deployVM	Failure	1.16	test_organization_states.py
test_44_disableHost_admin_stop_startVM	Failure	128.41	test_organization_states.py
test_02_Overcommit_factor	Failure	459.78	test_overcommit.py
test_03_cluste_capacity_check	Failure	610.30	test_overcommit.py
test_04_zone_capacity_check	Failure	610.30	test_overcommit.py
test_assign_vm_different_account_VR_1_VR	Error	8.42	test_persistent_networks.py
test_change_persistent_network_to_non_persistent	Error	4.18	test_persistent_networks.py
test_network_state_after_destroying_vms	Error	0.02	test_persistent_networks.py
test_newly_added_host_for_persistent_network_resources	Error	1.12	test_persistent_networks.py
test_persistent_network_with_RVR	Error	4.25	test_persistent_networks.py
test_pf_nat_rule_persistent_network_1_LB_VR	Error	4.02	test_persistent_networks.py
test_upgrade_network_VR_to_PersistentRVR	Error	4.16	test_persistent_networks.py
test_upgrade_to_persistent_services_VR_1_LB_VR	Error	4.03	test_persistent_networks.py
test_vm_deployment_persistent_and_non_persistent_networks	Error	4.03	test_persistent_networks.py
test_vm_deployment_two_persistent_networks	Error	4.30	test_persistent_networks.py
test_volume_delete_event_errorState	Error	2.96	test_persistent_networks.py
test_account_operations_1_locked	Error	3.88	test_persistent_networks.py
test_account_operations_2_disabled	Error	4.21	test_persistent_networks.py
test_project_operations	Error	6.05	test_persistent_networks.py
test_cleanup_persistent_network_1_true	Error	4.11	test_persistent_networks.py
test_cleanup_persistent_network_2_false	Error	3.96	test_persistent_networks.py
test_vpc_force_delete_domain	Failure	11.11	test_persistent_networks.py
test_vpc_network_life_cycle_1_delete	Error	5.50	test_persistent_networks.py
test_vpc_network_life_cycle_2_restart	Error	6.12	test_persistent_networks.py
ContextSuite context=TestAssociatePublicIp>:setup	Error	0.00	test_portable_ip.py
test_create_portable_ip_range	Failure	0.01	test_portable_ip.py
test_delete_account_services_disabled	Failure	3.77	test_portable_ip.py
test_delete_account_services_enabled	Failure	3.33	test_portable_ip.py
test_delete_portable_ip_range	Error	0.01	test_portable_ip.py
test_delete_portable_ip_range_in_use	Error	0.01	test_portable_ip.py
test_delete_portable_ip_range_non_root_admin	Error	0.01	test_portable_ip.py
ContextSuite context=TestDisassociatePublicIp>:setup	Error	4.06	test_portable_ip.py
test_list_portable_ip_range	Error	0.01	test_portable_ip.py
test_list_portable_ip_range_non_root_admin	Error	0.01	test_portable_ip.py
ContextSuite context=TestPortableIpTransferAcrossNetworks>:setup	Error	4.00	test_portable_ip.py
test_03_vm_per_project	Error	1.29	test_project_limits.py
test_04_publicip_per_project	Error	1.25	test_project_limits.py
test_05_snapshots_per_project	Error	1.21	test_project_limits.py
test_06_volumes_per_project	Error	7.51	test_project_limits.py
test_07_templates_per_project	Error	62.47	test_project_limits.py
ContextSuite context=TestResourceLimitsProject>:teardown	Error	68.73	test_project_limits.py
test_03_network_create	Error	8.02	test_project_resources.py
test_01_service_offerings	Error	7.54	test_project_resources.py
ContextSuite context=TestPublicIpAddress>:setup	Error	10.87	test_project_resources.py
test_06_create_snapshots_in_project	Error	1.30	test_project_resources.py
test_04_public_private_template_use_in_project	Failure	1.30	test_project_resources.py
test_05_use_private_template_in_project	Failure	1.22	test_project_resources.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestLBRuleUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestNatRuleUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestPublicIPUsage>:setup	Error	0.00	test_project_usage.py
ContextSuite context=TestSnapshotUsage>:setup	Error	0.00	test_project_usage.py
test_01_vm_usage	Error	1.26	test_project_usage.py
ContextSuite context=TestVolumeUsage>:setup	Error	14.04	test_project_usage.py
ContextSuite context=TestVpnUsage>:setup	Error	20.01	test_project_usage.py
test_01_multiple_domains_primary_storage_limits	Error	23.20	test_ps_domain_limits.py
test_02_multiple_domains_primary_storage_limits	Failure	22.07	test_ps_domain_limits.py
test_05_assign_virtual_machine_different_domain	Failure	22.13	test_ps_domain_limits.py
test_06_destroy_recover_vm	Failure	22.70	test_ps_domain_limits.py
test_deploy_multiple_vm_1_root_domain_admin	Error	20.24	test_ps_limits.py
test_deploy_multiple_vm_2_child_domain_admin	Error	21.13	test_ps_limits.py
test_stop_start_vm_1_root_domain_admin	Failure	17.95	test_ps_limits.py
test_stop_start_vm_2_child_domain_admin	Failure	20.43	test_ps_limits.py
test_01_deploy_vm_domain_limit_reached	Error	15.94	test_ps_max_limits.py
test_02_deploy_vm_account_limit_reached	Error	13.54	test_ps_max_limits.py
test_03_deploy_vm_project_limit_reached	Error	13.10	test_ps_max_limits.py
test_01_increase_volume_size_within_account_limit	Failure	12.56	test_ps_resize_volume.py
test_02_increase_volume_size_above_account_limit	Failure	11.61	test_ps_resize_volume.py
test_03_increase_volume_size_above_domain_limit	Failure	11.37	test_ps_resize_volume.py
ContextSuite context=TestPublicIp>:setup	Error	0.00	test_public_ip.py
ContextSuite context=TestRecurringSnapshots>:setup	Error	0.00	test_recurring_snapshots.py
test_network_gc	Error	12.30	test_redundant_router_cleanups.py
test_restart_ntwk_no_cleanup	Error	11.44	test_redundant_router_cleanups.py
test_restart_ntwk_with_cleanup	Error	12.58	test_redundant_router_cleanups.py
test_enableVPNOverRvR	Error	11.93	test_redundant_router_services.py
test_downgradeRvR_to_VR	Error	12.80	test_redundant_router_upgrades.py
test_upgradeVR_to_redundantVR	Error	11.27	test_redundant_router_upgrades.py
test_01_concurrent_snapshots_live_migrate	Failure	10.49	test_snapshots_improvement.py
test_02_stop_vm_concurrent_snapshots	Failure	9.52	test_snapshots_improvement.py
test_03_concurrent_snapshots_create_template	Failure	10.57	test_snapshots_improvement.py
test_04_concurrent_snapshots_create_volume	Failure	9.48	test_snapshots_improvement.py
test_01_snapshot_on_rootVolume	Error	1.28	test_snapshots_improvement.py
ContextSuite context=TestResetSSHKeyUserRights>:setup	Error	0.00	test_reset_ssh_keypair.py
ContextSuite context=TestSnapshotLimit>:setup	Error	0.00	test_snapshot_limits.py
ContextSuite context=TestResourceCountRunningVMs>:setup	Error	0.00	test_resource_count_running_vms.py
test_01_check_list_capacity	Failure	6.45	test_resource_limit_tags.py
test_06_verify_domain_tagged_vm_limit	Error	13.83	test_resource_limit_tags.py
test_07_verify_account_tagged_vm_limit	Error	11.16	test_resource_limit_tags.py
test_08_verify_domain_tagged_volume_limit	Error	11.66	test_resource_limit_tags.py
test_09_verify_account_tagged_volume_limit	Error	12.88	test_resource_limit_tags.py
test_10_verify_assign_vm_limit	Error	18.35	test_resource_limit_tags.py
test_11_verify_scale_vm_limit	Error	11.51	test_resource_limit_tags.py
test_12_verify_scale_volume_limit	Error	11.59	test_resource_limit_tags.py
test_13_verify_restore_vm_limit	Error	20.43	test_resource_limit_tags.py
test_13_verify_restore_vm_limit	Error	20.43	test_resource_limit_tags.py
test_01_vm_per_account	Error	121.47	test_resource_limits.py
test_02_publicip_per_account	Error	121.35	test_resource_limits.py
test_03_snapshots_per_account	Error	121.37	test_resource_limits.py
test_04_volumes_per_account	Error	121.36	test_resource_limits.py
test_05_templates_per_account	Failure	121.67	test_resource_limits.py
test_01_publicip_per_domain	Error	121.48	test_resource_limits.py
test_01_vm_per_domain	Error	121.40	test_resource_limits.py
test_03_snapshots_per_domain	Error	121.38	test_resource_limits.py
test_04_volumes_per_domain	Error	121.34	test_resource_limits.py
test_05_templates_per_domain	Failure	121.59	test_resource_limits.py
test_01_create__snapshot_new_resized_rootvolume_size	Error	1.31	test_rootvolume_resize.py
test_02_create__template_new_resized_rootvolume_size	Error	6.45	test_rootvolume_resize.py
test_02_create__template_new_resized_rootvolume_size	Error	6.45	test_rootvolume_resize.py
test_04_vmreset_after_migrate_vm__rootvolume_resized	Error	1.24	test_rootvolume_resize.py
test_05_vmdeployment_with_size	Error	1.23	test_rootvolume_resize.py
test_06_resized_rootvolume_with_lessvalue	Error	1.24	test_rootvolume_resize.py
test_08_increase_volume_size_within_account_limit	Failure	5.20	test_rootvolume_resize.py
test_08_increase_volume_size_within_account_limit	Error	5.20	test_rootvolume_resize.py
ContextSuite context=TestRouterServices>:setup	Error	0.00	test_routers.py
ContextSuite context=TestRouterStopCreateFW>:setup	Error	0.00	test_routers.py
ContextSuite context=TestRouterStopCreateLB>:setup	Error	0.00	test_routers.py
ContextSuite context=TestRouterStopCreatePF>:setup	Error	0.00	test_routers.py
test_01_deployVM_InDefaultSecurityGroup	Error	1.31	test_security_groups.py
test_03_accessInDefaultSecurityGroup	Error	1.25	test_security_groups.py
test_01_snapshot_data_disk	Error	5.26	test_separate_backup_from_snapshot.py
test_createSharedNetwork_All	Error	70.02	test_shared_networks.py
test_createSharedNetwork_accountSpecific	Error	71.09	test_shared_networks.py
test_createSharedNetwork_domainSpecific	Error	78.43	test_shared_networks.py
test_createSharedNetwork_projectSpecific	Error	70.23	test_shared_networks.py
test_createSharedNetwork_usedVlan2	Error	65.85	test_shared_networks.py
test_deployVM_isolatedAndShared	Error	65.53	test_shared_networks.py
test_deployVM_multipleSharedNetwork	Error	65.69	test_shared_networks.py
test_escalation_ES1621	Error	65.83	test_shared_networks.py
test_reboot_router	Error	64.67	test_shared_networks.py
test_restart_network_1_True	Error	64.91	test_shared_networks.py
test_restart_network_2_False	Error	65.27	test_shared_networks.py
test_stop_start_router	Error	64.72	test_shared_networks.py
ContextSuite context=TestSnapshotCopy>:setup	Error	0.00	test_snapshot_copy.py
test_04_create_template_delete_account	Error	88.99	test_ss_domain_limits.py
test_01_multiple_domains_secondary_storage_limits	Error	87.33	test_ss_domain_limits.py
ContextSuite context=TestAccountSnapshotClean>:setup	Error	0.00	test_snapshot_gc.py
ContextSuite context=TestSecondaryVolumeUsage>:setup	Error	0.00	test_ss_volume_usage.py
test_02_deploy_ha_vm_from_iso	Error	15.48	test_stopped_vm.py
test_deployVmOnGivenHost	Failure	5.66	test_stopped_vm.py
test_01_deploy_vm_no_startvm	Error	12.56	test_stopped_vm.py
test_02_deploy_vm_startvm_true	Error	11.70	test_stopped_vm.py
test_05_deploy_startvm_false_change_so	Error	12.27	test_stopped_vm.py
test_09_stop_vm_migrate_vol	Error	5.52	test_stopped_vm.py
test_deploy_vm_password_enabled	Error	48.96	test_stopped_vm.py
test_01_deploy_vm_no_startvm	Error	18.52	test_stopped_vm.py
ContextSuite context=TestStorageMotion>:setup	Error	0.00	test_storage_motion.py
ContextSuite context=TestResourceTags>:setup	Error	0.00	test_tags.py
test_01_check_cross_domain_template_access	Error	0.02	test_template_access_across_domains.py
test_02_create_template	Error	0.01	test_template_access_across_domains.py
test_03_check_subdomain_template_access	Error	0.02	test_template_access_across_domains.py
test_04_check_non_public_template_access	Error	0.02	test_template_access_across_domains.py
test_05_check_non_public_template_subdomain_access	Error	0.01	test_template_access_across_domains.py
test_06_check_sub_public_template_sub_domain_access	Error	0.02	test_template_access_across_domains.py
test_07_check_default_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_08_check_non_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_01_create_template_snampshot	Error	98.80	test_template_from_snapshot_with_template_details.py
test_01_create_template_snampshot	Error	98.81	test_template_from_snapshot_with_template_details.py
test_01_create_template	Error	97.92	test_templates.py
test_01_create_template	Error	97.92	test_templates.py
test_01_updateResourceCount	Error	10.73	test_updateResourceCount.py
test_update_vm_details_admin	Error	11.61	test_update_vm.py
test_update_vm_name	Error	9.45	test_update_vm.py
test_02_create_private_gateway_with_associated_network	Error	5.01	test_user_private_gateway.py
ContextSuite context=TestUserPrivateGateways>:teardown	Error	10.39	test_user_private_gateway.py
test_03_create_domain_shared_network_with_associated_network	Failure	0.80	test_user_shared_network.py
test_04_create_account_shared_network_with_associated_network	Failure	0.93	test_user_shared_network.py
ContextSuite context=TestUserSharedNetworks>:teardown	Error	5.31	test_user_shared_network.py
ContextSuite context=TestVMPasswordEnabled>:setup	Error	0.00	test_vm_passwdenabled.py
ContextSuite context=TestVolumeDestroyRecover>:setup	Error	0.00	test_volume_destroy_recover.py
ContextSuite context=TestAttachDetachVolume>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestAttachVolume>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestAttachVolumeISO>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestMigrateVolume>:setup	Error	8.48	test_volumes.py
test_01_verify_ipv6_vpc	Error	3.32	test_vpc_ipv6.py
test_02_verify_ipv6_vpc_redundant	Error	3.32	test_vpc_ipv6.py
test_03_verify_upgraded_ipv6_vpc	Error	3.32	test_vpc_ipv6.py
test_04_verify_upgraded_ipv6_vpc_redundant	Error	3.31	test_vpc_ipv6.py
ContextSuite context=TestRouterOperations>:setup	Error	0.00	test_vpc_network.py
test_01_create_network_1_network_offering	Error	5.96	test_vpc_network.py
test_02_create_network_fail_1_network_offering	Error	5.71	test_vpc_network.py
test_07_create_network_unsupported_services	Error	8.07	test_vpc_network.py
test_08_create_network_without_sourceNAT	Error	7.97	test_vpc_network.py
test_09_create_network_shared_nwoff_1_network_off_shared	Error	5.94	test_vpc_network.py
ContextSuite context=TestVPCNetworkGc>:setup	Error	10.82	test_vpc_network.py
test_01_create_network_outside_range_1_network_offering	Error	5.62	test_vpc_network.py
test_02_create_network_outside_range	Error	7.59	test_vpc_network.py
test_03_create_network_inside_range_1_network_offering	Error	5.27	test_vpc_network.py
test_04_create_network_overlapping_range_1_network_offering	Error	5.59	test_vpc_network.py
test_05_create_network_diff_account_1_network_offering	Error	5.39	test_vpc_network.py
test_01_network_services_upgrade	Error	5.76	test_vpc_network.py
test_02_network_vpcvr2vr_upgrade	Error	7.65	test_vpc_network.py
test_01_internallb_rules	Error	5.44	test_vpc_network_internal_lbrules.py
test_01_VPC_LBRulesListing	Error	6.33	test_vpc_network_lbrules.py
test_02_VPC_CreateLBRuleInMultipleNetworks	Error	6.22	test_vpc_network_lbrules.py
test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState	Error	6.11	test_vpc_network_lbrules.py
test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState	Error	5.80	test_vpc_network_lbrules.py
test_05_VPC_CreateAndDeleteLBRule	Error	5.84	test_vpc_network_lbrules.py
test_06_VPC_CreateAndDeleteLBRuleVRStopppedState	Error	4.74	test_vpc_network_lbrules.py
test_07_VPC_CreateAndDeleteAllLBRule	Error	5.70	test_vpc_network_lbrules.py
test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState	Error	5.58	test_vpc_network_lbrules.py
test_09_VPC_LBRuleCreateFailMultipleVPC	Error	4.50	test_vpc_network_lbrules.py
test_10_VPC_FailedToCreateLBRuleNonVPCNetwork	Error	5.75	test_vpc_network_lbrules.py
test_11_VPC_LBRuleCreateNotAllowed	Error	4.81	test_vpc_network_lbrules.py
test_12_VPC_LBRuleCreateFailForRouterIP	Error	5.72	test_vpc_network_lbrules.py
test_13_VPC_LBRuleCreateFailForPFSourceNATIP	Error	5.79	test_vpc_network_lbrules.py
test_14_VPC_LBRuleCreateFailForStaticNatRule	Error	5.44	test_vpc_network_lbrules.py
test_15_VPC_ReleaseIPForLBRuleCreated	Error	5.65	test_vpc_network_lbrules.py
test_01_network_services_VPC_StopCreatePF	Error	6.53	test_vpc_network_pfrules.py
test_02_network_services_VPC_CreatePF	Error	6.06	test_vpc_network_pfrules.py
test_03_network_services_VPC_StopCreateMultiplePF	Error	6.27	test_vpc_network_pfrules.py
test_04_network_services_VPC_CreateMultiplePF	Error	6.49	test_vpc_network_pfrules.py
test_01_VPC_StaticNatRuleCreateStoppedState	Error	6.40	test_vpc_network_staticnatrule.py
test_02_VPC_CreateStaticNatRule	Error	6.26	test_vpc_network_staticnatrule.py
test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState	Error	6.56	test_vpc_network_staticnatrule.py
test_04_VPC_CreateMultipleStaticNatRule	Error	6.82	test_vpc_network_staticnatrule.py
test_03_vpc_off_without_lb	Error	9.40	test_vpc_offerings.py
test_04_vpc_off_without_static_nat	Error	8.01	test_vpc_offerings.py
test_05_vpc_off_without_pf	Error	7.30	test_vpc_offerings.py
test_07_update_vpc_off	Error	9.38	test_vpc_offerings.py
test_09_create_redundant_vpc_offering	Error	7.97	test_vpc_offerings.py
ContextSuite context=TestVPCRouterOneNetwork>:setup	Error	0.00	test_vpc_routers.py
ContextSuite context=TestVPCRoutersBasic>:setup	Error	0.00	test_vpc_routers.py
ContextSuite context=TestVMLifeCycleBothIsolated>:setup	Error	0.00	test_vpc_vm_life_cycle.py
ContextSuite context=TestVMLifeCycleStoppedVPCVR>:setup	Error	0.00	test_vpc_vm_life_cycle.py
ContextSuite context=TestVMLifeCycleVPC>:setup	Error	0.00	test_vpc_vm_life_cycle.py
test_01_deploy_vms_in_network	Error	7.54	test_vpc_vms_deployment.py
test_02_deploy_vms_delete_network	Error	7.58	test_vpc_vms_deployment.py
test_03_deploy_vms_delete_add_network	Error	7.66	test_vpc_vms_deployment.py
test_04_deploy_vms_delete_add_network_noLb	Error	7.91	test_vpc_vms_deployment.py
test_05_create_network_max_limit	Error	8.00	test_vpc_vms_deployment.py
test_06_delete_network_vm_running	Error	7.71	test_vpc_vms_deployment.py
test_08_ip_reallocation_CS5986	Error	6.52	test_vpc_vms_deployment.py
test_01_VPN_user_limit	Error	4.92	test_vpn_users.py
test_02_use_vpn_port	Error	4.95	test_vpn_users.py
test_03_enable_vpn_use_port	Error	4.63	test_vpn_users.py
test_04_add_new_users	Error	4.79	test_vpn_users.py
test_05_add_duplicate_user	Error	5.00	test_vpn_users.py
test_06_add_VPN_user_global_admin	Error	4.72	test_vpn_users.py
test_07_add_VPN_user_domain_admin	Error	4.90	test_vpn_users.py
test_08_add_TCP_PF_Rule_In_VPN	Error	4.97	test_vpn_users.py
test_CLOUDSTACK_6181_stoppedvm_root_resize	Error	11.73	test_bugs.py
test_CLOUDSTACK_6181_vm_root_resize	Error	1.25	test_bugs.py
test_01_dedicate_guest_vlan_range_root_domain	Error	12.20	test_dedicate_guest_vlan_ranges.py
test_02_dedicate_guest_vlan_range_user_domain	Error	13.26	test_dedicate_guest_vlan_ranges.py
test_03_multiple_guest_netwoks	Error	8.12	test_dedicate_guest_vlan_ranges.py
test_02_delete_dedicated_vlan_range_vlan_in_use	Error	6.90	test_dedicate_guest_vlan_ranges.py
test_03_delete_account	Error	6.71	test_dedicate_guest_vlan_ranges.py
test_05_release_range_vlan_in_use	Error	6.82	test_dedicate_guest_vlan_ranges.py
test_05_acquire_ip_single_guest_network	Error	4.49	test_dedicate_public_ip_range.py
test_06_acquire_ip_multiple_guest_network	Error	4.71	test_dedicate_public_ip_range.py
test_08_acquire_ip_in_vpc	Error	7.05	test_dedicate_public_ip_range.py
test_14_release_ip_from_dedicated_range	Error	4.28	test_dedicate_public_ip_range.py
test_15_release_dedicated_range	Failure	4.34	test_dedicate_public_ip_range.py
test_16_delete_ip_range_no_network_rules	Error	4.75	test_dedicate_public_ip_range.py
test_17_delete_ip_range_network_rules	Error	4.24	test_dedicate_public_ip_range.py
test_18_delete_network	Error	4.09	test_dedicate_public_ip_range.py
test_19_delete_account	Error	4.65	test_dedicate_public_ip_range.py
test_21_release_dedicated_range_ip_address_in_use	Error	4.62	test_dedicate_public_ip_range.py
test_01_deploy_vm_with_explicit_dedication	Error	1.10	test_explicit_dedication.py
test_01_host_maintenance_mode	Failure	5.09	test_high_availability.py
test_02_host_maintenance_mode_with_activities	Failure	4.81	test_high_availability.py
test_01_ip_resource_count_vpc_network	Error	7.10	test_ip_resource_count_for_vpc.py
ContextSuite context=TestNFSMountOptsKVM>:setup	Error	0.00	test_primary_storage_nfsmountopts_kvm.py
test_createRvRNetwork	Error	10.77	test_redundant_router.py
test_createRvRNetwork	Error	11.28	test_redundant_router.py
test_01_stopPrimaryRvR	Error	4.89	test_redundant_router.py
test_02_stopBackupRvR	Error	4.94	test_redundant_router.py
test_03_rebootPrimaryRvR	Error	5.17	test_redundant_router.py
test_04_rebootBackupRvR	Error	4.60	test_redundant_router.py
test_05_stopBackupRvR_startInstance	Error	4.98	test_redundant_router.py
ContextSuite context=TestRvRRedundancy>:teardown	Error	5.05	test_redundant_router.py
test_applyNetworkRules_PrimaryDown_deleteNetworkRules	Error	12.96	test_redundant_router_network_rules.py
test_applyRules_restartRvRNetwork	Error	10.99	test_redundant_router_network_rules.py
test_apply_and__delete_NetworkRulesOnRvR	Error	12.91	test_redundant_router_network_rules.py
test_networkRules_afterRebootRouters	Error	10.97	test_redundant_router_network_rules.py

[blueorangutan]

[SF] Trillian test result (tid-15004)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 407958 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t15004-kvm-ol8.zip
Component tests completed. 92 look OK, 82 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_12_move_across_subdomain_vm_volumes	Error	8.82	test_assign_vm.py
test_16_move_across_subdomain_volume_and_account_limit	Error	34.40	test_assign_vm.py
ContextSuite context=TestVMOwnership>:teardown	Error	47.35	test_assign_vm.py
test_15_release_dedicated_range	Failure	6.19	test_dedicate_public_ip_range.py
test_19_delete_account	Failure	7.52	test_dedicate_public_ip_range.py
test_21_release_dedicated_range_ip_address_in_use	Error	6.49	test_dedicate_public_ip_range.py
test_16_list_vm_volumes_pagination	Error	100.32	test_escalations_instances.py
test_18_stopped_vm_change_service	Error	18.83	test_escalations_instances.py
test_19_create_reset_vm_sshkey	Error	18.76	test_escalations_instances.py
test_21_restore_vm	Error	17.82	test_escalations_instances.py
test_25_ip_reallocation_ES1377	Error	137.46	test_escalations_instances.py
test_28_VM_restore_ES3467	Failure	76.14	test_escalations_instances.py
test_03_list_Stopped_vm	Error	82.60	test_escalations_instances.py
test_04_list_Destroyed_vm	Error	18.75	test_escalations_instances.py
test_05_list_vm_by_id	Error	74.62	test_escalations_instances.py
test_06_list_vm_by_name	Error	19.04	test_escalations_instances.py
test_11_register_reset_vm_sshkey	Failure	81.09	test_escalations_instances.py
test_13_vm_nics	Error	80.13	test_escalations_instances.py
test_14_Create_vm_with_same_sshkey	Failure	82.44	test_escalations_instances.py
ContextSuite context=TestDataPersistency>:teardown	Error	279.29	test_blocker_bugs.py
test_01_restart_network_cleanup	Error	2.19	test_blocker_bugs.py
test_01_list_routers_admin	Error	6.59	test_blocker_bugs.py
test_01_create_template	Error	1.11	test_blocker_bugs.py
test_07_restart_network_vm_running	Failure	163.91	test_vpc.py
test_08_delete_vpc	Failure	109.24	test_vpc.py
ContextSuite context=TestNFSMountOptsKVM>:setup	Error	0.00	test_primary_storage_nfsmountopts_kvm.py
test_createRvRNetwork	Error	149.24	test_redundant_router.py
test_03_rebootPrimaryRvR	Error	12.31	test_redundant_router.py
test_04_rebootBackupRvR	Error	12.33	test_redundant_router.py
test_05_stopBackupRvR_startInstance	Error	126.53	test_redundant_router.py
ContextSuite context=TestRvRRedundancy>:teardown	Error	126.63	test_redundant_router.py
test_applyNetworkRules_PrimaryDown_deleteNetworkRules	Error	23.24	test_redundant_router_network_rules.py
test_applyRules_restartRvRNetwork	Error	21.82	test_redundant_router_network_rules.py
test_01_Browser_volume_Life_cycle_tpath	Failure	3841.34	test_browse_volumes.py
test_02_SSVM_Life_Cycle_With_Browser_Volume_TPath	Failure	3888.09	test_browse_volumes.py
test_04_Browser_Upload_Volume_Negative_Scenarios_TPath	Failure	18634.35	test_browse_volumes.py
test_05_Browser_Upload_Volume_MultiSSVM_Scenarios_TPath	Failure	0.03	test_browse_volumes.py
test_09_Browser_Upload_Volume_PostURL_with_Deleted_Uploadvolume_Details	Error	3660.17	test_browse_volumes.py
test_11_migrate_upload_volume	Failure	7456.11	test_browse_volumes.py
test_13_Browser_Upload_Volume_volume_resource_limits	Failure	3676.91	test_browse_volumes.py
test_14_Browser_Upload_Volume_secondary_storage_resource_limits	Failure	3676.71	test_browse_volumes.py
test_15_Browser_Upload_Volume_primary_storage_resource_limits	Failure	3676.82	test_browse_volumes.py
test_05_deployVM_SharedwithSG	Failure	223.58	test_advancedsg_networks.py
test_07_SharedNwSG_DomainWide_SubdomainAcccess	Failure	288.03	test_advancedsg_networks.py
test_10_deleteSharedNwSGAccountSpecific_InUse	Error	226.46	test_advancedsg_networks.py
test_11_deleteSharedNwSG_DomainWide_InUse	Error	215.91	test_advancedsg_networks.py
test_11_deleteSharedNwSG_DomainWide_InUse	Failure	215.91	test_advancedsg_networks.py
test_20_DeployVM_SecGrp_sharedNetwork_1_default	Failure	218.90	test_advancedsg_networks.py
test_20_DeployVM_SecGrp_sharedNetwork_2_custom	Failure	219.97	test_advancedsg_networks.py
test_24_DeployVM_Multiple_Shared_Networks	Error	210.33	test_advancedsg_networks.py
test_25_Deploy_Multiple_VM_Different_Shared_Networks_Same_SG	Error	272.51	test_advancedsg_networks.py
test_26_Destroy_Deploy_VM_NoFreeIPs	Error	215.88	test_advancedsg_networks.py
test__16_AccountSpecificNwAccess	Error	227.12	test_advancedsg_networks.py
test__17_DomainSpecificNwAccess	Error	314.77	test_advancedsg_networks.py
test_34_restart_shared_network_sg_1_account	Failure	221.56	test_advancedsg_networks.py
test_34_restart_shared_network_sg_3_zone	Failure	213.58	test_advancedsg_networks.py
ContextSuite context=TestConfigDrive>:setup	Error	0.00	test_configdrive.py
ContextSuite context=TestVolumeList>:setup	Error	0.00	test_acl_listvolume.py
ContextSuite context=TestIsolatedNetwork>:setup	Error	0.00	test_acl_isolatednetwork.py
test_03_deploy_vm_by_aff_grp_id	Error	9.61	test_affinity_groups.py
test_04_deploy_vm_anti_affinity_group	Error	8.87	test_affinity_groups.py
test_05_deploy_vm_by_id	Error	6.74	test_affinity_groups.py
test_09_deploy_vm_multiple_aff_grps	Error	8.00	test_affinity_groups.py
test_02_list_multiple_aff_grps_for_vm	Error	9.71	test_affinity_groups.py
test_07_list_all_vms_in_aff_grp	Error	12.61	test_affinity_groups.py
test_01_update_aff_grp_by_ids	Error	5.60	test_affinity_groups.py
test_02_update_aff_grp_by_names	Error	60.84	test_affinity_groups.py
test_03_update_aff_grp_for_vm_with_no_aff_grp	Error	139.27	test_affinity_groups.py
test_01_multiplecore_start_stop_instance	Failure	6.83	test_cpu_limits.py
test_04_deploy_multiple_vm_with_multiple_cpus	Failure	64.16	test_cpu_limits.py
test_01_stop_start_instance	Failure	28.12	test_cpu_limits.py
test_02_migrate_instance	Failure	84.48	test_cpu_limits.py
ContextSuite context=TestSnapshotList>:setup	Error	0.00	test_acl_listsnapshot.py
test_deployVM_in_sharedNetwork_scope_account_user	Error	55.80	test_acl_sharednetwork.py
test_deployVM_in_sharedNetwork_scope_all_ROOTadmin	Error	57.02	test_acl_sharednetwork.py
test_deployVM_in_sharedNetwork_scope_domain_withsubdomainaccess_domainadminuser	Error	6.56	test_acl_sharednetwork.py
test_deployVM_in_sharedNetwork_scope_domain_withsubdomainaccess_domainuser	Error	69.06	test_acl_sharednetwork.py
ContextSuite context=TestSharedNetwork>:teardown	Error	94.63	test_acl_sharednetwork.py
ContextSuite context=TestVMList>:setup	Error	0.00	test_acl_listvm.py
test_deployVM_in_sharedNetwork_as_admin_scope_account_user	Error	56.80	test_acl_sharednetwork_deployVM-impersonation.py
test_deployVM_in_sharedNetwork_as_admin_scope_all_ROOTuser	Error	60.84	test_acl_sharednetwork_deployVM-impersonation.py
test_deployVM_in_sharedNetwork_as_domainadmin_scope_all_domainadminuser	Error	12.73	test_acl_sharednetwork_deployVM-impersonation.py
test_deployVM_in_sharedNetwork_as_domainadmin_scope_all_domainuser	Error	12.70	test_acl_sharednetwork_deployVM-impersonation.py
test_deployVM_in_sharedNetwork_as_domainadmin_scope_all_subdomainadminuser	Error	11.70	test_acl_sharednetwork_deployVM-impersonation.py
test_deployVM_in_sharedNetwork_as_domainadmin_scope_domain_nosubdomainaccess_domainuser	Error	13.84	test_acl_sharednetwork_deployVM-impersonation.py
test_deployVM_in_sharedNetwork_as_domainadmin_scope_domain_withsubdomainaccess_subdomainuser	Error	12.83	test_acl_sharednetwork_deployVM-impersonation.py
test_02_deploy_vm_account_limit_reached	Failure	80.41	test_cpu_max_limits.py
test_01_acquire_public_ip_in_isolated_network	Error	5.65	test_acquire_specified_public_ip.py
test_02_acquire_public_ip_in_vpc	Failure	50.33	test_acquire_specified_public_ip.py
ContextSuite context=TestAddNetworkToVirtualMachine>:setup	Error	0.00	test_add_remove_network.py
ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup	Error	0.00	test_add_remove_network.py
ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup	Error	0.00	test_add_remove_network.py
ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup	Error	0.00	test_add_remove_network.py
test_07_remove_nic_running_vm	Error	4.17	test_add_remove_network.py
test_09_remove_foreign_nic	Error	18.53	test_add_remove_network.py
test_29_remove_nic_CS22503	Error	65.50	test_add_remove_network.py
test_29_remove_nic_CS22503	Error	65.51	test_add_remove_network.py
test_30_remove_nic_reattach	Error	67.36	test_add_remove_network.py
test_30_remove_nic_reattach	Error	67.37	test_add_remove_network.py
ContextSuite context=TestRemoveNetworkFromVirtualMachine>:teardown	Error	68.49	test_add_remove_network.py
test_13_set_foreign_nic_as_default	Error	18.59	test_add_remove_network.py
ContextSuite context=TestUpdateVirtualMachineNIC>:teardown	Error	19.73	test_add_remove_network.py
test_01_deploy_vm_anti_affinity_group	Error	59.98	test_affinity_groups_projects.py
test_02_deploy_vm_anti_affinity_group_fail_on_not_enough_hosts	Error	9.66	test_affinity_groups_projects.py
test_01_list_aff_grps_for_vm	Error	6.67	test_affinity_groups_projects.py
test_02_list_multiple_aff_grps_for_vm	Error	7.72	test_affinity_groups_projects.py
test_07_list_all_vms_in_aff_grp	Error	60.12	test_affinity_groups_projects.py
ContextSuite context=TestListAffinityGroups>:teardown	Error	98.06	test_affinity_groups_projects.py
test_01_update_aff_grp_by_ids	Error	59.92	test_affinity_groups_projects.py
test_06_secondary_storage	Failure	0.02	test_allocation_states.py
test_03_restore_vm_with_new_template	Error	262.56	test_base_image_updation.py
test_04_reoccuring_snapshot_rules	Error	4329.46	test_base_image_updation.py
ContextSuite context=TestBaseImageUpdate>:teardown	Error	4443.30	test_base_image_updation.py
test_browser_upload_template_incomplete	Failure	0.07	test_browse_templates2.py
test_01_concurrent_snapshot_global_limit	Error	76.08	test_concurrent_snapshots_limit.py
test_01_multiple_core_vm_start_stop_instance	Failure	290.69	test_cpu_domain_limits.py
test_02_multiple_core_vm_migrate_instance	Failure	87.00	test_cpu_domain_limits.py
test_03_multiple_core_vm_delete_instance	Failure	26.93	test_cpu_domain_limits.py
test_04_deploy_multiple_vm_with_multiple_core	Failure	83.03	test_cpu_domain_limits.py
test_01_project_counts_start_stop_instance	Failure	68.11	test_cpu_project_limits.py
test_03_project_counts_delete_instance	Failure	70.25	test_cpu_project_limits.py
test_01_deploy_vm_no_lease_svc_offering	Error	19.47	test_deploy_vm_lease.py
test_03_deploy_vm_lease_svc_offering_with_no_param	Error	74.95	test_deploy_vm_lease.py
test_04_deploy_vm_lease_svc_offering_with_param	Error	18.74	test_deploy_vm_lease.py
ContextSuite context=TestDeployVMs>:setup	Error	0.00	test_dhcp_dns_offload.py
test_max_account_cpus_scale_VM_1_ADMIN_ACCOUNT	Failure	18.52	test_dynamic_compute_offering.py
test_max_account_cpus_scale_VM_2_USER_ACCOUNT	Failure	20.15	test_dynamic_compute_offering.py
test_max_account_memory_scale_VM_2_USER_ACCOUNT	Failure	72.83	test_dynamic_compute_offering.py
test_deploy_VM_with_affinity_group_1_ADMIN_ACCOUNT	Failure	80.52	test_dynamic_compute_offering.py
test_deploy_VM_with_affinity_group_2_USER_ACCOUNT	Failure	79.25	test_dynamic_compute_offering.py
test_check_vm_stats_2_USER_ACCOUNT	Failure	74.10	test_dynamic_compute_offering.py
test_deploy_virtual_machines_dynamic_offering_1_ADMIN_ACCOUNT	Failure	74.25	test_dynamic_compute_offering.py
test_deploy_virtual_machines_dynamic_offering_2_USER_ACCOUNT	Failure	18.46	test_dynamic_compute_offering.py
test_deploy_virtual_machines_static_offering_1_ADMIN_ACCOUNT	Failure	74.82	test_dynamic_compute_offering.py
test_deploy_virtual_machines_static_offering_2_USER_ACCOUNT	Failure	17.58	test_dynamic_compute_offering.py
test_change_so_stopped_vm_dynamic_to_dynamic_1_ADMIN_ACCOUNT	Failure	19.28	test_dynamic_compute_offering.py
test_change_so_stopped_vm_dynamic_to_static_1_ADMIN_ACCOUNT	Failure	19.51	test_dynamic_compute_offering.py
test_change_so_stopped_vm_static_to_dynamic_2_USER_ACCOUNT	Failure	17.58	test_dynamic_compute_offering.py
test_change_so_stopped_vm_static_to_static_1_ADMIN_ACCOUNT	Failure	19.62	test_dynamic_compute_offering.py
test_change_so_stopped_vm_static_to_static_2_USER_ACCOUNT	Failure	18.29	test_dynamic_compute_offering.py
test_02_deploy_vm_account_limit_reached	Failure	22.35	test_mm_max_limits.py
test_04_deployVm__account_limit_reached	Failure	22.29	test_mm_max_limits.py
runTest	Error	0.00	test_edgezone_supportedoperations.py
runTest	Error	0.00	test_edgezone_supportedoperations.py
test_01_1_egress_fr1	Error	11.69	test_egress_fw_rules.py
test_01_1_egress_fr1	Error	11.70	test_egress_fw_rules.py
test_01_egress_fr1	Error	12.51	test_egress_fw_rules.py
test_01_egress_fr1	Error	12.51	test_egress_fw_rules.py
test_03_1_egress_fr3	Error	65.32	test_egress_fw_rules.py
test_03_1_egress_fr3	Error	65.33	test_egress_fw_rules.py
test_06_1_egress_fr6	Error	65.49	test_egress_fw_rules.py
test_06_1_egress_fr6	Error	65.49	test_egress_fw_rules.py
test_07_1_egress_fr7	Failure	732.26	test_egress_fw_rules.py
test_07_egress_fr7	Error	12.51	test_egress_fw_rules.py
test_07_egress_fr7	Error	12.52	test_egress_fw_rules.py
test_09_egress_fr9	Error	11.55	test_egress_fw_rules.py
test_09_egress_fr9	Error	11.56	test_egress_fw_rules.py
test_10_1_egress_fr10	Error	65.60	test_egress_fw_rules.py
test_10_1_egress_fr10	Error	65.61	test_egress_fw_rules.py
test_12_egress_fr12	Error	65.96	test_egress_fw_rules.py
test_12_egress_fr12	Error	65.96	test_egress_fw_rules.py
test_13_1_egress_fr13	Error	69.37	test_egress_fw_rules.py
test_13_1_egress_fr13	Error	69.38	test_egress_fw_rules.py
test_05_create_delete_lbrule_forvpc	Error	9.03	test_escalations_ipaddresses.py
test_07_assign_remove_lbrule_toinstance	Error	63.39	test_escalations_ipaddresses.py
test_10_create_delete_portforwarding_forvpc	Error	55.53	test_escalations_ipaddresses.py
test_14_enable_disable_staticnat_fornonvpc	Error	15.55	test_escalations_ipaddresses.py
test_14_enable_disable_staticnat_fornonvpc	Error	15.55	test_escalations_ipaddresses.py
test_15_enable_disable_staticnat_forvpc	Error	60.46	test_escalations_ipaddresses.py
test_16_create_delete_ipforwardingrule	Error	71.92	test_escalations_ipaddresses.py
test_16_create_delete_ipforwardingrule	Error	71.93	test_escalations_ipaddresses.py
ContextSuite context=TestIpAddresses>:teardown	Error	6.07	test_escalations_ipaddresses.py
test_03_list_vpc_pagination	Error	105.00	test_escalations_networks.py
test_04_create_vpc_with_networkdomain	Failure	0.05	test_escalations_networks.py
test_09_list_virtual_machines_single_network	Error	5.46	test_escalations_networks.py
test_14_list_public_ipaddress_by_associated_networkid	Failure	0.03	test_escalations_networks.py
test_15_list_privategateway_byvpcid	Failure	56.73	test_escalations_networks.py
test_17_restart_vpc	Failure	0.03	test_escalations_networks.py
test_18_create_list_vpn_gateway	Failure	0.03	test_escalations_networks.py
test_21_listNetworkacls_by_privategateway_aclid	Error	53.46	test_escalations_networks.py
ContextSuite context=TestNetworks_2>:teardown	Error	54.55	test_escalations_networks.py
test_03_data_volume_resize	Error	84.93	test_escalations_volumes.py
test_04_custom_volume_resize	Error	64.90	test_escalations_volumes.py
test_06_volume_snapshot_policy_hourly	Error	64.01	test_escalations_volumes.py
test_07_volume_snapshot_policy_daily	Error	78.83	test_escalations_volumes.py
test_08_volume_snapshot_policy_weekly	Error	88.22	test_escalations_volumes.py
test_09_volume_snapshot_policy_monthly	Error	9.78	test_escalations_volumes.py
test_10_volume_snapshots_pagination	Error	62.80	test_escalations_volumes.py
test_11_volume_extract	Error	65.89	test_escalations_volumes.py
test_12_volume_upload	Error	79.82	test_escalations_volumes.py
test_13_volume_custom_disk_size	Error	10.63	test_escalations_volumes.py
test_01_create_sticky_policy_default_values	Error	10.32	test_haproxy.py
test_03_supported_policies_by_network	Error	10.11	test_haproxy.py
test_04_delete_lb_rule	Error	69.75	test_haproxy.py
test_05_error_alerts_after_create	Error	9.37	test_haproxy.py
test_06_release_ip	Error	72.41	test_haproxy.py
test_07_delete_account	Error	66.44	test_haproxy.py
test_08_create_policy_router_stopped	Error	5.78	test_haproxy.py
test_09_create_policy_router_destroy	Error	5.94	test_haproxy.py
test_10_create_policy_enable_disable_vpn	Error	5.93	test_haproxy.py
test_11_invalid_params	Error	5.92	test_haproxy.py
test_01_host_ha_with_nfs_storagepool_with_vm	Error	0.26	test_host_ha.py
test_04_host_ha_vmactivity_check	Error	0.24	test_host_ha.py
test_01_check_hypervisor_max_data_volume_limit	Error	6.11	test_hypervisor_capabilities.py
test_02_check_hypervisor_vm_snapshot	Error	1.52	test_hypervisor_capabilities.py
test_01_deploy_vm_with_implicit_planner	Error	1.47	test_implicit_planner.py
test_01_stop_start_instance	Failure	249.52	test_memory_limits.py
test_04_deploy_multiple_vm	Failure	105.75	test_memory_limits.py
test_01_change_service_offering	Failure	240.97	test_mm_domain_limits.py
test_04_deploy_multiple_vm	Failure	120.54	test_mm_domain_limits.py
test_01_multiple_child_domains	Failure	113.64	test_mm_domain_limits.py
test_add_PF_rule_2_SHARED	Failure	87.58	test_multiple_ips_per_nic.py
test_add_static_nat_rule_1_ISOLATED	Error	115.96	test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHARED	Failure	66.60	test_multiple_ips_per_nic.py
test_add_static_nat_rule_2_SHARED	Error	66.61	test_multiple_ips_per_nic.py
test_add_static_nat_rule_3_VPC	Error	98.50	test_multiple_ips_per_nic.py
test_delete_PF_nat_rule_2_SHARED	Error	93.93	test_multiple_ips_per_nic.py
test_disable_static_nat_1_ISOLATED	Error	88.83	test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHARED	Error	71.85	test_multiple_ips_per_nic.py
test_disable_static_nat_2_SHARED	Error	71.86	test_multiple_ips_per_nic.py
test_disable_static_nat_3_VPC	Error	97.05	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_1_ISOLATED	Error	13.34	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_1_ISOLATED	Error	13.35	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED	Error	13.38	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED	Error	13.38	test_multiple_ips_per_nic.py
test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_3_VPC	Error	13.86	test_multiple_ips_per_nic.py
ContextSuite context=TestNetworkRules>:teardown	Error	13.93	test_multiple_ips_per_nic.py
test_delete_vm_1_ISOLATED	Error	26.54	test_multiple_ips_per_nic.py
test_delete_vm_1_ISOLATED	Error	26.54	test_multiple_ips_per_nic.py
test_delete_vm_2_SHARED	Error	27.72	test_multiple_ips_per_nic.py
test_delete_vm_3_VPC	Error	12.90	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_1_ISOLATED	Error	22.59	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_1_ISOLATED	Error	22.59	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_2_SHARED	Error	27.00	test_multiple_ips_per_nic.py
test_network_restart_cleanup_false_3_VPC	Error	9.87	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_1_ISOLATED	Error	26.16	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_1_ISOLATED	Error	26.16	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_2_SHARED	Error	25.19	test_multiple_ips_per_nic.py
test_network_restart_cleanup_true_3_VPC	Error	13.25	test_multiple_ips_per_nic.py
test_reboot_router_VM_1_ISOLATED	Error	25.38	test_multiple_ips_per_nic.py
test_reboot_router_VM_1_ISOLATED	Error	25.38	test_multiple_ips_per_nic.py
test_reboot_router_VM_2_SHARED	Error	26.59	test_multiple_ips_per_nic.py
test_reboot_router_VM_3_VPC	Error	13.04	test_multiple_ips_per_nic.py
test_recover_vm_1_ISOLATED	Error	25.29	test_multiple_ips_per_nic.py
test_recover_vm_1_ISOLATED	Error	25.29	test_multiple_ips_per_nic.py
test_recover_vm_2_SHARED	Error	27.05	test_multiple_ips_per_nic.py
test_recover_vm_3_VPC	Error	9.99	test_multiple_ips_per_nic.py
test_02_created_shared_guest_network	Error	4.56	test_multiple_physical_network_creation.py
test_01_acquire_public_ips_in_isolated_network_with_single_vr	Error	6.98	test_multiple_subnets_in_isolated_network.py
test_03_acquire_public_ips_in_vpc_with_single_vr	Error	325.08	test_multiple_subnets_in_vpc.py
test_04_acquire_public_ips_in_vpc_with_redundant_vrs	Error	553.52	test_multiple_subnets_in_vpc_rvr.py
test_01_verify_ipv6_network	Failure	363.77	test_network_ipv6.py
test_02_verify_ipv6_network_redundant	Failure	165.75	test_network_ipv6.py
test_03_verify_upgraded_ipv6_network	Failure	342.91	test_network_ipv6.py
test_04_verify_upgraded_ipv6_network_redundant	Failure	391.38	test_network_ipv6.py
test_01_create_isolated_network_with_mtu	Failure	151.21	test_network_mtu.py
test_02_update_isolated_network_with_mtu	Failure	85.66	test_network_mtu.py
test_01_verify_vpc_dns	Error	62.17	test_network_vpc_custom_dns.py
test_23_list_untagged_host_for_vm_migration	Error	1.42	test_tags.py
test_24_public_ip_tag	Error	18.41	test_tags.py
ContextSuite context=TestOrganizationStates>:setup	Error	0.00	test_organization_states.py
test_02_Overcommit_factor	Failure	464.67	test_overcommit.py
test_03_cluste_capacity_check	Failure	610.32	test_overcommit.py
test_04_zone_capacity_check	Failure	610.40	test_overcommit.py
test_assign_vm_different_account_VR_1_VR	Error	12.12	test_persistent_networks.py
test_change_persistent_network_to_non_persistent	Error	5.69	test_persistent_networks.py
test_network_state_after_destroying_vms	Error	0.03	test_persistent_networks.py
test_newly_added_host_for_persistent_network_resources	Error	3789.18	test_persistent_networks.py
test_pf_nat_rule_persistent_network_1_LB_VR	Error	5.54	test_persistent_networks.py
test_upgrade_network_VR_to_PersistentRVR	Error	5.41	test_persistent_networks.py
test_upgrade_to_persistent_services_VR_1_LB_VR	Error	5.46	test_persistent_networks.py
test_vm_deployment_persistent_and_non_persistent_networks	Error	5.68	test_persistent_networks.py
test_vm_deployment_two_persistent_networks	Error	5.53	test_persistent_networks.py
test_volume_delete_event_errorState	Error	4.62	test_persistent_networks.py
test_account_operations_1_locked	Error	5.55	test_persistent_networks.py
test_account_operations_2_disabled	Error	5.54	test_persistent_networks.py
test_project_operations	Error	7.86	test_persistent_networks.py
ContextSuite context=TestAssociatePublicIp>:setup	Error	0.00	test_portable_ip.py
test_create_portable_ip_range	Failure	0.02	test_portable_ip.py
test_delete_account_services_disabled	Failure	4.98	test_portable_ip.py
test_delete_account_services_enabled	Failure	5.41	test_portable_ip.py
test_delete_portable_ip_range	Error	0.02	test_portable_ip.py
test_delete_portable_ip_range_in_use	Error	0.02	test_portable_ip.py
test_delete_portable_ip_range_non_root_admin	Error	0.02	test_portable_ip.py
ContextSuite context=TestDisassociatePublicIp>:setup	Error	5.43	test_portable_ip.py
test_list_portable_ip_range	Error	0.02	test_portable_ip.py
test_list_portable_ip_range_non_root_admin	Error	0.02	test_portable_ip.py
ContextSuite context=TestPortableIpTransferAcrossNetworks>:setup	Error	5.31	test_portable_ip.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_project_usage.py
test_02_migrate_vm	Failure	88.17	test_ps_project_limits.py
ContextSuite context=TestPublicIp>:setup	Error	0.00	test_public_ip.py
test_enableVPNOverRvR	Failure	163.01	test_redundant_router_services.py
test_01_reset_keypair_normal_user	Failure	847.85	test_reset_ssh_keypair.py
test_02_reset_keypair_domain_admin	Failure	842.57	test_reset_ssh_keypair.py
test_03_reset_keypair_root_admin	Failure	840.54	test_reset_ssh_keypair.py
test_01_reset_ssh_keys	Failure	830.44	test_reset_ssh_keypair.py
test_02_reset_ssh_key_password_enabled_template	Failure	775.79	test_reset_ssh_keypair.py
test_03_reset_ssh_with_no_key	Failure	770.77	test_reset_ssh_keypair.py
test_04_reset_key_passwd_enabled_no_key	Failure	823.99	test_reset_ssh_keypair.py
ContextSuite context=TestResetSSHKeypair>:teardown	Error	99.53	test_reset_ssh_keypair.py
ContextSuite context=TestResourceCountRunningVMs>:setup	Error	0.00	test_resource_count_running_vms.py
test_01_check_list_capacity	Failure	7.17	test_resource_limit_tags.py
test_06_verify_domain_tagged_vm_limit	Error	18.10	test_resource_limit_tags.py
test_07_verify_account_tagged_vm_limit	Error	17.72	test_resource_limit_tags.py
test_08_verify_domain_tagged_volume_limit	Error	17.65	test_resource_limit_tags.py
test_09_verify_account_tagged_volume_limit	Error	126.51	test_resource_limit_tags.py
test_10_verify_assign_vm_limit	Error	23.59	test_resource_limit_tags.py
test_11_verify_scale_vm_limit	Error	17.67	test_resource_limit_tags.py
test_12_verify_scale_volume_limit	Error	17.96	test_resource_limit_tags.py
test_13_verify_restore_vm_limit	Error	22.67	test_resource_limit_tags.py
test_13_verify_restore_vm_limit	Error	22.67	test_resource_limit_tags.py
test_02_create__template_new_resized_rootvolume_size	Error	235.42	test_rootvolume_resize.py
test_04_vmreset_after_migrate_vm__rootvolume_resized	Error	86.14	test_rootvolume_resize.py
test_08_increase_volume_size_within_account_limit	Failure	6.92	test_rootvolume_resize.py
test_08_increase_volume_size_within_account_limit	Error	6.92	test_rootvolume_resize.py
test_01_snapshot_data_disk	Failure	94.58	test_separate_backup_from_snapshot.py
test_createSharedNetwork_All	Error	73.08	test_shared_networks.py
test_createSharedNetwork_accountSpecific	Error	72.23	test_shared_networks.py
test_createSharedNetwork_domainSpecific	Error	79.89	test_shared_networks.py
test_createSharedNetwork_projectSpecific	Error	70.99	test_shared_networks.py
test_createSharedNetwork_usedVlan2	Error	67.01	test_shared_networks.py
test_deployVM_isolatedAndShared	Error	66.61	test_shared_networks.py
test_deployVM_multipleSharedNetwork	Error	66.61	test_shared_networks.py
test_escalation_ES1621	Error	66.79	test_shared_networks.py
test_reboot_router	Error	66.35	test_shared_networks.py
test_restart_network_1_True	Error	65.88	test_shared_networks.py
test_restart_network_2_False	Error	66.12	test_shared_networks.py
test_stop_start_router	Error	65.75	test_shared_networks.py
ContextSuite context=TestSnapshotCopy>:setup	Error	0.00	test_snapshot_copy.py
test_04_create_template_delete_account	Error	90.88	test_ss_domain_limits.py
test_01_multiple_domains_secondary_storage_limits	Error	93.42	test_ss_domain_limits.py
test_deployVmOnGivenHost	Failure	6.49	test_stopped_vm.py
test_09_stop_vm_migrate_vol	Error	6.35	test_stopped_vm.py
test_02_migrate_volume	Error	1.21	test_storage_motion.py
test_01_check_cross_domain_template_access	Error	0.02	test_template_access_across_domains.py
test_02_create_template	Error	0.02	test_template_access_across_domains.py
test_03_check_subdomain_template_access	Error	0.01	test_template_access_across_domains.py
test_04_check_non_public_template_access	Error	0.02	test_template_access_across_domains.py
test_05_check_non_public_template_subdomain_access	Error	0.01	test_template_access_across_domains.py
test_06_check_sub_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_07_check_default_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_08_check_non_public_template_sub_domain_access	Error	0.01	test_template_access_across_domains.py
test_01_create_template_snampshot	Error	262.20	test_template_from_snapshot_with_template_details.py
test_01_create_template	Error	170.10	test_templates.py
test_04_template_from_snapshot	Error	40.88	test_templates.py
test_02_create_private_gateway_with_associated_network	Error	5.30	test_user_private_gateway.py
ContextSuite context=TestUserPrivateGateways>:teardown	Error	10.70	test_user_private_gateway.py
test_03_create_domain_shared_network_with_associated_network	Error	217.99	test_user_shared_network.py
test_04_create_account_shared_network_with_associated_network	Error	217.87	test_user_shared_network.py
ContextSuite context=TestUserSharedNetworks>:teardown	Error	271.65	test_user_shared_network.py
test_11_get_vm_password	Failure	789.67	test_vm_passwdenabled.py
ContextSuite context=TestVMPasswordEnabled>:teardown	Error	790.81	test_vm_passwdenabled.py
ContextSuite context=TestVolumeDestroyRecover>:setup	Error	0.00	test_volume_destroy_recover.py
test_01_verify_ipv6_vpc	Error	61.42	test_vpc_ipv6.py
test_02_verify_ipv6_vpc_redundant	Error	128.70	test_vpc_ipv6.py
test_03_verify_upgraded_ipv6_vpc	Error	118.86	test_vpc_ipv6.py
test_04_verify_upgraded_ipv6_vpc_redundant	Error	244.85	test_vpc_ipv6.py
test_01_network_services_upgrade	Failure	121.07	test_vpc_network.py
test_03_migrate_router_after_addition_of_one_guest_network	Failure	240.22	test_vpc_routers.py
test_03_migrate_router_after_creating_vpc	Failure	240.20	test_vpc_routers.py
test_01_deploy_vm_two_isolated_nw	Failure	15.73	test_vpc_vm_life_cycle.py
ContextSuite context=TestVMLifeCycleDiffHosts>:setup	Error	157.72	test_vpc_vm_life_cycle.py
ContextSuite context=TestVMLifeCycleVPC>:setup	Error	300.60	test_vpc_vm_life_cycle.py

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16129

[Pearl1594]

@blueorangutan test ol8 xcpng83

[blueorangutan]

@Pearl1594 a [SL] Trillian-Jenkins test job (ol8 mgmt + xcpng83) has been kicked to run smoke tests

[Pearl1594]

@blueorangutan test ol8 xenserver-84

[blueorangutan]

@Pearl1594 a [SL] Trillian-Jenkins test job (ol8 mgmt + xenserver-84) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-15061)
Environment: xenserver-84 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 63376 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t15061-xenserver-84.zip
Smoke tests completed. 137 look OK, 13 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	146.62	test_events_resource.py
test_03_deploy_and_scale_kubernetes_cluster	Failure	51.19	test_kubernetes_clusters.py
test_01_non_strict_host_anti_affinity	Error	125.26	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	48.16	test_nonstrict_affinity_group.py
test_01_add_primary_storage_disabled_host	Error	15.38	test_primary_storage.py
test_01_primary_storage_iscsi	Error	0.17	test_primary_storage.py
test_01_primary_storage_nfs	Error	0.15	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	Error	0.24	test_primary_storage.py
test_02_list_snapshots_with_removed_data_store	Error	8.45	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	8.45	test_snapshots.py
test_01_vpn_usage	Error	1.08	test_usage.py
test_01_scale_up_verify	Failure	445.93	test_vm_autoscaling.py
test_02_update_vmprofile_and_vmgroup	Failure	254.72	test_vm_autoscaling.py
test_06_autoscaling_vmgroup_on_project_network	Failure	374.72	test_vm_autoscaling.py
test_06_autoscaling_vmgroup_on_project_network	Error	374.73	test_vm_autoscaling.py
test_07_autoscaling_vmgroup_on_vpc_network	Failure	377.24	test_vm_autoscaling.py
test_07_autoscaling_vmgroup_on_vpc_network	Error	377.25	test_vm_autoscaling.py
ContextSuite context=TestVmAutoScaling>:teardown	Error	387.04	test_vm_autoscaling.py
test_01_deploy_vm_on_specific_host	Error	0.07	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	0.09	test_vm_deployment_planner.py
test_08_migrate_vm	Error	0.06	test_vm_life_cycle.py
test_11_destroy_vm_and_volumes	Error	15.68	test_vm_life_cycle.py
test_12_start_vm_multiple_volumes_allocated	Error	54.63	test_vm_life_cycle.py
test_13_destroy_and_expunge_vm	Error	3.62	test_vm_life_cycle.py
test_01_migrate_vm_strict_tags_success	Error	0.23	test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure	Error	0.24	test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success	Error	0.17	test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure	Error	0.18	test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success	Error	0.20	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Error	0.20	test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags	Error	0.16	test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags	Error	3.44	test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success	Error	0.20	test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success	Error	5.55	test_vm_strict_host_tags.py
test_05_deploy_vm_on_specific_host_with_strict_tags_failure	Failure	0.19	test_vm_strict_host_tags.py
test_01_verify_ipv6_vpc	Error	160.62	test_vpc_ipv6.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	Failure	351.56	test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	Error	351.60	test_vpc_redundant.py
test_02_redundant_VPC_default_routes	Failure	259.88	test_vpc_redundant.py
test_02_redundant_VPC_default_routes	Error	259.91	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	Failure	247.40	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	Error	247.42	test_vpc_redundant.py
test_05_rvpc_multi_tiers	Failure	231.50	test_vpc_redundant.py
test_05_rvpc_multi_tiers	Error	231.52	test_vpc_redundant.py
test_01_redundant_vpc_site2site_vpn	Failure	171.93	test_vpc_vpn.py

[blueorangutan]

[SF] Trillian test result (tid-15058)
Environment: xcpng83 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 69334 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t15058-xcpng83.zip
Smoke tests completed. 140 look OK, 10 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	196.98	test_events_resource.py
test_03_deploy_and_scale_kubernetes_cluster	Failure	48.35	test_kubernetes_clusters.py
test_01_non_strict_host_anti_affinity	Error	169.61	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	73.92	test_nonstrict_affinity_group.py
test_01_add_primary_storage_disabled_host	Error	15.53	test_primary_storage.py
test_01_primary_storage_iscsi	Error	0.20	test_primary_storage.py
test_01_primary_storage_nfs	Error	0.20	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	Error	0.32	test_primary_storage.py
test_02_list_snapshots_with_removed_data_store	Error	15.75	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	15.76	test_snapshots.py
test_01_vpn_usage	Error	1.14	test_usage.py
test_01_deploy_vm_on_specific_host	Error	0.12	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	0.17	test_vm_deployment_planner.py
test_08_migrate_vm	Error	0.07	test_vm_life_cycle.py
test_11_destroy_vm_and_volumes	Error	20.36	test_vm_life_cycle.py
test_change_service_offering_for_vm_with_snapshots	Failure	981.77	test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success	Error	0.33	test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure	Error	0.28	test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success	Error	0.24	test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure	Error	0.26	test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success	Error	0.23	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Error	0.28	test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags	Error	0.24	test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags	Error	5.70	test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success	Error	0.24	test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success	Error	5.72	test_vm_strict_host_tags.py
test_05_deploy_vm_on_specific_host_with_strict_tags_failure	Failure	0.28	test_vm_strict_host_tags.py

[shwstppr]

@blueorangutan package

[blueorangutan]

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16166

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-15071)

[blueorangutan]

[SF] Trillian Build Failed (tid-15069)

[blueorangutan]

[SF] Trillian test result (tid-15068)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 55035 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t15068-kvm-ol8.zip
Smoke tests completed. 149 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_03_deploy_and_scale_kubernetes_cluster	Failure	28.87	test_kubernetes_clusters.py

[blueorangutan]

[SF] Trillian test result (tid-15070)
Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 74079 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12198-t15070-vmware-70u3.zip
Smoke tests completed. 147 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80	Error	976.14	test_internal_lb.py
test_03_deploy_and_scale_kubernetes_cluster	Failure	51.53	test_kubernetes_clusters.py
test_01_vpn_usage	Error	1.12	test_usage.py

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with no SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16176

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-15075)