Repository navigation
[16.0-stable] evetest: sync with master and adapt the tests to EVE 16.0 - #6842
Merged
Merged
Conversation
milan-zededa
requested review from
deitch,
eriknordmark and
yash-zededa
as code owners
October 18, 2026 17:41
This was referenced Oct 18, 2026
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## 16.0-stable #6842 +/- ##
===============================================
- Coverage 29.12% 26.89% -2.24%
===============================================
Files 10 25 +15
Lines 1133 4332 +3199
===============================================
+ Hits 330 1165 +835
- Misses 768 2938 +2170
- Partials 35 229 +194 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
This was referenced Oct 20, 2026
milan-zededa
force-pushed
the
evetest-16.0
branch
2 times, most recently
from
October 22, 2026 13:32
d7e5438 to
80d6149
Compare
Publish the evetest, broker, SDN and testapps images from 16.0-stable the same way as from master. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
Start with a copy of evetest from master. Test changes required to match EVE 17.0 will be done in the follow-up commits. The copy also includes a few fixes that are not in master yet: more generous timeouts in tests that depended on the periodic connectivity test or on slow app start, the port label used to isolate a node in TestClusterPVCRedownload, and the issues reported by yetus. It also carries the evetest changes of lf-edge#6781 (TestAppTeardownWithRemovedAdapter) and lf-edge#6794 (TestMgmtProxy CDI HTTP DataVolume cases and timeouts), which are in master but were missing from the first copy. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
Point evetest at the pillar from 17.0-stable (the eve-api version it uses is unchanged) and make the tests match what 17.0 supports. Framework: on 17.0 a change of the adapters of a deployed app is rejected unless a purge is requested, so UpdateApplication now bumps the purge counter instead of the restart counter for such changes. Removed tests of features that are not in 17.0: the konvert suite, vault key mode recovery, deferred queue metrics, native Kubernetes app networking, the USB hub chain test, and the NIC count, ordered interface, staged NIC and passthrough NIC change tests. The dynamic NIC addition part of TestNetworkAdapterPassthrough and the usbaddr wildcard phase of TestUSBFlashDriveHotplug are removed as well. Adjusted tests to the 17.0 behavior: TestDNSFunctionality and the LPS network test do not rely on the management dnsmasq (DNS servers are read from /etc/resolv.conf), and the NTP servers reported for an app VIF are only the NI-level ones. The upgrade test starts EVE-K from 17.0.1-rc2, the first 17.0 tag with the longhorn disk path fix. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
Point evetest at the pillar from the tip of 16.0-stable. The eve-api version used by that pillar is the one evetest already referenced. The kubevirt hypervisor (eve-k) is not supported in 16.0-stable, so remove it from the framework together with everything that exists only for it: HypervisorKubevirt, the EdgeCluster and cluster config builders, the cluster-info gRPC calls and "evetest cluster" command, the kubectl helpers, RemoteConsole and DialViaSSH, and the K3s registry mirror setup. Remove the tests that cover eve-k only (the cluster and kuberegistration suites, the VMIRS purge test, the vault zvol trim test and the volume size alignment test). Tests that run on both flavors are kept without their eve-k specific parts. TestPNAC is dropped as well, since SCEP enrollment is not implemented in 16.0-stable. The OCI datastore upgrade variant starts from the latest 16.0.x release (16.0.2-lts); if it fails because of the missing downloader fix, backport the fix and bump the version. TestHardwareInventory and TestContainerdCPUs are dropped too: 16.0-stable does not report HwInventorySupport (lf-edge#5535) and has no ctrd_max_vcpus confinement of containerd (lf-edge#6771). The 16.0 sshd has a broken "Subsystem sftp" path, so scp over SFTP never works there. scp now falls back to the legacy protocol (-O) when the SFTP attempt fails, escaping the remote path with backslashes. The PCI access tracer builds eve-tools/bpftrace-compiler from its vendor directory only when the checkout has one, which 16.0-stable does not. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
milan-zededa
force-pushed
the
evetest-16.0
branch
from
October 22, 2026 14:10
80d6149 to
1920752
Compare
rene
approved these changes
Oct 25, 2026
4 of 7 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Bring
evetestto16.0-stableand make it work with EVE 16.0.The PR has four commits:
evetest: add the image publishing workflow to 16.0-stable: the workflowthat builds and publishes the evetest images from this branch.
Copy evetest from master:evetestis made to be in sync with master,including the evetest changes of USB passthrough: fixes for device model changes at runtime #6781 and Fix CDI HTTP DataVolume imports through the mgmtproxy cni0 TLS proxy #6794, plus a few small fixes
that make some tests less sensitive to timing.
evetest: adapt tests to EVE 17.0: the same adaptation as in [17.0-stable] evetest: sync with master and adapt the tests to EVE 17.0 #6833(17.0-stable), kept as a separate commit so that the 16.0 changes on top of
it are easy to review. It removes the tests of features that are not in
17.0, adjusts the tests to the 17.0 behavior and points
evetest/go.modtothe
17.0-stablepillar.evetest: adapt tests to EVE 16.0: on top of that, the tests are made tomatch what 16.0 supports, and
evetest/go.modis updated to point to thepillar from
16.0-stable:removed from the framework together with everything that exists only for
it (cluster configuration builders, cluster-info gRPC calls, kubectl
helpers,
RemoteConsole,DialViaSSH, the K3s registry mirror setup).suites, the VMIRS purge test, the vault zvol trim test and the volume size
alignment test). Tests that run on both flavors are kept without their
eve-k specific parts.
TestPNAC(no SCEPenrollment),
TestHardwareInventory(HwInventorySupportis notreported) and
TestContainerdCPUs(noctrd_max_vcpusconfinement ofcontainerd).
Subsystem sftppath, so scp over SFTP neverworks there. scp now falls back to the legacy protocol (
-O), escapingthe remote path with backslashes.
eve-tools/bpftrace-compilerfrom itsvendordirectory only if the checkout has one, which16.0-stabledoesnot.
Some tests need fixes that are not in
16.0-stableyet and are backported inseparate PRs:
TestHaltUnresponsiveGuest: [16.0-stable] kvm: honour the force flag when stopping a domain #6843TestExternalPortScanKVM: [16.0-stable] evetest: port scans; fix the exposure they found on EVE #6845TestSwitchNIDeletedWithAppsAttached: [16.0-stable] Fix bugs in reporting of application IPs and flows #6844TestVMAppPurgeAfterPowerCycle: [16.0-stable] zedmanager: drive purge state machine to completion in doUpdate #6846, [16.0-stable] zedmanager: fix purge stuck when app was never activated #6847, [16.0-stable] eve-k: fix purge leaving stale VMIRS generations and volume refs #6848TestInfoRetriedAfterServerError: [16.0-stable] pillar: retry deferred info messages the controller may still accept #6849How to test and validate this PR
Run the tests against a build of
16.0-stable(with the backports above forthe tests listed there), for example:
The tests have been run with the QEMU provider.
Changelog notes
No user-facing changes (evetest only).
Checklist
And the last but not least:
check them.