Repository navigation
[17.0-stable] evetest: sync with master and adapt the tests to EVE 17.0 - #6833
Merged
Merged
Conversation
milan-zededa
requested review from
eriknordmark and
yash-zededa
as code owners
October 16, 2026 14:59
milan-zededa
requested review from
andrewd-zededa,
christoph-zededa,
europaul and
rene
October 16, 2026 15:03
milan-zededa
force-pushed
the
evetest-17.0
branch
5 times, most recently
from
October 16, 2026 15:44
1d634aa to
e3cfd85
Compare
Contributor
Author
|
About the remaining Yetus failures (latest run: https://github.com/lf-edge/eve/actions/runs/38925121993). None of them is relevant for this PR:
|
7 of 9 tasks
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## 17.0-stable #6833 +/- ##
===============================================
+ Coverage 22.94% 23.30% +0.35%
===============================================
Files 513 523 +10
Lines 94855 96553 +1698
===============================================
+ Hits 21768 22497 +729
- Misses 71248 72034 +786
- Partials 1839 2022 +183 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
milan-zededa
force-pushed
the
evetest-17.0
branch
from
October 17, 2026 17:07
e3cfd85 to
cba429f
Compare
Publish the evetest, broker, SDN and testapps images from 17.0-stable the same way as from master. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
Start with a copy of evetest from master. Test changes required to match EVE 17.0 will be done in the follow-up commits. The copy also includes a few fixes that are not in master yet: more generous timeouts in tests that depended on the periodic connectivity test or on slow app start, the port label used to isolate a node in TestClusterPVCRedownload, and the issues reported by yetus. It also carries the evetest changes of lf-edge#6781 (TestAppTeardownWithRemovedAdapter) and lf-edge#6794 (TestMgmtProxy CDI HTTP DataVolume cases and timeouts), which are in master but were missing from the first copy. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
Point evetest at the pillar from 17.0-stable (the eve-api version it uses is unchanged) and make the tests match what 17.0 supports. Framework: on 17.0 a change of the adapters of a deployed app is rejected unless a purge is requested, so UpdateApplication now bumps the purge counter instead of the restart counter for such changes. Removed tests of features that are not in 17.0: the konvert suite, vault key mode recovery, deferred queue metrics, native Kubernetes app networking, the USB hub chain test, and the NIC count, ordered interface, staged NIC and passthrough NIC change tests. The dynamic NIC addition part of TestNetworkAdapterPassthrough and the usbaddr wildcard phase of TestUSBFlashDriveHotplug are removed as well. Adjusted tests to the 17.0 behavior: TestDNSFunctionality and the LPS network test do not rely on the management dnsmasq (DNS servers are read from /etc/resolv.conf), and the NTP servers reported for an app VIF are only the NI-level ones. The upgrade test starts EVE-K from 17.0.1-rc2, the first 17.0 tag with the longhorn disk path fix. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Milan Lenco <milan@zededa.com>
milan-zededa
force-pushed
the
evetest-17.0
branch
from
October 18, 2026 17:37
cba429f to
c536778
Compare
This was referenced Oct 18, 2026
eriknordmark
approved these changes
Oct 19, 2026
eriknordmark
left a comment
Contributor
There was a problem hiding this comment.
Do we not need a evetest/VERSION file any more?
Contributor
|
No need to wait for eden run for these evetest-only changes. |
Contributor
Author
@eriknordmark |
2 of 6 tasks
4 of 7 tasks
Merged
6 of 9 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Bring
evetestto17.0-stableand make it work with EVE 17.0.The PR has three commits:
evetest: add the image publishing workflow to 17.0-stable: the workflowthat builds and publishes the evetest images from this branch.
Copy evetest from master: first,evetestis made to be in sync withmaster, including all the enhancements from evetest: run several tests in parallel with a dashboard UI #6783 (not yet merged to master), plus a few small fixes to make some tests less sensitive to
timing.
evetest: adapt tests to EVE 17.0: in the follow-up commit, some testsare removed or modified to align with 17.0, and
evetest/go.modisupdated to point to the pillar from
17.0-stable:pkg/pillaris bumped to the17.0-stabletip (da1f21294a; theeve-apiversion is unchanged, 17.0 pillar uses the same one).rejected unless a purge is requested, so
UpdateApplicationnow bumpsthe purge counter instead of the restart counter for such changes.
vault key mode recovery, deferred queue metrics, native Kubernetes app
networking, the USB hub chain test, and the NIC count, ordered
interface, staged NIC and passthrough NIC change tests. The dynamic NIC
addition part of
TestNetworkAdapterPassthroughand the usbaddrwildcard phase of
TestUSBFlashDriveHotplugare removed as well.TestDNSFunctionalityand the LPSnetwork test do not rely on the management dnsmasq (DNS servers are
read from
/etc/resolv.conf), and the NTP servers reported for an appVIF are only the NI-level ones. The upgrade test starts EVE-K from
17.0.1-rc2, the first 17.0 tag with the longhorn disk path fix.The only open question is
TestInfoRetriedAfterServerError, which currentlyfails because #6304 is still not backported to
17.0-stable.How to test and validate this PR
Run the tests against a build of
17.0-stable, for example:The tests have been run with the Proxmox and the QEMU providers.
Changelog notes
No user-facing changes (evetest only).
Checklist
And the last but not least:
check them.