b6e01459b5
Move obsdsnap test VMs to ephemeral runners.
2022-12-13 20:48:56 +11:00
9f2747e0be
Rework how selfhosted tests interact with runners.
...
Previously there was one runner per test target (mostly VMs). This had
a few limitations:
- multiple tests that ran on the same target (eg multiple build
configs) were serialized on availability or that runner.
- it needed manual balancing of VMs over host machines.
To address this, make VMs that use ephemeral disks (ie most of them)
all use a pool of runners with the "libvirt" label. This requires that
we distinguish between "host" and "target" for those. Native runners
and VMs with persistent disks (eg the constantly-updated snapshot ones)
specify the same host and target.
This should improve test throughput.
2022-11-28 22:39:08 +11:00
d664ddaec8
Run vmstartup from temp dir.
...
This will allow us to create ephemeral disk images per-runner.
2022-11-27 12:19:37 +11:00
0fa16e952b
Make "config" in matrix singular and pass in env.
...
This will allow the startup scripts to adapt their behaviour based on
the type and config.
2022-11-27 12:14:00 +11:00
e8857043af
Add "libvirt" label to dfly30.
2022-11-27 11:45:43 +11:00
9775473d84
Rename "os" in matrix to "target".
...
This is in preparation to distinguish this from the host that the runner
runs on in case where they are separate (eg VMs).
2022-11-27 11:20:35 +11:00
04fd00ceff
Remove unused self-hosted test targets.
2022-11-27 09:23:04 +11:00
c9d9fcad2a
Remove explicit "default" test config argument.
...
Not specifying the test config implicitly selects default args.
2022-11-27 09:16:15 +11:00
8926956f22
Add dfly62 test target.
2022-11-11 11:25:37 +11:00
419aa8a312
Shutdown any VM before trying to check out repo.
...
In the case where the previous run did not clean up, the checkout will
fail as it'll leave a stale mount.
2022-11-08 12:42:52 +11:00
a32c07cbb7
Run vm startup and shutdown from runner temp dir.
...
Should work even if the github workspace dir is on a stale sshfs mount.
2022-11-08 12:01:33 +11:00
2ea03d1f6d
Update checkout and upload actions.
...
Update actions/checkout and actions/upload-artifact to main branch for
compatibility with node.js v16.
2022-11-08 10:29:32 +11:00
4e316ff0f1
Split out rekey test since it runs the longest.
2022-11-08 10:29:32 +11:00
b496b9f831
Do not run CIFuzz on selfhosted tree.
...
We already run it on the regular tree, no need to double up.
2022-11-07 14:45:37 +11:00
2138b1c4dd
Whitespace change to trigger CIFuzz workflow.
2022-11-07 14:41:58 +11:00
4670b97ef8
Run cifuzz workflow on the actions as regular CI.
2022-11-07 14:34:04 +11:00
79391e66ce
Add CIFuzz integration
2022-11-07 14:31:45 +11:00
9655217231
Rerun tests on changes to Makefile.in in any dir.
2022-11-03 23:07:50 +11:00
73550a218e
Increase selfhosted job timeout.
...
The default job timeout of 360 (6h) is not enough to complete the
regress tests for some of the slow VMs depending on the load on the host.
Increase to 600 (10h).
2022-11-03 13:41:16 +11:00
ba05370963
Add tests for OpenSSL 3.0.7 and LibreSSL 3.6.1.
2022-11-03 08:40:06 +11:00
a75cffc270
Add LibreSSL 3.6.0 to test suite.
...
While there, bump OpenSSL to latest 1.1.1q release.
2022-10-07 03:54:56 +11:00
ef211eee63
Test commits to all branches of portable.
...
Only test OpenBSD upstream on commits to master since that's what it
tracks.
2022-10-05 06:31:48 +11:00
9f81736cf1
Add Windows 2022 test targets.
2022-08-27 09:37:40 +10:00
85e1a69243
Add cygwin-release test target.
...
This also moves the cygwin package install from the workflow file to
setup_ci.sh so that we can install different sets of Cygwin packages
for different test configs.
2022-08-26 19:22:25 +10:00
6851f4b8c3
Install Cygwin packages based on OS not config.
2022-08-19 17:22:18 +10:00
1b470b9036
Fix cygwin conditional steps.
2022-08-19 15:19:19 +10:00
a9305c4c73
Add Cygwin (on windows-2019) test target.
...
In addition to installing the requisite Cygwin packages, we also need to
explicitly invoke "sh" for steps that run other scripts since the runner
environment doesn't understand #! paths.
2022-08-19 15:08:57 +10:00
5e820bf79c
Replace deprecated ubuntu-18.04 runners with 22.04
2022-08-12 14:56:55 +10:00
d0c4fa5859
Rerun tests if any .github config file changes.
2022-08-11 14:23:58 +10:00
fdbd5bf507
Test hostbased auth on github runners.
2022-08-10 17:37:58 +10:00
dba7099ffc
Remove deprecated MacOS 10.15 runners.
2022-07-27 18:40:12 +10:00
eb679e2959
Move vmshutdown to first step.
...
If a previous run on a physical runner has failed to clean up, the next
run will fail because it'll try to check out the code to a broken
directory mount. Make cleanup the first step.
2022-07-15 21:31:48 +10:00
46b91b70ff
Rename bbone test target to ARM.
2022-07-15 20:25:27 +10:00
c483a5c0fb
Test against openssl-3.0.5.
2022-07-06 11:52:54 +10:00
669a56bcfe
Update sanitizer test targets:
...
- remove clang-sanitize-memory for now. It takes so long that the test
times out.
- add gcc sanitize-address and sanitize-undefined test targets.
2022-07-05 18:35:53 +10:00
55c60bdd39
Move sanitizer logs into regress for collection.
2022-07-05 18:30:10 +10:00
7394ed80c4
Add clang sanitizer tests.
2022-07-03 22:53:44 +10:00
c71a1442d0
Update OpenSSL tests to the most recent releases.
2022-06-29 18:28:47 +10:00
1781f507c1
Test against OpenSSL 1.1.1o and 3.0.3.
2022-05-27 18:19:48 +10:00
c53906e0c5
Test against LibreSSL 3.5.3.
2022-05-27 18:18:31 +10:00
f38cf74f20
Also retest OpenBSD upstream on .yml changes.
2022-05-06 14:50:18 +10:00
217b518e0f
Add ubsan minimal testcase on OpenBSD.
...
As suggested by djm@.
2022-05-06 14:39:34 +10:00
4835544d2d
Add Mac OS X 12 test target.
2022-04-30 11:00:02 +10:00
97a6a8b8c1
Only run tests when source files change.
...
Also run tests on changes to V_9_0 branch.
2022-04-29 18:34:38 +10:00
7bf2eb958f
Add debian-riscv64 test target.
2022-04-26 23:30:59 +10:00
3913c93552
Update OpenSSL and LibreSSL versions in tests.
2022-04-25 17:21:24 +10:00
d2b888762b
Retire fbsd6 test VM.
...
It's long since out of support, relatively slow (it's i686) and the
compiler has trouble with PIE.
2022-04-16 14:31:13 +10:00
f67e479039
Increase test timeout to allow slow VMs to finish
2022-04-01 23:21:06 +11:00
e937514920
Add AIX 5.1 test target.
2022-03-28 17:51:03 +11:00
d23efe4b12
Add OpenWRT mips and mipsel test targets.
2022-03-26 08:13:46 +11:00
Darren Tucker
David Korczynski