Darren Tucker
1b470b9036
Fix cygwin conditional steps.
2022-08-19 15:19:19 +10:00
Darren Tucker
fd6ee741ab
Add a bit more debug output.
2022-08-19 15:12:57 +10:00
Darren Tucker
a9305c4c73
Add Cygwin (on windows-2019) test target.
...
In addition to installing the requisite Cygwin packages, we also need to
explicitly invoke "sh" for steps that run other scripts since the runner
environment doesn't understand #! paths.
2022-08-19 15:08:57 +10:00
Darren Tucker
5a5c580b48
Check for perms to run agent-getpeereid test.
...
Ubuntu 22.04 defaults to private home dirs which prevents "nobody"
running ssh-add during the agent-getpeereid test. Check for this and
add the necessary permissions.
2022-08-18 21:36:39 +10:00
Darren Tucker
5e820bf79c
Replace deprecated ubuntu-18.04 runners with 22.04
2022-08-12 14:56:55 +10:00
Darren Tucker
d0c4fa5859
Rerun tests if any .github config file changes.
2022-08-11 14:23:58 +10:00
Darren Tucker
113fe6c77a
Skip hostbased during Valgrind tests.
...
Valgrind doesn't let ssh exec ssh-keysign (because it's setuid) so skip
it during the Valgrind based tests.
See https://bugs.kde.org/show_bug.cgi?id=119404 for a discussion of this
(ironically there the problematic binary was ssh(1) back when it could
still be setuid).
2022-08-11 13:50:05 +10:00
Darren Tucker
4df246ec75
Fix conditional for running hostbased tests.
2022-08-11 10:24:56 +10:00
Darren Tucker
fdbd5bf507
Test hostbased auth on github runners.
2022-08-10 17:37:58 +10:00
Darren Tucker
dba7099ffc
Remove deprecated MacOS 10.15 runners.
2022-07-27 18:40:12 +10:00
Darren Tucker
eb679e2959
Move vmshutdown to first step.
...
If a previous run on a physical runner has failed to clean up, the next
run will fail because it'll try to check out the code to a broken
directory mount. Make cleanup the first step.
2022-07-15 21:31:48 +10:00
Darren Tucker
46b91b70ff
Rename bbone test target to ARM.
2022-07-15 20:25:27 +10:00
Darren Tucker
e75bbc1d88
Capture stderr output from configure.
2022-07-12 14:37:15 +10:00
Darren Tucker
fb2f3a61bf
Move unset to before we set anything.
2022-07-12 12:54:24 +10:00
Darren Tucker
c483a5c0fb
Test against openssl-3.0.5.
2022-07-06 11:52:54 +10:00
Darren Tucker
669a56bcfe
Update sanitizer test targets:
...
- remove clang-sanitize-memory for now. It takes so long that the test
times out.
- add gcc sanitize-address and sanitize-undefined test targets.
2022-07-05 18:35:53 +10:00
Darren Tucker
48cc68b691
Add GCC address sanitizer build/test.
2022-07-05 18:30:10 +10:00
Darren Tucker
55c60bdd39
Move sanitizer logs into regress for collection.
2022-07-05 18:30:10 +10:00
Darren Tucker
7394ed80c4
Add clang sanitizer tests.
2022-07-03 22:53:44 +10:00
Darren Tucker
c71a1442d0
Update OpenSSL tests to the most recent releases.
2022-06-29 18:28:47 +10:00
Darren Tucker
1781f507c1
Test against OpenSSL 1.1.1o and 3.0.3.
2022-05-27 18:19:48 +10:00
Darren Tucker
c53906e0c5
Test against LibreSSL 3.5.3.
2022-05-27 18:18:31 +10:00
Darren Tucker
f38cf74f20
Also retest OpenBSD upstream on .yml changes.
2022-05-06 14:50:18 +10:00
Darren Tucker
217b518e0f
Add ubsan minimal testcase on OpenBSD.
...
As suggested by djm@.
2022-05-06 14:39:34 +10:00
Darren Tucker
4835544d2d
Add Mac OS X 12 test target.
2022-04-30 11:00:02 +10:00
Darren Tucker
97a6a8b8c1
Only run tests when source files change.
...
Also run tests on changes to V_9_0 branch.
2022-04-29 18:34:38 +10:00
Darren Tucker
7bf2eb958f
Add debian-riscv64 test target.
2022-04-26 23:30:59 +10:00
Darren Tucker
3913c93552
Update OpenSSL and LibreSSL versions in tests.
2022-04-25 17:21:24 +10:00
Darren Tucker
d2b888762b
Retire fbsd6 test VM.
...
It's long since out of support, relatively slow (it's i686) and the
compiler has trouble with PIE.
2022-04-16 14:31:13 +10:00
Darren Tucker
3741df98ff
Disable security key on fbsd6 test host.
2022-04-04 23:52:11 +10:00
Darren Tucker
32c12236f2
Specify TEST_SHELL=bash on AIX.
...
The system shells cause the agent-restrict test to fail due to some
quoting so explicitly specify bash until we can get configure to
autmatically work around that.
2022-04-04 15:16:51 +10:00
Darren Tucker
6c49eb5fab
Only run regression tests on slow VMs.
2022-04-01 23:21:40 +11:00
Darren Tucker
f67e479039
Increase test timeout to allow slow VMs to finish
2022-04-01 23:21:06 +11:00
Darren Tucker
5b054d7640
Skip slow tests on (very) slow test targets.
2022-04-01 13:16:47 +11:00
Darren Tucker
e937514920
Add AIX 5.1 test target.
2022-03-28 17:51:03 +11:00
Darren Tucker
4bbe815ba9
Drop leading "v" from release version identifier.
...
It's present in the git tags but not in the release tarball names.
Also drop extra "/" from URL path.
2022-03-26 22:01:31 +11:00
Darren Tucker
f5cdd3b3c2
Use tarballs when testing LibreSSL releases.
...
This means they'll still work when the combination of -portable and
openbsd github repos no longer match.
2022-03-26 16:28:04 +11:00
Darren Tucker
d23efe4b12
Add OpenWRT mips and mipsel test targets.
2022-03-26 08:13:46 +11:00
Darren Tucker
f2ff669347
No unused param warnings for clang-12 and gcc-11.
...
These have too many false positives in -Werror tests on the github CI
since we often provide empty stub functions for functionality not needed
for particular configurations.
2022-02-28 22:21:36 +11:00
Darren Tucker
96558ecd87
Add debian-i386 test target.
2022-02-26 14:10:41 +11:00
Darren Tucker
3016ba4703
Add tests for latest releases of {Libre,Open}SSL.
2022-02-25 11:39:34 +11:00
Darren Tucker
6520c488de
Add Alpine Linux test VM.
2022-02-22 13:08:59 +11:00
Damien Miller
7c0d4ce911
disable agent-restrict test on minix3
...
Minix seems to have a platform-wide limit on the number of
select(2) syscalls that can be concurrently issued. This test
seems to exceed this limit.
Refer to:
https://github.com/Stichting-MINIX-Research-Foundation/minix/blob/R3.3.0/minix/servers/vfs/select.c#L114
https://github.com/Stichting-MINIX-Research-Foundation/minix/blob/R3.3.0/minix/servers/vfs/select.c#L30-L31
2022-02-22 11:14:51 +11:00
Darren Tucker
63bf4f49ed
Add test configs for MUSL C library.
2022-02-18 12:12:21 +11:00
Darren Tucker
41417dbda9
Comment hurd test, the VM is currently broken.
2022-02-17 22:05:29 +11:00
Darren Tucker
766176cfdb
Add cygwin-release test config.
...
This tests the flags used to build the cygwin release binaries.
2022-02-12 10:24:56 +11:00
Darren Tucker
ea13fc830f
Stop testing OpenBSD HEAD on 6.9 and 7.0.
...
HEAD is not guaranteed to work on previous stable branches, and at the
moment is broken due to libfido API changes.
2022-02-11 13:42:36 +11:00
Darren Tucker
3fe6800b60
Move more tests out of valgrind-1 runner.
2022-01-20 00:49:57 +11:00
Darren Tucker
6c435bd499
Stop on first test failure to minimize logs.
2022-01-13 09:01:05 +11:00
Darren Tucker
613a6545fc
libhardended_malloc.so moved into out dir.
2022-01-11 20:56:01 +11:00
Darren Tucker
bbf285164d
Always save config.h as build artifact.
...
Should allow better comparison between failing and succeeding test
platforms.
2022-01-05 11:48:58 +11:00
Darren Tucker
03bd4ed0db
Add OpenBSD 7.0 target. Retire 6.8.
2022-01-05 11:48:58 +11:00
Darren Tucker
3dafd3fe22
Increase timeout for test step.
2021-12-11 08:43:41 +11:00
Darren Tucker
5aefb05cd5
Update the list of tests that don't work on Minix.
...
While there, remove CC (configure will now find clang) and make the test
list easier to update via cut and paste.
2021-12-10 10:27:27 +11:00
Darren Tucker
e665ed2d0c
Switch from LibreSSL 3.4.0 to 3.4.1.
...
The LibreSSL 3.4.0 release has an OPENBSD_BRANCH that points to
"master" and that branch no longer has the files LibreSSL expects
and thus it will no longer build, breaking the test.
2021-11-12 22:57:51 +11:00
Darren Tucker
d575cf4489
kitchensink test target now needs krb5.
2021-10-22 23:27:41 +11:00
Darren Tucker
4ae39cada2
Test both MIT KRB5 and Heimdal.
2021-10-22 22:54:33 +11:00
Darren Tucker
a07664646b
Source configs script so setup_ci can use settings
2021-10-22 14:00:05 +11:00
Darren Tucker
34df52c201
Install libedit and pam based on config flags.
2021-10-22 09:42:14 +11:00
Darren Tucker
8c626cc563
Don't use 'here string", it's not POSIX.
2021-10-21 16:53:39 +11:00
Darren Tucker
086a4b5977
Remove -Werror from compiler package to install.
2021-10-21 15:33:27 +11:00
Darren Tucker
5a7a468750
Build with -Werror on most recent gcc and clang.
2021-10-21 15:18:34 +11:00
Darren Tucker
d4b38144c0
Add tcmalloc test target.
2021-10-12 23:01:40 +11:00
Darren Tucker
482f73be10
Include relevant env vars on command line.
...
Makes it easier to reproduce a build by cut/pasting the configure line.
2021-10-07 15:55:04 +11:00
Darren Tucker
52d4232b49
Disable security key on minix3.
...
The test doesn't work so disable.
2021-10-06 18:14:37 +11:00
Darren Tucker
8f4be526a3
Disable security key on NetBSD4 test.
...
sk-dummy used for the security key test includes both sha2.h and OpenSSL
causing the definitions conflict so disable security key support on this
platform.
2021-10-06 15:40:58 +11:00
Darren Tucker
a3c6375555
Use backticks instead of $(..) for portability.
...
Older shells (eg /bin/sh on Solaris 10) don't support $() syntax.
2021-09-29 19:30:59 +10:00
Darren Tucker
958aaa0387
Skip file-based tests by default on Mac OS.
...
The file-based tests need OpenSSL so skip them.
2021-09-29 18:53:32 +10:00
Darren Tucker
55c8bdf6e9
Build without OpenSSL on Mac OS.
...
Modern versions don't ship enough libcrypto to build against.
2021-09-29 18:42:47 +10:00
Darren Tucker
5e6d28b787
Split c89 test openssl setting out.
2021-09-29 17:48:09 +10:00
Darren Tucker
c8d92d3d4f
Add make clean step to tests.
2021-09-29 13:28:56 +10:00
Darren Tucker
360fb41ef8
Test all available clang and gcc versions.
2021-09-29 12:05:50 +10:00
David Manouchehri
f6a660e5bf
Don't prompt for yes/no questions.
2021-09-24 07:52:04 +10:00
Darren Tucker
8a7a06ee50
Test against LibreSSL 3.2.6, 3.3.4, 3.4.0.
2021-09-17 13:03:31 +10:00
Darren Tucker
c4565e69ff
Really fix test on OpenSSL 1.1.1 stable.
2021-09-08 21:09:49 +10:00
Darren Tucker
79f1bb5f56
Correct OpenSSL 1.1.1 stable identifier.
2021-09-08 18:51:39 +10:00
Darren Tucker
a3e92a6794
Tests for OpenSSL 3.0.0 release & 1.1.1 branch.
2021-09-08 13:45:10 +10:00
Darren Tucker
65bb011113
Test against OpenSSL 3 branch as well as dev.
...
Now that OpenSSL development has moved to 3.1, test against the most
recent version of the openssl-3.0 branch too.
2021-09-05 19:43:13 +10:00
Darren Tucker
6a24567a29
Improve github test driver script.
...
- use a trap to always output any failed regress logs (since the script
sets -e, the existing log output is never invoked).
- pass LTESTS and SKIP_LTESTS when re-running with sshd options (eg.
UsePAM).
2021-08-16 14:42:48 +10:00
Darren Tucker
b467cf1370
Remove deprecated ubuntu-16.04 test targets.
...
Github has deprecated ubuntu-16.04 and it will be removed on 20
September.
2021-08-16 11:32:23 +10:00
Darren Tucker
20e6eefcdf
Skip agent ptrace test on hurd.
2021-08-15 23:25:26 +10:00
Darren Tucker
7c9115bbbf
Add hurd test target.
2021-08-15 19:37:22 +10:00
Darren Tucker
7909a566f6
Skip scp3 tests on all dfly58 and 60 configs.
2021-08-15 12:45:10 +10:00
Darren Tucker
e50635640f
Test OpenSSH from OpenBSD head on 6.8 and 6.9.
2021-08-13 13:21:00 +10:00
Darren Tucker
e0ba38861c
Skip scp3 test on dragonfly 58 and 60.
...
The tests hang, so skip until we figure them out.
2021-08-13 13:00:14 +10:00
Darren Tucker
a1f78e08bd
Move SUDO to "make test" command line.
...
Environment variables don't get passed by vmrun, so move to command
line.
2021-07-26 12:45:30 +10:00
Darren Tucker
02e624273b
Set SUDO for tests and cleanup.
2021-07-25 23:26:36 +10:00
Darren Tucker
460ae5d930
Pass OPENSSL=no to make tests too.
2021-07-25 22:37:55 +10:00
Darren Tucker
b6673b1d2e
Test OpenBSD upstream with and without OpenSSL.
2021-07-24 14:20:12 +10:00
Darren Tucker
8aa2f9aeb5
Make whitespace consistent.
2021-07-14 11:27:24 +10:00
Darren Tucker
4f4297ee9b
Add ARM64 Linux self-hosted runner.
2021-07-14 11:27:24 +10:00
Darren Tucker
2c9e4b319f
Disable rocky84 to figure out why agent test fails
2021-07-03 19:17:31 +10:00
Darren Tucker
f93fdc4de1
Add rocky84 test target.
2021-06-28 13:06:37 +10:00
Darren Tucker
da9f9acaac
Save logs on failure for upstream test
2021-06-07 19:19:23 +10:00
Darren Tucker
76883c6016
Add obsdsnap-i386 upstream test target.
2021-06-07 14:38:17 +10:00
Darren Tucker
ecc186e46e
Retire fbsd7 test target.
...
It's the slowest of the selfhosted targets (since it's 32bit but has
most of the crypto algos). We still have coverage for 32bit i386.
2021-06-02 13:54:11 +10:00
Darren Tucker
1db69d1b65
Add dfly60 target.
2021-06-02 11:22:12 +10:00
Darren Tucker
7a3a1dd2c7
Put minix3 config in the host-specific block.
2021-06-01 09:38:26 +10:00
Darren Tucker
2063af7142
Add minix3 test target.
2021-05-27 21:13:38 +10:00
Darren Tucker
078a0e60c9
Rename README.md to ci-status.md.
...
The original intent was to provide a status page for the CIs configured
in that directory, but it had the side effect of replacing the top-level
README.md.
2021-05-25 11:40:47 +10:00