openssh-portable/regress
Darren Tucker 7b6cb5c5ef - (dtucker) [regress/Makefile] AIX's make doesn't like " +=", so replace
with vanilla "=".

Hopefully everybody's "make" will be happy with that.
2003-09-14 13:16:55 +10:00
..
Makefile - (dtucker) [regress/Makefile] AIX's make doesn't like " +=", so replace 2003-09-14 13:16:55 +10:00
README.regress - [regress/README.regress] Add a basic readme. 2003-09-04 15:39:54 +10:00
agent-getpeereid.sh - [Makefile.in regress/agent-getpeereid.sh] config.h is now in $BUILDDIR 2003-09-04 18:04:16 +10:00
agent-ptrace.sh [regress/agent-ptrace.sh] sh doesn't like "if ! shell_function; then". 2003-09-12 11:20:32 -07:00
agent-timeout.sh - (dtucker) [regress/agent-timeout.sh] Timeout of 5 sec is borderline for 2003-09-13 09:46:03 +10:00
agent.sh - [regress/agent.sh regress/proto-version.sh regress/ssh-com.sh 2003-09-04 15:16:56 +10:00
broken-pipe.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
bsd.regress.mk - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
connect-privsep.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
connect.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
dsa_ssh2.prv - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
dsa_ssh2.pub - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
dynamic-forward.sh [regress/agent-ptrace.sh regress/dynamic-forward.sh 2003-09-11 22:32:17 -07:00
exit-status.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
forwarding.sh - (dtucker) [dynamic-forward.sh forwarding.sh sftp-batch.sh (all regress/)] 2003-09-07 09:28:03 +10:00
keygen-change.sh - (djm) Sync regress with OpenBSD -current 2003-01-22 17:53:16 +11:00
keyscan.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
proto-mismatch.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
proto-version.sh - [regress/agent.sh regress/proto-version.sh regress/ssh-com.sh 2003-09-04 15:16:56 +10:00
proxy-connect.sh - (djm) Sync regress with OpenBSD -current 2003-01-22 17:53:16 +11:00
reconfigure.sh - [regress/reconfigure/sh] Make path to sshd fully qualified if required. 2003-09-04 13:59:48 +10:00
rekey.sh - [regress/rekey.sh] Remove dependence on /dev/zero (not all platforms have 2003-09-04 14:02:56 +10:00
rsa_openssh.prv - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
rsa_openssh.pub - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
rsa_ssh2.prv - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
runtests.sh - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
sftp-badcmds.sh [regress/sftp-badcmds.sh regress/sftp-cmds.sh] Fix errors like 2003-09-09 08:35:20 -07:00
sftp-batch.sh - (dtucker) [regress/sftp-batch.sh] Make temporary batch file name more 2003-09-07 09:31:02 +10:00
sftp-cmds.sh [regress/agent-ptrace.sh regress/dynamic-forward.sh 2003-09-11 22:32:17 -07:00
sftp.sh - [regress/sftp.sh] Remove dependency on /dev/stdin. 2003-09-04 15:00:55 +10:00
ssh-com-client.sh - [regress/sftp-badcmds.sh regress/sftp-cmds.sh regress/sftp.sh 2003-09-04 14:54:39 +10:00
ssh-com-keygen.sh - (dtucker) OpenBSD CVS Sync (regress/) 2003-06-18 22:36:48 +10:00
ssh-com-sftp.sh - [regress/ssh-com-sftp.sh] Remove dependency on /dev/stdin. 2003-09-04 15:26:57 +10:00
ssh-com.sh - [regress/agent.sh regress/proto-version.sh regress/ssh-com.sh 2003-09-04 15:16:56 +10:00
stderr-after-eof.sh [regress/agent-ptrace.sh regress/dynamic-forward.sh 2003-09-11 22:32:17 -07:00
stderr-data.sh - [regress/sftp-badcmds.sh regress/sftp-cmds.sh regress/sftp.sh 2003-09-04 14:54:39 +10:00
t4.ok - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
t5.ok - (djm) Import OpenBSD regression tests. Requires BSD make to run 2002-05-01 13:17:33 +10:00
test-exec.sh [regress/agent-ptrace.sh regress/dynamic-forward.sh 2003-09-11 22:32:17 -07:00
transfer.sh - [regress/sftp-badcmds.sh regress/sftp-cmds.sh regress/sftp.sh 2003-09-04 14:54:39 +10:00
try-ciphers.sh - (dtucker) OpenBSD CVS Sync (regress/) 2003-06-18 22:43:13 +10:00
yes-head.sh [regress/yes-head.sh] shell portability fix. 2003-09-12 13:21:14 -07:00

README.regress

Overview.

$ ./configure && make tests

You'll see some progress info. A failure will cause either the make to
abort or the driver script to report a "FATAL" failure.

The test consists of 2 parts. The first is the file-based tests which is
driven by the Makefile, and the second is a set of network or proxycommand
based tests, which are driven by a driver script (test-exec.sh) which is
called multiple times by the Makefile.

Failures in the first part will cause the Makefile to return an error.
Failures in the second part will print a "FATAL" message for the failed
test and continue.

OpenBSD has a system-wide regression test suite. OpenSSH Portable's test
suite is based on OpenBSD's with modifications.


Environment variables.

SUDO: path to sudo command, if desired. Note that some systems (notably
	systems using PAM) require sudo to execute some tests.
TEST_SSH_TRACE: set yo "yes" for verbose output from tests 
TEST_SSH_QUIET: set to "yes" to suppress non-fatal output.
TEST_SSH_x: path to "ssh" command under test, where x=SSH,SSHD,SSHAGENT,SSHADD
	SSHKEYGEN,SSHKEYSCAN,SFTP,SFTPSERVER
OBJ: used by test scripts to access build dir.


Individual tests.

You can invoke test-exec.sh directly if you set up the path to find the
binaries under test and the test scripts themselves, for example:

$ cd regress
$ PATH=`pwd`/..:$PATH:. sh test-exec.sh `pwd` agent-timeout.sh
ok agent timeout test


Files.

test-exec.sh: the main test driver. Sets environment, creates config files
and keys and runs the specified test.

At the time of writing, the individual tests are:
agent-timeout.sh:	agent timeout test
agent.sh:		simple agent test
broken-pipe.sh:		broken pipe test
connect-privsep.sh:	proxy connect with privsep
connect.sh:		simple connect
exit-status.sh:		remote exit status
forwarding.sh:		local and remote forwarding
keygen-change.sh:	change passphrase for key
keyscan.sh:		keyscan
proto-mismatch.sh:	protocol version mismatch
proto-version.sh:	sshd version with different protocol combinations
proxy-connect.sh:	proxy connect
sftp.sh:		basic sftp put/get
ssh-com-client.sh:	connect with ssh.com client
ssh-com-keygen.sh:	ssh.com key import
ssh-com-sftp.sh:	basic sftp put/get with ssh.com server
ssh-com.sh:		connect to ssh.com server
stderr-after-eof.sh:	stderr data after eof
stderr-data.sh:		stderr data transfer
transfer.sh:		transfer data
try-ciphers.sh:		try ciphers
yes-head.sh:		yes pipe head


Problems?

Run the failing test with shell tracing (-x) turned on:
$ PATH=`pwd`/..:$PATH:. sh -x test-exec.sh `pwd` agent-timeout.sh

Failed tests can be difficult to diagnose. Suggestions:
- run the individual test via ./test-exec.sh `pwd` [testname]
- set LogLevel to VERBOSE in test-exec.sh and enable syslogging of
  auth.debug (eg to /var/log/authlog).


Known Issues.


$Id: README.regress,v 1.1 2003/09/04 05:39:54 dtucker Exp $