runtests: run a series of tests and compare against a baseline

Overview

runtests runs one or more executables (each assumed to correspond to a set of test cases) and from each run redirects the standard output to results_dir/exec_base_name.results. The redirected output is compared to baseline_dir/exec_base_name.baseline and if different or if there is no baseline data available an error is flagged. If there is no error, the .results file is removed.

Invoking

The command-line syntax for runtests is

     runtests [-r results_dir] [-b baseline_dir] [--] \
          exec_name | -f file ...

-r

The argument that follows this option sets the directory used for storage of the results from the tests. If not set, the default is the directory specified by the TMPDIR environment variable or /tmp if that is not set.

-b

The argument that follows this option sets the directory to search for baseline results. If not set, the default is the current working directory.

--

Anything after this will not be examined for -r or -b options.

exec_name

Is the name of an executable to run. More than one executable may be specified, and they may be interspersed with -f file directives.

-f

The argument following this is treated as a file to be read for the names of executables to run. The executables should be listed one per line and no additional lines may appear in the file. If file is -, the names of the executables are read from standard input.

modified $Date: 2003/12/09 05:24:24 $