Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: Jon TURNEY <jon.turney@dronecode.org.uk>
Signed-off-by: Dan Nicholson <dbn.lists@gmail.com>
|
|
tprogs lists the test programs without $(EXEEXT), so substituting
the $(EXEEXT) with .c to get BUILD_SOURCES fails to work correctly
when $(EXEEXT) isn't empty
Signed-off-by: Jon TURNEY <jon.turney@dronecode.org.uk>
Signed-off-by: Dan Nicholson <dbn.lists@gmail.com>
|
|
Allows moving the location of the results directory without having to
recreate the dated subdirectory. For example, "xts-run -o ~/xts-results"
will give you results in ~/xts-results/$date and subsequent runs will
not conflict.
|
|
Collect all the results under one directory instead of cluttering the
current directory. Also, add the seconds to the date in the directory
name to reduce the chance of conflict.
|
|
When using an older automake, the AM_SILENT_RULES macro is not used,
but the custom silent rule for mc uses the variable AM_DEFAULT_VERBOSITY.
Make sure it's defined even without AM_SILENT_RULES.
Tested-by: Pat Kane <pekane52@gmail.com>
|
|
Give users a quick summary of the test results with the xts-report
"no details" mode. This will appear next to the journal as summary.
|
|
Use the package version for reporting the version of xts-run and
xts-report.
|
|
|
|
I still can't find the issue, but AM_V_mc_ was causing make to stop on a
recursive variable. Now it's basically AM_V_GEN with s/GEN/MC/.
|
|
|
|
xts-report makes a lot more sense than vswrpt since everything else is
called xts and you probably couldn't even figure out what vswrpt is.
A few fixes along the way:
- use DEFAULT_TET_ROOT when $TET_ROOT is not set and use it throughout
the code
- fix the argv[0] scanner to also accept xts-report
- comment out a random form feed (wtf?) and a useless error message
- install the docs so xts-report can strip the release data
|
|
Not used yet, but will be much better than constant getenv("TET_ROOT").
|
|
Hopefully by the year 2100 XTS will not be necessary...
|
|
|
|
This will be renamed to xts-report, but it has some clever argv[0]
matching that prevents it for now.
Also fixes a broken comment from an RCS ID removal.
|
|
|
|
|
|
|
|
Linking the xts libraries statically into each test program results in a
massive size for the collection of programs. The libraries have been
changed to private libtool modules that default to shared, resulting in
a much smaller installed size.
One consequence of linking to shared objects is that the linker errors
on undefined extern variables. The obsolete and unused startup routines
in linkstart.c had one of these, so they have been removed from the
build.
Next is to create the tet library shared.
|
|
We want to use the tcc built with xts, so default to setting the full
path instead of hoping to find it in $PATH.
|
|
More tests can be run when using XTEST.
|
|
The XP check for protocol tests in configure was grabbing the same
packages as the general XTS check. Consolidate them.
|
|
The meanings of the variables were confusing or obfuscating. Now it's
much clearer which libraries are in use.
|
|
|
|
For some reason, there seems to be an aversion to the standard headers.
Mostly this is <string.h>, which unfortunately causes a symbol conflict
with index on glibc.
|
|
The journal file will default to $results_dir/journal, which is what we
want anyway.
|
|
Having critical errors in the journal is nice, but it's also nice if we
can show the to the user at the terminal so they don't wonder what the
heck happened.
|
|
tet is really built around the notion that all the source, programs, data
and output will all live in a single tree. However, often times the test
programs are built and/or installed in a separate location. This can be
worked around with various environment variables or command line options,
but it would be better to build this behavior in by default.
This introduces TET_EXEC_ROOT, which specifies the base directory for tet
test programs. The tests will be found in the test suite subdirectory of
TET_EXEC_ROOT. E.g., $TET_EXEC_ROOT/xts. The default here is to have
TET_ROOT=$datadir and TET_EXEC_ROOT=$libexecdir.
|
|
|
|
Requiring an environment variable to be set in order to get any behavior
is an obnoxious trait. Instead, a sane default TET_ROOT is built into
the programs that use it. Users such as "make check" that need more
control can continue using the environment variable.
The scripts are now substituted from make so that we get full variable
resolution.
|
|
I'm not sure any of the currently installed tests use the test fonts or
not, but tetexec.cfg at least creates a fontpath for them.
|
|
xts-run is a simple wrapper script to generate a tetexec.cfg and run tcc
with the appropriate arguments.
|
|
|
|
Many of the tests use data files for verifying pixels in images.
|
|
|
|
|
|
|
|
Welcome to the wooorld of tomorrow!
|
|
Before when the display number was set by configure, we wanted to make
sure tetexec.cfg was updated with the Makefile. That's not necessary
anymore.
|
|
Let's use DISPLAY like every other sane X application does, not through a
variable set at configure time.
Signed-off-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Dan Nicholson <dbn.lists@gmail.com>
|
|
'make check' was invoking tcc with each test case to get usable results
back to automake. Since tcc reporting has now been fixed up, we can just
run tcc once with scenario. This is the same way that testing will work
when installed.
|
|
While it would be nice to generate a single tetexec.cfg file for all
hosts, some of the details are runtime specific. Part of the test
process will have to be generating tetexec.cfg from the template.
|
|
In order to keep the scenarios usable in the source tree and while
installed, install the test programs to subdirectories of $(libexecdir)
matching the source tree. This gives, for example,
/usr/libexec/xts5/Xproto/pAllocColor.
|
|
tcc provides the test suite name (xts5) and test case name (e.g.
/Xproto/pAllocColor) to the test program via the environment. The test
program uses this information when outputting the results to stdout.
TET_TSNAME is a new global variable containing the test suite name
provided by tcc. This required a change to the config initialization to
only check if the value was an absolute path when necessary.
TET_TCNAME is a per-test-exec variable providing the test case name as
listed in the scenario file.
|
|
|
|
|
|
|
|
|
|
|
|
|