1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
|
.\"
.\"Copyright (c) 2005 X.Org Foundation L.L.C.
.\"
.\"Permission is hereby granted, free of charge, to any person obtaining a copy of
.\"this software and associated documentation files (the "Software"), to deal in
.\"the Software without restriction, including without limitation the rights to
.\"use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies
.\"of the Software, and to permit persons to whom the Software is furnished to do
.\"so, subject to the following conditions:
.\"
.\"The above copyright notice and this permission notice shall be included in all
.\"copies or substantial portions of the Software.
.\"
.\"THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
.\"IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
.\"FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
.\"AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
.\"LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
.\"OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
.\"SOFTWARE.
.\"
.\"Copyright (c) 1994, 1995 Applied Testing and Technology, Inc.
.\"All rights reserved
.TH vswrptm "1" "November 1999" "The Open Group" "VSW5"
.SH NAME
vswrptm \- Report Comparison Generator for the VSW5 Test Suite
.SH SYNOPSIS
.in +10n
.ti -10n
\fBvswrptm\fR
[
.B -a
] [
.B -f
] [
.B -h
] [
.B -s
.I section
] [
.B -t
.I test_case
] [
.B -u
] [
.B -v
]
.I journal1 journal2
[
.I journal3
] [
.I journal4
] [
.I journal5
] [
.I journal6
]
.SH DESCRIPTION
\fRThe VSW5 Report Comparison Generator (vswrptm) produces a
report comparing the Test Purpose results from two to six Test Environment
Toolkit (TET) journal files produced from runs of VSW5.
The report is written to stdout.
.PP
vswrptm employs the standard TET journal information along with additional
information provided by the Test Suite via the scenario file and the tests
themselves. This data provides the names of Test Suite Sections and Test Cases
as well as invariant Test Purpose numbering to allow vswrptm to detect
missing Test Cases or Purposes.
.PP
The journal files given to vswrptm must be the result of a tcc command which
includes the -e option. The -b and/or -c options may also have been used.
vswrptm cannot be used on journal files which do not contain the additional
information provided by VSW5.
.SH OPTIONS
.TP 5
.B Detail and Scope
.PP
vswrptm always produces a summary report of the results of the test runs in
the input journals. By default it also reports the results for all Test
Purposes for which the results are not the same in each journal.
Five options provide the ability to alter this later information.
.TP 5
.B -a
Show results for all Test Purposes, not just variations.
.P
.TP 5
.B -f
Show results for Test Purposes where a failure is present as well as variations.
.P
.TP 5
.B -u
Show results for Test Purposes where UNINITIATED results are present as well as variations.
.TP 5
.B -t test_case
.PP
.in +5
Report results only for the Test Case
.I test_case.
.PP
.TP 5
.B -s section
.PP
.in +5
Report results only for the Test Suite Section
.I section.
.PP
.B Other Options
.PP
.TP 10
.B -h
Display usage information.
.TP 10
.B -v
Display program version.
.PP
.SH FIP RESULTS
\fRA Further Information Provided (FIP) result code indicates that manual
analysis is required to resolve an anomaly. In some cases FIP results
are generated by Test Purposes themselves but primarily they are
produced during report generation. If compiler warnings are present in a
journal for the build phase of a test suite file and the result of a
Test Purpose in that file would otherwise be PASS vswrptm changes the
result to FIP. This indicates the compiler warnings must be manually
examined and either corrected or justified.
.PP
.SH UNINITIATED RESULTS
\fRAn UNINITIATED result code indicate that a Test Purpose was not
executed, usually due to a compiler error during the build phase.
vswrptm is aware of which Test Purposes are executed and will report
result of UNINITIATED for each Test Purpose which is not run. This
indicates that the compiler error should be corrected and the test
re-run.
.PP
.SH REPORT FORMATS
\fRThe summary report produced by vswrptm
provides a summary of the result codes reported by the Test Purposes in
each journal file.
.PP
Result from Test Purposes are output in columnar form.
.PP
.SH ERRORS
vswrptm will print an error and usage message to stderr if illegal options
are specified. No report is generated.
.PP
vswrptm will print an error message to stderr if format errors are encountered
in the journal file. No report is generated.
.SH SEE ALSO
.PP
vswrpt
.PP
Copyright (c) 1994-1997 Applied Testing and Technology, Inc.
|
