formalWARE
project
Participating
Organizations
Research
Topics
People
formalWARE
results
Overview
Publications
Presentation
Tools
Methods
Examples
Training
formalWARE
information
Events
Index
Links
Contacts |
[This page is no longer being maintained. Please visit the resource
page on Testing
at Intrepid Critical Software Inc.
]
What
is System Level Requirements Based Testing?
System level requirements based testing
is typically performed to demonstrate that each of the specified requirements
has been implemented. The tests are derived from the requirements specification
and focus on the system as a whole rather than inputs and outputs of individual
components such as software modules or pieces of hardware.
System level requirements based testing
is another example of using a formal specification of a set of requirements
as input to other tools which partially automate requirements-driven processes.
This is illustrated in formalWARE
by the Ph.D. thesis research of Michael
Donat (UBC Computer Science) on the partially automated generation
of tests from formal specifications.
In addition to investigating the potential
for test case generation from formally specified requirements, an important
contribution of Donat's research is the formal definition of a variety
of different coverage criteria for requirements-based testing.
If you are a software / testing engineer,
items marked  might be of interest to you.
If you are a formal methods researcher,
items marked  might be of interest to you.
formalWARE
material on this topic:
| Publications: |
Michael R. Donat,
A Discipline of Specification-Based Test Derivation, Ph.D. dissertation,
Department of Computer Science, University of British Columbia, expected
October 1998.
Michael R. Donat
and Jeffrey J. Joyce, Applying
an Automated Test Description Tool to Testing Based on System Level Requirements.
INCOSE '98: International Council
on Systems Engineering, July 1998, Vancouver B.C., Canada
Michael R. Donat, “Automatically
Generated Test Frames from an S Specification of Separation Minima for
the North Atlantic Region”. Technical Report 98-04, Department
of Computer Science, University of British Columbia, April 30, 1998.
Michael R. Donat, “Automatically
Generated Test Frames from a Q Specification of ICAO
Flight
Plan Form Instructions”. Technical Report 98-05, Department of
Computer Science, University of British Columbia, April 30, 1998.
Michael R. Donat. Automating
formal specification-based testing. In Michel Bidoit and Max Dauchet,
editors, TAPSOFT '97: Theory and Practice of Software Development, 7th
International Joint Conference CAAP/FASE, volume 1214 of Lecture Notes
in Computer Science, Springer-Verlag, April 1997.
|
| Presentations: |
Test
Generation from System-level Requirements Specifications |
Related
formalWARE topics:
Recommended
reading:
-
Mark R. Blackburn
and Robert D. Busser. T-VEC: A tool for developing critical systems. In
Compass'96: Eleventh Annual Conference on Computer Assurance, pages
237-249, Gaithersburg, Maryland, 1996. National Institute of Standards
and Technology.
Test data generation from a fully modelled
specification.
-
Mark R. Blackburn, Robert
D. Busser, and Joseph S. Fontaine. Automatic generation of test vectors
for SCR-style specifications. In Compass'97: Twelfth Annual Conference
on Computer Assurance, pages 54-67, Gaithersburg, Maryland, 1997. National
Institute of Standards and Technology.
Test data generation from a fully modelled
SCR specification.
-
Robert Büssow
and Matthias Weber. A steam-boiler control specification with statecharts
and Z. In Jean-Raymond Abrial, Egon Börger, and Hans Langmaack, editors,
Formal Methods for Industrial Applications: Specifying and Programming
the Steam Boiler Control, volume 1165 of Lecture Notes in Computer
Science, pages 109-128, October 1996.
An example of a hybrid formal specification
combining statecharts and Z. Such a specification would facilitate the
generation of test sequences.
-
Henning Buus, Robert
McLees, Munir Orgun, Elizabeth Pasztor, and Larry Schultz. 777 flight controls
validation process. IEEE Transactions on Aerospace and Electronic Systems,
33(2), April 1997.
How different types of requirements are
verified.
-
John Joseph Chilenski
and Philip H. Newcomb. Formal specification tools for test coverage analysis.
KBSE'94 Knowledge-Based Software Engineering, pages 59-68, 1994.
Code-based coverage analysis tools.
-
Department of Defense,
Washington D.C. MIL-STD-498 Military Standard, Software Developement
and Documentation, December 1994.
A prominant standards document.
-
Jeremy Dick and Alain
Faivre. Automating the generation and sequencing of test cases from model-based
specifications. In Formal Methods Europe '93, volume 670 of Lecture
Notes in Computer Science, pages 268-284. Springer-Verlag, 1993.
A disjunctive normal form approach to automating
test generation.
-
Steffen Helke, Thomas
Neustupny, and Thomas Santen. Automating test case generation from Z specifications
with Isabelle. In Jonathan Bowen, Mike Hinchey, and David Till, editors,
ZUM'97: The Z Formal Specification Notation, 10th International Conference
of Z Users, volume 1212 of Lecture Notes in Computer Science.
Springer-Verlag, April 1997.
Demonstrating the application of theorem
proving technology to test generation.
-
C.B. Jones. Systematic Software Development
Using VDM (2nd edition). Prentice Hall, 1990.
A method of formal specification.
-
Brian Marick. The
Craft of Software Testing. Prentice Hall, Englewood Cliffs, NJ, 1995.
Practical insights into the problems of
generating appropriate tests.
-
Christian P. Schinagl.
VDM specification of the steam-boiler control using RSL notation. In Jean-Raymond
Abrial, Egon Börger, and Hans Langmaack, editors, Formal Methods
for Industrial Applications: Specifying and Programming the Steam Boiler
Control, volume 1165 of Lecture Notes in Computer Science, pages
428-452, October 1996.
An example of a Z specification. A
translated version of this example was used to generate tests using
Donat's TCG tool.
-
J. Michael Spivey.
Understanding Z: A Specification language and its formal semantics.
Cambridge University Press, 1988.
A formal specification language.
-
Elaine Weyuker, Tarak
Goradia, and Ashutosh Singh. Automatically generating test data from a
boolean specification. IEEE Transactions on Software Engineering,
20(5):353-363, May 1994.
Another disjunctive normal form based approach
to test data generation from a fully modelled specification.
-
Kalman Toth, Jeffrey
J. Joyce, and Michael R. Donat. Generating test
cases from formal specifications. In 6th Annual Symposium of the
International Council on Systems Engineering, INCOSE,
July 1996.
This paper provided the inspiration for
Donat's thesis research.
Recommended
websites:
|
