Learning toolsProgress & bookmarks
Current section
1-1-5 System Qualification Testing Process
p. 241
Progress
Not marked complete
p. 241 · PDF 245
1-1-5 System Qualification Testing Process
The system qualification testing process ensures that the system is ready for delivery by testing the compliance of implementation for each system requirement.
[Activities of system qualification testing process] (i) System qualification testing
(1) System qualification testing
In system qualification testing, seven tasks are performed.
(i) Implementation of system qualification testing
System qualification testing is conducted in accordance with the qualification requirements specified for the system in the system requirements definition. It is ensured that the implementation of each system requirement is tested for compliance and that the system is ready for delivery. The qualification test
p. 242 · PDF 246
results are documented in a system qualification testing report. (ii) System evaluation
The results of system qualification testing are evaluated, with consideration given to the criteria of test coverage of system requirements, conformance to expected results, feasibility of operation and maintenance, and appropriateness of the test methods and standards used. If the result of evaluation reveals areas that do not fulfill system requirements, tuning is conducted and documentation is updated, as required. (iii) Implementation of joint review of system qualification testing
A joint review by the development department (i.e., supplier) and stakeholders (i.e., acquirer) is implemented, and agreement is obtained concerning system qualification testing. (iv) Updating user documentation User documentation is updated as required, including corrections to operation manuals. When system operators update user documentation, the necessary information is to be provided to the system operators. (v) Support for audits
Audit refers to independent evaluation to assure that selected deliverables and processes conform to the corresponding requirements, plans, and agreements. In support for audits, the audit activities are supported, and the audit results are documented. (vi) Preparation of deliverable systems
Deliverable systems are updated and prepared for the process of supporting system installation and system acceptance. (vii) Preparation of systems to be taken over in operation and maintenance
From the created deliverables, deliverables to be taken over in operation and maintenance are organized and prepared.
In system qualification testing, whether the system has been achieved (i.e., implemented) according to system requirements is verified through testing listed below.
| Name of Test | Content of Testing |
|---|---|
| Functional test (Functional requirement test) | Verifies whether functions defined in system requirements (functional requirements) are fulfilled, by using data used in business operations. |
| Non-functional requirement test | Verifies whether non-functional requirements other than functional requirements of the system (i.e., software) are fulfilled. |
p. 243 · PDF 247
| Performance test | Verifies whether performance requirements (e.g., response time, throughput) defined in system requirements are fulfilled. |
|---|---|
| Load test (Stress test) | Increases the volume of processed data or the number of programs executed simultaneously, in order to verify the maximum processable data volume or continuous operable time. |
| Security test | Verifies that security requirements defined in system requirements are fulfilled. In order to intentionally find issues of a security breach, verify strength against unauthorized access. Tests including penetration testing are performed. |
| Exception test | Verifies that appropriate operation (e.g., error processing) is performed, by using data that would be processed as exceptions in business operations. |
| Regression test | Verifies whether modifications to the system because of specification changes or others have impacts on non-modified portions of the system. In general, this is conducted in operation/maintenance. |
Section progress
Original chapter exercises
Original chapter exercises →New FE Textbook Vol.2 · First Edition, April 2015