Conformance Testing

Users can monitor the conformance of tests systems to a specification based on Conformance Suites available in Touchstone.

Prior to Touchstone 5.0.0, users were limited to pre-configured conformance tests in Touchstone. The following Conformance-testing capabilities have been added in Touchstone 5.0.0:

• Organizations (with the appropriate subscription level) can create their own Conformance Suites with custom test groups and test scripts.

• Client (Peer-to-Peer) interactions can be monitored as part of Conformance (in addition to Server interactions).

• Organizations can optionally make their Conformance Suites accessible to members of their Organization only or to members of their Org Group or to everyone.

• Conformance Suites and Results are versioned. This allows organizations to publish their results at any time and continue their testing without affecting published results.

• Suite authors can allows users to publish conformance results or prevent them from doing so.

• Suite authors can have conformance results tracked separately for XML and JSON formats.

• Suite authors can have conformance results tracked separately for supported interactions (in the test system’s capability statement) or disregard the capability statement and include all interactions.

• Conformance Suites
  • Listing
  • Launching Executions
• Current
  • Single Test Group
  • Multi Test Group
• Results Summary
• Publishing Results
• FAQ