Touchstone¶
TS 6.2.2 – September 16, 2024
Enhancements
Enhanced the Touchstone validators updated to HL7 FHIR Core Library v6.3.19
Enhanced the WildFHIR application dependency updated to HL7 FHIR Core Library v6.3.19
Enhanced the Touchstone validators to allow for the new FHIR Extensions IG package upload
Updated the Touchstone validation messages to be prefixed with the source that generated the message
Updated the WildFHIR client administrative interface for configuration setting maintenance
Enhanced the FHIRPathEngine ‘ofType’ and ‘as’ functions updated to handle conversions between date, dateTime and instant data types
Updated the Touchstone validation package upload issues to now display in the IG Validation Packages UI
Bug Fixes
Corrected the FHIRPathEngine to properly follow the defined regex to limit the time milliseconds to 3 digits
Corrected the validators to make validation terminology errors for unknown code systems reduce to warning messages
Corrected the WildFHIR date search parameter logic updated to properly handle date and period range comparisons
Corrected the WildFHIR numeric search parameters to accept decimal values
TS 6.2.1 – January 23, 2024
Update Subscription page to reflect 2024 Subscription and Commercial pricing.
Bug Fixes
Terminology server errors for an unknown code system are now preserved and generates a validator warning message.
TS 6.2.0 – December 18, 2023
Enhancements
Implemented a proof of concept (POC) of HL7 Version 2 and HL7 Version 3 testing capabilities. Look for more details in upcoming releases.
Touchstone Testing IG v2.0.0 released with support for HL7 V2 and V3
Enhanced the WildFHIR servers to support the use of the fhirVersion mime type attribute
Enhanced the WildFHIR servers to recognize the FHIR version in the Accept Header and return an OperationOutcome if it doesn’t match FHIR version of the WildFHIR instance being tested
Bug Fixes
Corrected Touchstone to honor a trailing forward slash ‘/’ in endpoint URLs
Corrected Touchstone to honor encodeRequestURL setting in Peer-To-Peer testing
Corrected Touchstone to allow users to access Test Setups when the list was empty or searched for a Test Setup that did not exist
Corrected Touchstone to allow test executions in a ‘Waiting’ state to be stopped if the related TestScript has been removed
Corrected Touchstone validation logic to correct duplicate CodeableConcept sub-elements when evaluating profile slicing
Corrected Touchstone terminology code validation error response handling when code not found in a value set
Corrected Touchstone FHIR 3.0.2 FHIRPathEngine ‘replace()’ method to focus element reference
Corrected Touchstone FHIR 4.0.1 FHIRPathEngine ‘dateTime’ equivalency when comparing two dateTime values without time zone information
Corrected Touchstone FHIR 4.0.1 FHIRPathEngine ‘exists()’ method to correctly handle arguments
TS 6.1.1 – August 16, 2023
Bug Fixes
Corrected Touchstone to no longer attempt to use Test System’s authorization when requesting metadata.
Corrected the Whitelist FAQ in Touchstone documentation.
TS 6.1.0 – June 27, 2023
Enhancements
Moved the CDSHSandbox folder to the top of the list of Test definitions.
Per recent FHIR Terminology Server (tx.fhir.org) update to change the incorrect code display warning messages to error message, the Touchstone Validators have been modified to reset these error messages back to warning messages.
Bug Fixes
Corrected Touchstone to always run and display asserts in the order that they appear in the TestScript.
Corrected encoding the hash (#) value in test executions when TestScript operations request encoding.
Corrected hover text for CDSHooks Test Systems.
Corrected pulling of CDS Services statements for Test Systems that do not yet have one associated to the Test System setup at test execution.
Corrected error text when CDSHooks Test System CDS Services do not support the hooks being tested.
TS 6.0.0 – May 1, 2023
Enhancements
The HL7-FHIR and CDS Hooks domains have been merged, allowing users to have FHIR Tests and CDS-Hooks Tests execute in a single Test Execution, as well as create and run TestScripts with both HL7 FHIR and CDS Hooks operations in the same TestScript or test execution. This enhancement removes the need for the user to specify a “Domain” in Touchstone.
Implemented support for Order-Dispatch hook for CDS Hooks.
Provide a read-only view to the Implementation Guide (IG) Packages loaded into the public Validators.
Test Definitions page updated to display the full qualified Test Definition path selected at the top of the page and then each TestScript display the path after the selected root folder.
Test Executions page updated to display the assert.description, assert.label, and operation.label when specified in the TestScript.
Created WildFHIR instances to support CDS Hooks JWT backend authentication for both RS384 and ES384 signing algorithms.
WildFHIR updated to FHIR R4 support of CDS Hooks order-select and order-sign hooks.
Implemented validation support for toDate(), toDateTime() and toTime()
Updated Rule Outputs documentation to provide additional guidance.
FHIR validator modification to allow for valid base64 encoded contents in payload.
Bug Fixes
Corrected Conformance Suite behavior so that when certain variables like “${CURRENTDATE}” are used in TestScripts, they render properly in the Suite.
Conformance Results Summary screen corrected to allow selection of any previous Conformance Suite.
Corrected CDS-Hooks JWT Assertion to use the CDS Hooks defined interaction when testing with CDS-Hooks systems (see https://cds-hooks.org/specification/current/#security-and-safety).
Corrected TestScript upload and execution errors when an operation defined uses a rule output as a sourceid (fixture) in a test.
Corrected WildFHIR implementation of: global search parameters in chained search parameters, Bundle fullURL values when _include used, the ‘or’ of ‘less than or equals’ and ‘greater than or equals’ conditions.
Corrected validation logic to: Bundle searchset validation of self link to handle search results from extended ‘$’ operations, appropriately ignore TestScript ${variable} declarations, correctly handle extension context.
Notes
There is a known issue impacting CDS Hooks security enabled Test Systems. Touchstone is not able to automatically download the Services Statement for a secured CDS Hooks Test System.
Symptom: The user will get a TestScript execution failure with an error “Capability Statement is required in CDS-Hooks testing. Please download it on the Test System screen.”
Fix to be implemented in subsequent release: Touchstone will be corrected to appropriately download the Services Statement of a secured CDS Hooks Test System.
Workaround: The user can manually upload the Services Statement via the Test System screen using the Upload hyperlink.
TS 5.9.1 – February 2, 2023
Bug Fixes
Corrected Touchstone parsing of external client request URL to extract the path components - scheme, host, port, path and query - when period characters are present in the path
Corrected Touchstone to include PKCE flow elements in the Authorization Request when testing non-OAuth TestScripts against a PKCE-Enabled Test System
Corrected Touchstone logic validating OAuth2 Scopes when the requested and/or supported scopes contain wildcards
TS 5.9.0 - December 9, 2022
Enhancements
Updated Test System to allow support for PKCE
NOTE: Specific coding will be required in any TestScript executed against a Test System that is defined with PKCE enabled. Please reference the online Docs for the specifics of what will need to be added to the TestScript(s): (Touchstone Docs PKCE guidence)
Bug Fixes
Corrected logic when Touchstone performs Oauth Scope comparison where wildcards were used in the scope settings
Corrected Conformance Suite behavior to properly recognize all TestScripts when TestScripts are added to a suite folder via the Touchstone IDE
Corrected Vaidator logic when verifying code values against ValueSets that include ValueSet(s) either as a union or an interaction
Corrected Validator comparison precision handling of fixed date and datetime values
Corrected WildFHIR processing of conditional create and update search logic to account for the possibility of a returned OperationOutcome in the internal search results
Corrected WildFHIR search operation with datetime comparison involving time zone
Corrected WildFHIR operations that return Bundles to populate the Bundle.entry.fullUrl with the full web context path
Corrected WildFHIR search operation results with multiple sort values
Corrected WildFHIR search operation query logic for date typed search parameters when the search parameter’s corresponding element is defined as a polymorphic typed element with potential date and period data types
Corrected WildFHIR search operation query logic to perform exact matching with reference data type values
TS 5.8.0 - November 4, 2022
Enhancements
Updated the MinimumId logic used by Touchstone to match out of order elements (in non-arrays) and to allow for extra element in arrays while preserving array order. TestScripts that previously used MinimumId logic may need to be updated to properly utilize new MinimumId logic
Enhanced Touchstone to do additional pre-parsing of TestScripts at upload to capture and return any non-XML schema conformant elements
Enhanced Touchstone Peer-to-Peer TestScript matching process to more accurately match incoming messages to the correct waiting test
Enhanced Touchstone registration to allow users change the primary email address associated to their user registration and to have an alternate email address that can receive automated emails from Touchstone in addition to their primary email address
Updated Conformance Suites to allow a Test Group to be associated to an unlimited number of Conformance Suites
Updated the AEGIS Validators to utilize the updated FHIR Java Core Library (based on HL7 Core Library v5.6.xx). Slight changes in validation messages and validation logic should be expected
As part of the AEGIS Validator FHIR Java Core Library updates, enhanced Touchstone to properly ignore primitive values containing Testing Platform variable declarations using the ${} delimiters
Enhanced AEGIS Validator behavior to relax Warning messages to become Informational messages when evaluating referenced resources against ElementDefinitions with multiple targetProfile values where the referenced resource conforms to at least one of the targetProfile entries
As part of the AEGIS Validator FHIR Java Core Library updates, enhanced Touchstone to properly validate conditional profile definitions on Bulk Data TestScripts
Enhanced the AEGIS Validator logic allow for a configured selection of which SNOMED-CT code system specific edition of FHIR terminology server is used in validation
As part of the AEGIS Validator FHIR Java Core Library updates, enhanced the AEGIS WildFHIR instances to utilize the updated validators
Bug Fixes
Corrected Touchstone user registration to not allow identical email addresses to be used across multiple registrations
Corrected Conformance Suites Interactions table totals and progress bars to correctly match the conformance results
Corrected MinimumId logic to correctly process single quotes in XML payload comparisons
Corrected Conformance Results Summary screen to default to version=All on initial display
Corrected Conformance Suites to only show active Test Groups in the Test Group selection drop-downs
Corrected the informational message text to be more clear when a user deletes a Test System Setup
Corrected the Test System Setup screen to properly display the correct data entry fields when users switch between Oauth Token Types
Corrected Touchstone to leave the user on the Test Setup screen to allow them to make a correction when the Test Setup name is in error
Corrected display of User names when navigating between User pages
Corrected logic and error messaging for fixture variables that do not populate at Testscript upload
Corrected the WildFHIR server operation response to correctly populate the Bundle.entry.fullUrl of any additonally returned resources
TS 5.7.0 - April 22, 2022
Enhancements
Subscription page updated to include hover over text for all features and provide additional feature information
Increased the Base URL length on the New Test System and Edit Test System screens from 128 to 512 characters
Increased Touchstone session inactivity timeout duration to 30 minutes
Enhanced validation in the check special code systems logic to allow for ValueSets that reference other ValueSets
Login process now allows user to login with the email used during registration or a Touchstone generated login based on user name provided during registration. Touchstone generated loginIDs can be found on the User Settings page
Enhanced HL7 Core Library validator logic to not cache error messages received from a terminology server enabling validation to proceed when there is a communication issue with a terminology server
Updated the automated email text received when Subscription levels change to notify the user to logout and login to see the Subscription updates applied to their user experience
Bug Fixes
Corrected exception error encountered on peer to peer testing when ifSupported() executed
Running tests from Conformance screen no longer requires variables from non-selected tests
Test Execution no longer uses static authorization headers from previous configurations of the Test System
Touchstone now allows user to utilize “Execute Again” functionality when a Test Setup fixture name has been changed
Corrected FHIRPath evaluation errors related to the prioritization of “and”/”in” operators
Touchstone now ignores search Bundle entries containing an OperationOutcome or with a search.mode = ‘outcome’ when doing Smart Deletes in Testscript Setup and Teardown operations
Corrected Conformance Suites starburst graphic to show orange when tests passed with warnings
Corrected Conformance Suites starbursts to display correct interactions totals for Pass/Warn when hovering over the main starburst
Corrected state parameter size for OAuth2 Dynamic testing in Conformance Suite execution to match the 100 byte state parameter size in Test Setup execution
Corrected sorting issue in Conformance Suites which was causing unexpected results as test were not run in the correct order
Updated validator logic to correctly handle timezones when comparing date and timestamp precision values
Updated validator logic to correctly handle required bindings for Codeable Concept type elements to ensure that the rules for them are being evaluated correctly:
at least one Coding element SHALL be present
one of the Coding values SHALL be from the specified value set
text can be provided as well, and is always recommended, but is not an acceptable substitute for the required code
Corrected hover-over text on CapabilityStatement on Test System Configuration to remove references to month and year
Corrected Touchstone landing page URLs for the Developer’s Integration Lab and the AEGIS.net main website so that they directed users to the proper website
TS 5.6.0 - December 10, 2021
Enhancements
Enhanced test execution warning status display in UI to represent Passed with Warnings as orange in the status bar, include the count of the warnings in the test count summary, and the execution status will represent Passed with Warnings rather than just Passed when there are warnings
Enhanced navigation in Test Executions with more intuitive hyperlinks and expansions
Enhanced extractScopesNotGranted() to accept and process a context wildcard
Implemented FHIRPath $index token support
Updated Touchstone Testing Implementation Guide for the TestScript profile to include ‘history-instance’, ‘history-type’, and ‘history-system’ operations in FHIRPath expression
Implemented support for history-instance, history-type and history-system
Enhanced Validator to data drive the terminology server used during validation
Enhanced Validator to handle slicing definitions with single and multiple discriminators
Enhanced Validator timezone processing when comparing date and timestamp precision values
Added functionality to secured version of WildFHIR to allow page caching
Added Touchstone IPs for Whitelist to documentation
Bug Fixes
Added check and warning message to prevent user from uploading a TestScript with the same name but a different extension
Public Test System no longer requires client secret to be specified
Fixed “Execute Again” populating incorrect Destination Server
Resolved issue with auto-pagination incorrectly applying encoding a second time
Resolved duplicate Authorization Header caused by auto-pagination
Added logic to prevent test setup execution when no destination specified
Corrected Touchstone to recognize json extension at test execution
Implemented validation to prevent a user from executing a test mid-load
Resolved caching errors caused by unavailable HL7 terminology server
TS 5.5.0 - October 8, 2021
Enhancements
Added ‘nonce’ and ‘response_mode’ parameters
Added ability to manually upload Capability Statement
Validator now returns as much of the response as it has validated within the timeout period instead of just returning an error
Developed extension to support TestSetup Dynamic Fixture such that a user can enter their own fixture at test setup time
Enhanced Touchstone to allow testing of peer to peer secure systems (OAuth Clients and Servers)
Added support for history operation, described in Touchstone Testing IG
Allow organizations to create Test Systems with the same IP address and/or base URL within Touchstone
Bug Fixes
Unsupported Validators are no longer displayed on User Admin ‘Validator’ selection box
Updated the Error message thrown when failing a test setup
Adjusted heirarchy of importance so that “Skipped” is not displayed over “Passed” or “Passed+W”
Resolved Unexpected error in Conformance Suite when Toggle to XML is selected
Fixed Incorrect Handling of Placeholders in requestHeader
Corrected exception thrown when duplicate tests are run in a Conformance Suite
Conformance Suites - Passed with “W” now showing at ‘Current’ view
Conformance Suite Published result for a previous suite version is now viewable
Correction to the resolution of references with Bundle entry nesting so that those references are correctly attributed to their respective Bundles
Validator now recognizes when Code System Content Mode is “Example” the validation can be performed internally and a call to the terminology server for validation is no longer made
Validator no longer restricts refererence types in standalone validation
Validator with FHIR Path Engine funcResolve method now accounts for local references within a Bundle
Updated validator to provide more precise error text when a non-existent code system validation error is encountered
The validation engine honors the warningOnly = ‘true’ setting even when there is a Touchstone-related error present
TS 5.4.0 - July 9, 2021
Enhancements
Touchstone API enhanced to allow passing of a static OAuth token in test execution call
Automated the Authorization grant flow Oauth login for use via TS API
Added support for slicing by pattern for FHIR Primitive Data Types
Updated the slice match by pattern logic to be more lenient when pattern value does not define extension(s)
Added a pop up message to the “Join Org Group” functionality to provide explanation of test execution visibility
In support of pagination, the Touchstone Testing Implementation Guide was updated to add new TestScript Extension for operation pagesNext
Updated WildFHIR capability statement to include support for $document operation
Increased the Validator & Touchstone timeout thresholds
Bug Fixes
Addressed drop down sort order to be case insensitive
Addressed issues with result sets being too large for Touchstone
Addressed null pointer references
Addressed pull failure on Capability Statement
Addressed issue with Validator giving warnings when code values were in the required valueset
TS 5.3.0 - March 26, 2021
Enhancements
Populate Variables for multiple tests with a single input
Allow Conformance Suites to be set as ‘Inactive’
Increased Validator timeout parameter
Increased Rule timeout parameter
Added filter “waiting for auth” in testscript history
Bug Fixes
Touchstone doesn’t support _include and _revInclude
Adding IGV Upload Roles & Validators gives Error
Smart Config not persisted in Test Systems definition
Some TestScripts unable to be seen on the Conformance page
Static Token in Test Systems & Test Setup functionality broken
TS 5.2.3 - February 26, 2021
Maintenance to Subscription Page
TS 5.2.2 - February 15, 2021
Enhancements
Security settings, DH key size key size must be able to accommodate larger key size of 8192
Need rule-accessible operation to read restful links
Bug Fixes
Get ‘phantom’ Test System Proxy Port has Changed error when certain errors occur in Test Execution
SourceId declarations in rule asserts not working
Smart Config unavailable for some testscripts in some circumstances
Validation slicing logic now accounts for Extension slicing where the extension contains a coded value
Validator no longer issues Fatal error when ill-formed element is found
Validator no longer locks up in an Uploading state when it runs into conformance artifacts that cannot be parsed
Validator resolved “ERROR: This element does not match any known slice for profile” encountered when running CARIN Validation Tests
Validator giving invalid Warning - “Expansion not defined” when valid values for a valueset are present
TS 5.2.1 - January 11, 2021
Enhancement
Conformance Suite Description allows for up to 1,000 characters
Bug Fixes
Conformance Suite Org Group visibility does not save properly - includes ALL org groups
Test Setup List is loading blank pages
Test Systems that have been deleted are stopping Orgs from building a new Test System with the same base url
Getting ‘value was null’ for SpecEnum error on validation when capability FHIR version is not supported for server
Oauth2 operations not showing up on Categorizations
TS 5.2.0 - December 14, 2020
Enhancements
FHIR® Bulk Data Access (Flat FHIR) and SMART Backend Services Support
Support for testing of SMART Backend Services conformance
Updates to Test System Setup to allow for JWT Assertion and details for registering Touchstone to a SMART Backend Service
Support for testing of Bulk Data, including validation of ndjson file contents
Updates to the Touchstone Testing IG to aid in Bulk Data ndjson file content validation - https://touchstone.aegis.net/touchstone/fhir/testing/history.html
Enhancement to allow for Invalid Handshake Security Testing
Allows for test launching for invalid handshake testing that does NOT expect a return
New ‘manual pass’ test button for visual inspection and passing of tests
Enhancement to increase the Touchstone Validator runtime timeout to 90 seconds, allowing for large or complex validations to complete
Bug Fixes
FHIRPath exists(criteria : expression) support corrected
Slicing logic correction; added logic to slice matches for discriminator of type ‘type’ when multiple types are defined
Correct UTF8 encoded character handling
Message Bundle reverse references validated properly
‘Test System Proxy Port has Changed’ error when proxy port has not actually changed is no longer displayed on Test Execution results
TS 5.1.0 - October 29, 2020
Enhancements
OAuth2 and SMART-on-FHIR Support Test Support
Dynamic authorization for both the OAuth2 Authorization Code and the Client Credentials flows
Dynamic retrieval of Smart Configuration from SMART-enabled test systems in Touchstone
Test Support for SMART-on-FHIR Discovery, OpenID Connect (OIDC)
Ability to perform Stand-Alone Launch and EHR-Launch testing
Enhanced TestScript Authoring to include OAuth2 capabilities (Refer to the Touchstone IG)
OAuth2 authorizations support in explicit form via new TestScript operations: oauth2-authorize, oauth2-get-token, oauth2-refresh-token, and oauth2-revoke-token
Enhancement to allow for Assertion-Only Tests
Enhancement to allow Tests to continue when Test Assertions fail
New FHIR4-0-1-Security test scripts to support SMART-on-FHIR testing
New section in TestScript Authoring Guide that describes the OAuth2 functionality
TS 5.0.0 - June 26, 2020
Enhancements
Multi-Profile Validator
Enabling testing against an existing profile and a newer version of that profile for the same FHIR version.
Touchstone will allow for different validators to exist for a FHIR Version, be associated to a TestScript at upload, be selected for a test setup at runtime.
Users with appropriate authority will be able to upload IG Validation Packages, upload testscripts and associate them to one or more validator packages.
Please refer to Multi-Profile Testing for more information.
Conformance Suites
Enabling organizations to build their own certification program and easily see results of systems who test against it.
Conformance Suites can be defined by an organization, can include only the tests needed for certification, can automatically build conformance reports.
Conformance Suites are versioned so that organizations can know which version of the suite they tested against and so that an organization knows which version of the suite organizations are certified against.
Users can see and select the Conformance Suite they want to certify against.
Testers and Organizations can easily and instantly see conformance in both a graphical and tabular view.
Please refer to Conformance Testing and Conformance Suite Authoring for more information.
TS 4.7.4 - Nov 8, 2019
Bug Fixes
Request URL assertion fails when request parameter contains multiple values for a given parameter with the AND condition.
Touchstone does not allow POST requests without a request body.
Some special characters (e.g. ‘/’ and ‘+’) are not being encoded in request query parameters.
HTML entity references get resolved in request URLs on Test Script Execution screen. This makes it difficult to compare what was submitted to what was expected in Peer-to-Peer tests.
TS 4.7.3 - Sept 6, 2019
Enhancement
Add support for FHIR Connectathon 22 in Analytics/Conformance.
TS 4.7.2 - August 30, 2019
Bug Fixes
Presence of “_format” parameter on its own in Peer-to-Peer request causes test failure.
Touchstone appends forward slash (‘/’) to request URLs before query parameters.
User gets error when accessing Org Groups page before logging in.
TS 4.7.1 - August 05, 2019
Bug Fixes
Peer-to-Peer ‘requestURL’ assertion is not performing exact match on URL path.
Peer-to-Peer ‘requestURL’ assertion fails when query parameter contains multiple values in different order from actual request.
TS 4.7.0 - July 29, 2019
Enhancements
Improve the performance of Groovy rule assertions in Rules Engine.
Inform user of incorrect proxy port in submitted URL in peer-to-peer testing.
Security Improvements.
Bug Fix
User gets ‘Unexpected error’ if Test Setup is executed without waiting for page to completely load.
TS 4.6.1 - July 01, 2019
Bug Fixes
Users are blocked from using the same Origin IP address for IP-only peer-to-peer testing at the Connectathon.
Two users within the same organization that have marked their client test systems for IP-matching are not prevented from launching test execution at the same time in peer-to-peer testing even when the test systems share the same IP address.
Touchstone does not inform user on Test Script Execution screen if proxy port of a destination test system changed after the execution was launched in peer-to-peer testing.
Touchstone inserts request URL assertion for peer-to-peer tests even when resource id in URL is dynamically generated on client test system in peer-to-peer testing. This assertion will always fail.
Previous user agreement version getting displayed to user even after its updated in database.
Navigating to a page on Test systems list screen throws error if first test system name on list has unencoded special characters.
Touchstone is not evaluating variables in assertion FHIR expressions.
TS 4.6.0 - May 29, 2019
Enhancements
Improve support for IP-only Peer-to-Peer testing. Refer to Peer-to-Peer Testing for details.
TS 4.5.1 - May 24, 2019
Bug Fix
User getting security violation if multiple browser tabs are used to sign into Touchstone.
TS 4.5.0 - May 23, 2019
Enhancements
Add support for CORS in Touchstone API.
Remove Touchstone-specific USER_KEY and ORG_KEY headers before forwarding request to destination server in Peer-to-Peer exchanges.
Add warning message on Test Setup when Test System specification does not match Test Definition specification.
Security improvements.
Bug Fix
Touchstone sends POST to Bundle endpoint instead of Base for batch operations.
TS 4.4.6 - May 05, 2019
Bug Fix
Test Definition upload allows ‘Viewable By’ access to get widened for child test groups via Org Groups.
TS 4.4.5 - Apr 02, 2019
Enhancement
Support for FHIR 4.0.0 testing in FHIR Connectathon 21.
TS 4.4.4 - Mar 21, 2019
Bug Fix
User getting error when attempting to access expected request message in peer-to-peer test.
TS 4.4.3 - Mar 21, 2019
Bug Fixes
User getting error when attempting to download the Touchstone IDE.
Email notifications being sent without subject line.
Request URL assertion should work with or without forward slash before query string.
TS 4.4.2 - Mar 18, 2019
Bug Fix
User getting error when attempting to edit a Test Group.
TS 4.4.1 - Mar 17, 2019
Bug Fix
User getting error when attempting to delete Test Setup.
Clicking on ‘CapabStmt’ link on Analytics/Conformance or Published screens throws error.
TS 4.4.0 - Mar 13, 2019
Enhancements
Validate email authenticity for new user registrations.
Automatically stop test executions that have been in Waiting status for long period of time.
Security improvements.
TS 4.3.6 - Mar 03, 2019
Bug Fixes
Org Reps that are also Org Group Reps cannot assign the Test Editor role to an org user.
Paging to last page on Exchanges screen can produce UI error if more exchanges took place during the request.
TS 4.3.5 - Feb 06, 2019
Bug Fix
Exchange attributes not getting resolved correctly for test systems that have been deleted and recreated.
TS 4.3.4 - Jan 25, 2019
Bug Fixes
Navigation to resolved rule contents within an assertion on “Test Script Execution” screen causes unexpected error.
Navigation to test setup that had destination missing causes unexpected error.
TS 4.3.3 - Jan 15, 2019
Bug Fix
Navigation to previous Test Setup throws error if Test System used in the setup got deleted and one or more test scripts in the setup used variables.
TS 4.3.2 - Jan 14, 2019
Enhancement
Avoid appending default ports (80 for HTTP and 443 for HTTPS) for ‘Host’ header in Peer-to-Peer requests.
Bug Fix
Test Script Execution and Exchanges screens reporting incorrect ‘Host’ header in Peer-to-Peer requests.
TS 4.3.1 - Jan 10, 2019
Bug Fixes
Edit Test System screen redirects user to Sign-In screen with error when test system name is changed to a deleted test system name within the organization.
When Test Script Execution and its resource screens are accessed without signing in, the user is not redirected to those screens after signing in.
TS 4.3.0 - Jan 9, 2019
Enhancements
Support for FHIR 4.0.0. See http://www.hl7.org/fhir/directory.cfml and http://hl7.org/fhir/R4.
Allow test script authors to deactivate test groups to reduce clutter on Test Definitions tree.
Resolve placeholders in variable default value during test setup.
Offer explicit Approve and Reject buttons for membership requests on “Edit Privileges” screen.
Support for HTTP Method in Test Script operation. See http://build.fhir.org/testscript-definitions.html#TestScript.setup.action.operation.method
Security improvements.
Section 508 improvements on Subscriptions screen.
Bug Fix
User gets error when Test Script or Fixture links are accessed from Test Script Execution and newer versions of the resources have restricted access.
TS 4.2.2 - Dec 26, 2018
Bug Fixes
Request URL assertion fails in Peer-to-Peer tests when ‘_format’ parameter is present.
Operation counts are miscalculated on TestScript Execution screen when request assertion fails in Peer-to-Peer testscripts.
TS 4.2.1 - Dec 16, 2018
Bug Fix
Users can bypass duplicate hostname checks on Edit Test System screen by deleting and recreating a test system.
TS 4.2.0 - Nov 26, 2018
Enhancements
Add support for exclusions of test definitions during upload, parsing, and validations. Refer to Docs for details.
Improved support for CDS-Hooks testing.
Section 508 improvements on Test Setup and Test Execution screens.
Bug Fixes
FHIR profile validation fails in CDSH domain when invoked from Groovy rules.
Conditional delete should not require Bundle.total on internal search response.
TS 4.1.0 - Oct 18, 2018
Enhancements
Add support for HTTPS in Touchstone Proxy for SSL/TLS peer-to-peer exchanges.
Support relative ‘DATE’ and ‘DATETIME’ placeholder in fixtures, request payloads, and URLs.
Allow INVALID floater (that displays testscript and fixture validation errors) to stick so user can copy the messages.
Break up validation error and warning messages into separate line items on Test Script Execution screen.
Support Media types (MIME types) in TestScript operation ‘accept’ and ‘contentType’ elements.
Redirect legacy TS Release Notes URL to new HTML version URL.
TS 4.0.2 - Sep 28, 2018
Bug Fixes
Error message on Exchanges screen is misleading when submitted USER_KEY is incorrect.
Rules Engine does not handle a capability statement with an invalid FHIR spec version.
TS 4.0.1 - Sep 26, 2018
Bug Fixes
Upload of sub groups removes other sub groups from Analytics/Conformance screen in non-Sandbox test groups.
Analytics/Conformance screen errors if user’s organization has not created any test systems.
TS 4.0.0 - Sep 24, 2018
Enhancements
Support for CDS Hooks 1.0. See https://cds-hooks.hl7.org/1.0.
Support for FHIR 3.5.0. See http://hl7.org/fhir/directory.html and http://hl7.org/fhir/2018Sep/index.html.
Bug Fix
Users with Pending registration status get unexpected error when they navigate to My Placeholders.
TS 3.9.3 - August 20, 2018
Enhancement
Performance improvements to response time of the Exchanges screen.
Bug Fix
Trailing space in testscript name causes Test Setup to fail.
TS 3.9.2 - August 6, 2018
Enhancement
Rebranding of Touchstone UI.
Bug Fix
Changing values on MySettings page and then switching to Test Definitions page causes error.
TS 3.9.1 - July 24, 2018
Enhancement
Allow invalid fixtures to get skipped during scheduled validation-runs for negative testing.
Bug Fixes
Validation-errors permanently disappear on some test definitions that haven’t changed after an upload.
Validation-errors panel gets clipped on Test Definitions page when user is on lower screen resolutions.
User gets “No invalid fixtures” immediately upon upload without any indication of a pending validation-run.
TS 3.9.0 - July 23, 2018
Enhancements
Validate Sandbox test definitions on a scheduled basis.
Touchstone checks for new and modified test definitions every 5 minutes and validates them using FHIR Validator.
Validation errors become visible to owners of the Sandbox test group on Test Definitions screen e.g. Only members of ‘Organization0005’ will be able to view validation errors under ‘/FHIRSandbox/Organization0005’ test group.
Remove subscription requirement for the following read-only Touchstone APIs:
New Rules Authoring documentation and clean up of the Rules API.
Bug Fix
Some links in Touchstone email notifications point to the old Touchstone user guide.
TS 3.8.4 - July 10, 2018
Bug Fix
Special characters are not handled properly in RequestURL assertions for Peer-to-Peer tests.
TS 3.8.3 - June 17, 2018
Enhancement
Allow Org Reps of subscribing organizations to control who can upload test scripts. See Upload on UI for more details.
Bug Fix
When user signs in after attempt to download touchstone-api.zip, the user is redirected to Test Definitions instead of Downloads page.
TS 3.8.2 - May 29, 2018
Enhancement
Allow non-subscribers to execute FHIRSandbox test scripts.
TS 3.8.1 - May 28, 2018
Enhancement
Disallow uploads of test scripts that contain dot in the name.
Bug fix
Upload of test group with wider access to test group with Org Group restrictions causes unexpected error.
TS 3.8.0 - May 13, 2018
Enhancements
TestScript Editor release
To learn more about it, visit TestScript Editor.
It can be downloaded from TestScript Editor Download.
Online HTML-based Documentation
Can be accessed at Touchstone Docs.
Add placeholder support for generated UUID values.
TS 3.7.0 - April 23, 2018
Enhancements
Support for FHIR 3.3.0. See http://hl7.org/fhir/directory.html and http://hl7.org/fhir/2018May/index.html
Test Result Publishing
New Analytics/Published screen.
Organizations at the Project subscription level and above can now publish their test results to make them publicly viewable.
Performance improvements to response time of the Test Definitions screen.
Ability for Groovy rule writers to raise arbitrary warnings and errors in TestScript execution assertions.
Warning message on Analytics/Conformance screen when Interaction Counts are reset.
Bug fix
Org short name change does not propagate to test definitions
TS 3.6.2 - Jan 25, 2018
Bug fixes
The extended operation ‘$validate-code’ shows up under ‘$validate’ band on Analytics/Conformance screen.
The TestScript and HL7 FHIR links on home page point to old github URLs.
TS 3.6.1 - Jan 22, 2018
Enhancement
Add support for $versions operation. See http://wiki.hl7.org/index.php?title=201801_Versioned_API
TS 3.6.0 - Jan 14, 2018
Enhancements
Add support for FHIR 3.2.0. See http://hl7.org/fhir/directory.html and http://hl7.org/fhir/2018Jan/index.html
Third-party library upgrades.
TS 3.5.3 - Dec 13, 2017
Enhancement
Allow deletion of Org Groups and edits to their names.
TS 3.5.2 - Dec 04, 2017
Enhancements
Allow Org Group members to filter by “My Org Groups” on the Test Executions and Exchanges screens.
Allow Org Group Reps to set the visibility of member-organization test-executions to “Org Group (Open)” or “Org (Private)”. Organizations that are part of “Org Group (Open)” org groups can view each other’s test executions. Those that are part of “Org (Private)” cannot. Org Group Reps can view test executions of member organizations regardless of the flag setting.
Allow Touchstone to be selected as the default FHIR Client in peer-to-peer test scripts. This allows for the same test scripts to be used for both client-server (peer-to-peer) testing as well as server-only testing.
Allow Test System owners to bypass origin IP checks in peer-to-peer testing.
Bug fix
Users that are not signed-in can view test scripts that have been uploaded with access of “Can be viewed by My organization”.
TS 3.5.1 - Nov 21, 2017
Enhancements
Improved email notifications during registration and other events.
TS 3.5.0 - Nov 12, 2017
Enhancements
Subscription services. You can learn more at the new Subscription page.
Users can upload Test Scripts to Touchstone under the Starter plan.
Improvements to operation paths on Analytics/Conformance screen.
TS 3.4.16 - Sept 27, 2017
Bug fix
Status-count meter is broken on Test Execution and Analytics/Conformance screens. This issue can be seen on latest Chrome release (Version 61.0.3163.100).
TS 3.4.15 - Sept 11, 2017
Bug fix
In Peer-to-Peer exchanges (client-side testing), Touchstone forwards requests to the old Base URL of a test system when the test system Base URL changes.
TS 3.4.14 - Sept 05, 2017
Enhancements
Improve error reporting in Setup Deletes when test system returns invalid JSON response during test execution.
Improve error reporting when variables cannot be resolved during test execution.
TS 3.4.13 - Sept 03, 2017
Enhancements
Improve error reporting when conformance statement cannot be parsed.
Improve error reporting when response from Test System cannot be parsed.
TS 3.4.12 - July 31, 2017
Enhancement
Add support for different sets of Test Groups for the same FHIR version across different months on Analytics/Conformance screen.
Bug fix
Default Accept and Content-Type headers are created alongside explicit Accept and Content-Type request headers. This issue arose in new test scripts that define Accept and Content-Type headers explicitly using <requestHeader> element in TestScript operation definition and not the usual <accept> and <contentType> elements.
Test System formats field is not updated in Touchstone based on actual CapabilityStatement format field value after CapabilityStatement download
TS 3.4.11 - July 19, 2017
Enhancement
Improve error reporting when Bundle total is non-numeric in search response during Setup.
Bug fix
Do not display response links on Exchanges screen if a response has not been received by Touchstone.
TS 3.4.10 - July 10, 2017
Enhancements
Add support for GraphQL operation in Touchstone. See http://build.fhir.org/graphql.html and http://graphql.org/ for details.
Add support for FHIRPath PATCH in Touchstone. See http://build.fhir.org/http.html#patch and http://build.fhir.org/fhirpatch.html for details.
Exclude external resources referenced in HTML responses from Peer-to-Peer interceptions on Exchanges screen.
TS 3.4.9 - July 2, 2017
Enhancements
Reject Peer-to-Peer exchanges originating from web crawlers e.g. GoogleBot.
Validate actual origin of the peer-to-peer request against Origin test system in Test Setup.
Do not capture CORS Pre-Flight OPTIONS request in peer-to-peer message exchanges.
Bug fix
Interaction counts on TestScript Execution screen get reset after each Peer-to-Peer exchange.
TS 3.4.8 - June 21, 2017
Bug fix
Touchstone is not handling versionId in FHIR resource when it’s specified in wrong format.
TS 3.4.7 - May 28, 2017
Enhancements
Change “Conformance Statement” to “Capability Statement” where appropriate in Touchstone.
Improve error reporting when invalid operator value is used for confOperator in rule templates.
Bug fixes
Supported flag is incorrectly set on some of the main sunburst bands on Analytics/Conformance screen.
Message on parent of outermost band is misleading on Analytics/Conformance screen when some but not all interactions are supported.
Rule parameter values are not properly listed on Ruleset popup.
Clicking on Ruleset link causes error if ruleset uses same rule more than once.
TS 3.4.6 - May 4, 2017
Enhancement
Allow users to filter for failures on Test Execution and TestScript Execution screens. This is helpful when the number of test scripts and tests is large in the run.
Bug fix
Incorrect icon/flag is displayed for unsupported bands in main sunburst on Analytics/Conformance screen.
TS 3.4.5 - May 3, 2017
Bug fix
The sunbursts on Analytics/Conformance screen shift a little when user hovers over them. This makes it harder for user to click on a particular band.
TS 3.4.4 - May 2, 2017
Enhancement
Add support for FHIR 3.0.1. See http://hl7.org/fhir/directory.html and http://hl7.org/fhir/STU3/index.html
Bug fixes
Patch interaction shows up as supported on Analytics/Conformance screen even though capability statement does not declare support for it.
Search param ‘_include’ at the resource level shows up as unsupported on Analytics/Conformance screen even though capability statement declares support for it.
TS 3.4.3 - April 14, 2017
Bug fix
Upgraded Groovy to latest version (2.4.10). This got rid of memory leak during TestScript rule execution. See https://issues.apache.org/jira/browse/GROOVY-7683 for details.
TS 3.4.2 - March 22, 2017
Enhancement
Add support for FHIR 3.0.0. See http://hl7.org/fhir/directory.html and http://hl7.org/fhir/STU3/index.html
Bug fix
Formats-Supported checkboxes are misaligned in Firefox on New/Edit Test System screens.
TS 3.4.1 - March 1, 2017
Enhancement
Test Groups renamed
Top-level test groups under Test Definitions are now listed with latest version at the top.
Basic test scripts have been broken up into alphabetical groupings to allow for future growth and easier navigation.
TS 3.4.0 - Feb 17, 2017
Enhancement
Assertion dependencies
Touchstone can now conditionally evaluate assertions based on the state of message headers/content as well as support in the test system’s conformance statement.
TS 3.3.8 - Jan 14, 2017
Bug fixes
Conformance statement parsing fails when conformance statement contains lists with empty items.
Test Systems screen shows no items on some pages.
TS 3.3.7 - Jan 13, 2017
Enhancement
Msc improvements to UI response times.
TS 3.3.6 - Jan 12, 2017
Bug fix
Extended-Operation interactions are not matched correctly against the Conformance Statement. Even though conformance statement declares e.g. “‘reference’ : ‘OperationDefinition/ValueSet-validate-code’”, Touchstone expects “‘reference’ : ‘OperationDefinition/valueset-validate-code’”, and flags the interaction as unsupported. Either reference will now work.
TS 3.3.5 - Jan 11, 2017
Enhancements
Support for FHIR TestReport. Users can now retrieve test results via Touchstone API in FHIR TestReport format. Details can be found in the UserGuide.
Peer-to-Peer Testing: Touchstone should not auto-retrieve conformance statements during test execution and once a day for test systems that are marked as purely client test systems. Users should still have the option of manually downloading the conformance statement on the UI.
Peer-to-Peer Testing: Client request-submission attributes should be more prominent on the Script Execution screen.
Peer-to-Peer Testing: Default checks should be made during test execution for HTTP method and URL submission by the client so bad submits can be caught upstream and reported to user.
TS 3.3.4 - Jan 05, 2017
Bug fix
Analytics/Conformance screen throws error when number of test scripts exceeds 256 for a given specification.
TS 3.3.3 - Jan 03, 2017
Enhancement
Support for SSL- cert communication between Touchstone and Test Systems.
TS 3.3.2 - Dec 29, 2016
Bug fixes
Resource profile links are broken for relative references on Conformance/Capability statement popup.
Navigating to XML view on Conformance/Capability statement popup still displays JSON content.
TS 3.3.1 - Dec 26, 2016
Enhancements
Add system-generation assertion for Bundle/total presence in system-generated search response in Setup.
Display more descriptive text on the UI when Touchstone is unable to connect to target test system.
Bug fixes
Assertion for Content-Type does not check for correct FHIR mime-type.
Detect infinite loop when deletes fail for system-generated search/delete operations in Setup.
TS 3.3.0 - Dec 20, 2016
Enhancements
Add support for FHIRPath evaluation when used in TestScript “variable.expression”, “assertion.expression”, and “assertion.compareToSourceExpression” elements.
The Advanced-FHIR1-8-0, Basic-FHIR1-8-0, and Connectathon14 test scripts use FHIRPath expressions for some assertion evaluations.
Details can be found at http://hl7.org/fhirpath/index.html
Touchstone continues to support “variable.path”, “assertion. path”, and “assertion. path” elements where built-in XPath/JSONPath is executed.
TS 3.2.5 - Dec 19, 2016
Bug fixes
System errors when user attempts to update the access token on Test Setup screen (instead of Test System screen).
TS 3.2.4 - Dec 13, 2016
Enhancements
Add support for FHIR 1.8.0.
Attempt more mime-types during Conformance Statement retrieval. Update Test System “Spec” and “Formats-Supported” fields in Touchstone based on values in retrieved Conformance Statement.
Bug fixes
Required check for Destination field fails in Safari on TestSetup screen causing test execution to fail.
Test Scripts table does not show up on Analytics/Conformance screen in Safari.
TS 3.2.3 - Dec 03, 2016
Enhancements
Allow users to see the state of their existing conformance statements in Touchstone on the Test Systems, Test System, and Edit Test System screens without having to download every time.
Keep search field on Analytics/Conformance screen visible at all resolutions.
Bug fixes
Peer-to-Peer Test Execution matching does not work by IP address.
Interaction counts do not get updated during test execution in peer-to-peer exchange when source fixture is missing.
TS 3.2.2 - Dec 01, 2016
Enhancements
Add placeholder support for relative date and date time computations and replacements in fixtures.
Bug fixes
Do not allow users outside an organization to delete a test system even if the test system is publicly editable.
Monthly dropdown on Analytics/Conformance screen does not show Sept 2016.
TS 3.2.1 - Nov 29, 2016
Enhancements
On a daily basis, Touchstone will pull conformance statement for all test systems that have checked “Allow Touchstone to pull conformance statement on scheduled basis” on Test System screen. Touchstone will also attempt to pull conformance statement during test execution if previous attempts had failed.
Enforce timeout in TestScript operation calls.
TS 3.2.0 - Nov 28, 2016
Enhancements
Ability for users to delete test system even if it has test executions.
Ability for users to change test system name, base URL, and specification even if the test system has test executions.
Ability for two organizations to choose the same test system name. Display Organization in TestSetup test system drop-down.
New filter option on Test Executions screen that shows all test executions against the organization’s test systems including those launched by users in other organizations.
Ability to download Conformance statement for the month within Analytics/Conformance screen.
Display link to Conformance statement on Analytics/Conformance screen.
Show test systems for the signed-in user’s organization on Test Systems screen by default.
Conformance icon on Test Execution screen indicates one or more test scripts have unsupported interactions but screen does not indicate which test script in the list is the culprit. User has to click on each test script execution to find out. Test Execution screen now shows which test scripts in the list have unsupported interactions.
Display icon for unsupported interactions in orange instead of red on Test Execution and Script Execution screens.
Bug fixes
Clicking on XML on Conformance statement popup retrieves JSON Conformance statement. It should retrieve XML Conformance statement.
Conformance floater overflows page if conformance statement supports over 7 formats.
TS 3.1.0 - Nov 14, 2016
Enhancements
Improve error handling and reporting during Test Script upload by Test Editors.
Add support for http://build.fhir.org/testscript-definitions.html#TestScript.setup.action.operation.requestId .
Improve handling of non-existent elements during JSON path evaluation in TestScript assertions.
Bug fixes
Execution fails for test script that does not contribute towards Analytics/Conformance.
Request parameters are being decoded twice which has caused errors during paging of some TestSetups.
TS 3.0.7 - Oct 18, 2016
Enhancements
Improve error reporting when minimum check fails for unexpected element type.
Bug fixes
Addition of Other column on Analytics/Conformance screen is causing overlap of tables
ConditionalDelete in Setup fires unnecessary Search operations for JSON.
When user selects unsupported Domains (e.g. NwHIN instead of HL7 FHIR), Analytics/Conformance screen throws error.
TS 3.0.6 - Oct 10, 2016
Enhancements
Conformance statements are validated after download and validation errors are displayed on the conformance popup.
Resolve variables in minimum fixtures.
Bug fixes
TestScript setup operations/interactions are not counted correctly against the conformance analytics.
Assertions against header values should be case-insensitive.
TestScript popup is not handled properly when session has expired.
TS 3.0.5 - Oct 04, 2016
Enhancements
Add ‘Other’ column on Analytics/Conformance and Script Execution screens that captures the rest of the interaction counts besides Pass and Fail.
Bug fixes
Background color for C icon for conformance statements on Test Execution and Test Execution list screens is inconsistent with C icon on Script Execution screen.
TS 3.0.4 - Oct 02, 2016
Enhancements
Add support for Basic Authentication in Touchstone API.
TS 3.0.3 - Sept 29, 2016
Enhancements
Exclude entire test script from “% conformant” if any interaction is unsupported and user selects “Exclude Unsupported”. This is needed because of dependencies between tests/operations with a TestScript.
Add support for conditionDelete/single, conditionalDelete/multiple, updateCreate, and conditionalRead to conformance-based testing.
Move Test Systems link to the top menu so it’s visible at all times.
New set of options for execute access on New Test System and Edit Test system screen allows separation of view-access from execute-access. Test systems that use access tokens can have execute-access restricted without affecting view-access.
Admin screens for maintenance.
TS 3.0.2 - Sept 18, 2016
Bug fix
HTML returned in HTTP header values throws off the ScriptExecution and Message detail screens.
TS 3.0.1 - Sept 17, 2016
Enhancements
Allow users to access test executions by other users from Analytics/Conformance screen if target system is owned by user’s org.
Bug fixes
Search in test assertions for headers in HTTP requests and responses should be case-insensitive based on HTTP spec.
System throws error when user has not defined any test systems yet and attempts to go to Stats/Conformance screen.
Popups for request and response message detail lost their CSS styles in 3.0.0
TS 3.0.0 - Sept 15, 2016
Enhancements
Conformance-based Testing
New Analytics/Conformance screen allows users to monitor the conformance of their tests systems to a specification based on test scripts available in Touchstone.
Tests can be executed from within this new screen.
Details can be found in the Touchstone User Guide here.
Improve default TestSetup name generation.
Allow Access Token to get set on Test System Edit screen for test systems that require OAuth2.
Inform users of interactions that are supported (or unsupported) by a test system’s conformance statement on Script Execution screen.
TS 2.4.8 - Sept 11, 2016
Enhancement
Add support for STU3 Ballot+ FHIR Mime Type (‘application/fhir+json’ and ‘application/fhir+xml’)
TS 2.4.7 - Sept 05, 2016
Enhancement
Change Test Group names to better align with FHIR specification versions.
TS 2.4.6 - Aug 12, 2016
Enhancement
Added support for FHIR STU3 Ballot.
TS 2.4.5 - July 07, 2016
Bug fix
Test engine producing errors with negative testing of update operation.
TS 2.4.4 - June 26, 2016
Bug fixes
Upload of TestScript sub-folder does not overwrite existing test scripts.
Header value in TestScript-operation that contains a colon will not appear on Script Execution screen.
Table columns on TestScript-Execution screen widen and then shrink on screen refresh.
TS 2.4.3 - June 18, 2016
Enhancements
Add support for verifying request URL contents.
This is useful in Client-side/Peer-to-Peer testing.
Do not set ‘Content-Type’ and ‘Accept’ headers in request when TestScript has explicitly specified ‘none’ for operation contentType and accept.
This is useful in verifying test-system behavior when these headers have not been set.
TS 2.4.2 - June 13, 2016
Bug fix
Test Engine ignores response assertions when request assertions are present in peer-to-peer operations.
TS 2.4.1 - June 07, 2016
Bug fix
Upload of fixtures-only sub-directory by Test Editor causes Test Definitions to become inaccessible.
TS 2.4.0 - May 23, 2016
Enhancements
Touchstone API
Test executions can be launched and monitored via remote RESTful web services. This allows for integration of Touchstone test executions as part of your internal automated regressions tests (e.g. as part of Continuous Integration).
The XML and JSON schemas for Touchstone API are available within the schemas folder in touchstone-api.zip.
Details can be found in the Touchstone User Guide here.
Details on CI integration with Jenkins can be found here.
CAPTCHA during registration to prevent robot registrations.
Software upgrades
TS 2.3.2 - May 06, 2016
Bug fix
Clicking on History for a test definition on Test Definitions screen throws error.
TS 2.3.1 - May 05, 2016
Enhancements
Added XML-Patch support.
TS 2.3.0 - April 20, 2016
Enhancements
Rules Engine
Complex rules against message headers and body (that go beyond what TestScript assert previously supported) can now be evaluated using the new Rules Engine.
These rules can be used via the new TestScript.rule, TestScript.ruleset, TestScript assert.rule, and TestScript assert.ruleset elements.
Rules can be implemented in the following languages:
Groovy
Schematron
XSLT
Support for additional languages will be added in the future.
Test editors can create, upload, and edit rule and ruleset definitions on the UI.
Access to rule and rule definitions is controlled the same way that access to test scripts and fixtures are controlled (by user, organization, and organization-group).
Bug fix
Fixed XXE vulnerabilities.
TS 2.2.3 - April 13, 2016
Bug fix
Assertion in TestScript.setup system-generated delete operation is checking for response code 200. It should also check for 204.
TS 2.2.2 - April 11, 2016
Enhancements
Rename “FHIR DSTU 2.2” to “FHIR-STU-3-Candidate”
TS 2.2.1 - April 01, 2016
Enhancements
Add support for FHIR DSTU 2.2.
TS 2.2.0 - March 24, 2016
Enhancements
Test Script and Fixture Versioning
When the content of an existing test script or fixture changes (via an upload), the test execution screens will inform the user that newer version of the test script and/or fixture is available.
The system will continue to pull in latest test scripts and fixtures on test re-execution.
Old test scripts and fixtures (before versioning became available) will assume the version 0 in old test executions.
Capture Test System conformance statement for each test execution
End-users can now see the conformance statement of each test system involved in test execution at the time of execution on Test Execution screens. Until now, Touchstone only made the latest conformance statements available to end-users on Test System screens.
Improvements in conformance checks and display of conformance statements.
Some FHIR servers can only return conformance statements in one format. Touchstone now attempts to retrieve conformance statements first in JSON and then in XML if JSON fails. In the past, Touchstone only attempted XML conformance statement retrieval during conformance checks.
Validations per specification version.
Profile and resource validations during execution of test script FHIR spec 2.1 will be performed against FHIR spec 2.1 Validator. Similarly, profile and resource validations in 2.0 test script executions will be performed against FHIR spec 2.0 Validator, etc. In the past Touchstone validated only against latest FHIR validator.
FHIR spec 2.0 corresponds to FHIR DSTU 2.0 (v1.0.2-7202) - DSTU 2 (Official version) with 1 technical errata (Permanent home); http://hl7.org/fhir/DSTU2/index.html .
FHIR spec 2.1 corresponds to FHIR DSTU 2.1 (v1.2.0-7447) - Connectathon 11 Snapshot (temporary); http://hl7.org/fhir/2016Jan/index.html .
TS 2.1.9 - March 11, 2016
Bug fix
Concurrent test script execution can cause operation execution data collisions.
TS 2.1.8 - February 28, 2016
Bug fixes
XML Minimum assertion evaluation failure when minimum file contains attribute with resource name.
JSON Minimum assertion evaluation failure for resource “List” which has nested entry elements within Bundle.
TS 2.1.7 - February 27, 2016
Bug fix
Test Definition tree expands and contracts on page load.
TS 2.1.6 - February 25, 2016
Bug fix
Have system-generated search and delete operations in Setup and Teardown honor the Accept header specified in the delete operation.
TS 2.1.5 - February 25, 2016
Enhancements
New Landing Page for guest users with following information:
What Touchstone is.
Links to tutorials.
Software updates.
Feeds.
Users can bypass the landing page by bookmarking the “Sign In” page. Users continue to get redirected to their last set of Test Definitions after signing in. You can always get to the Landing Page by clicking on the Touchstone logo.
TS 2.1.4 - February 21, 2016
Enhancements
Org Group membership
Admins can now make users the Org Group Rep of Org Groups.
Org Reps can request their organizations to become members of Org Groups.
Org Group Rep can approve or reject such requests.
Access to resources such as Test Definitions and Test Systems can be limited to a group of organizations via Org Group functionality.
TS 2.1.3 - February 08, 2016
Enhancements
Display the org groups that a user and organization belong to on the appropriate screens.
Capture changes to Organization name and to Test System name and baseUrl in User History.
Bug fixes
Bad baseURL throws off Proxy URL generation during Test System creation
‘No test setups’ is displayed twice when a user initially lands on ‘Test Setup’ screen.
TS 2.1.2 - February 06, 2016
Bug fixes
XPath functions are not always taken into account in XPath evaluation during test execution
TS 2.1.1 - February 04, 2016
Bug fixes
Multiple variables in URL path not getting resolved properly in some cases during operation execution.
System does not handle relative references to fixtures (in test scripts) that contain ‘..’.
TS 2.1.0 - February 03, 2016
Enhancements
Allow Org Reps to view User History for members of the organization. The following events are captured:
User registers
User requests membership
User membership gets approved
User membership gets rejected
User membership gets changed back to Pending
User roles change
User creates an organization
User cancels a membership request
User status get deactivated by admin
User status gets reactivated by admin
User gets locked because of too many password attempts
User gets locked manually by admin
User gets unlocked by admin
User resets his/her password
User password gets reset by org rep or admin
User regenerates the Org Key for his/her organization
User regenerates his/her User Key
Support for Organization Groups
Admins can now create organization groups. An organization can belong to multiple organization groups. Test scripts, fixtures, and test systems can now be tied to organization groups. This allows members of multiple organizations to share resources and control access across specific organizations.
Redirect user to Test Definitions if an old test script has been removed.
After sign in, redirect org reps to users screen if they have pending registrations.
Bug fixes
System errors when test setup is deleted in dual session and executed in another.
TS 2.0.4 - January 25, 2016
Enhancements
Allow users to switch organizations more easily.
Improve error reporting in test script SETUP execution when entries cannot be found.
Search criteria not included in message to user when 0 records returned in Test Definitions search.
Bug fixes
Old sort cookie value is not being handled by Touchstone. This causes error when some users land on Test Definitions screen.
Touchstone attempts to parse FHIR resource out of HTML response (when operation errors).
TS 2.0.3 - January 10, 2016
Enhancements
Add support for FHIR transaction operation
Bug fixes
Resource type assertions are failing when operation response contains BOM characters.
The presence of bad html in the operation response throws off the page’s styles.
TS 2.0.2 - January 08, 2016
Enhancements
Improve Test Setup default name generation.
Email other org reps when one org rep approves or rejects user registration.
Indicate the expected Content-Type and Accept headers for client-side operations to help users submit the right request the first-time.
Bug fixes
If the test scripts referred to by a Test Setup have all be removed, then system throws misleading error when user tries to re-execute the Test Setup.
Client-side patch operation was not working properly.
Execution Status filter drop-down on Test Executions screen is out-of-order, has spaces, and duplicates
Touchstone refuses to process an XML response with a DOCTYPE declaration.
TS 2.0.1 - January 07, 2016
Enhancements
Improve error reporting when a request or response message cannot be parsed.
Increase the width of the Origin and Destination drop-downs in Test Setup.
Touchstone 2.0 User Guide.
Bug fixes
The Supported Profiles column gets squashed on Test System list screen.
Conformance retrieval needs to use access tokens for test systems that require OAuth2.
TS 2.0.0 - January 06, 2016
Enhancements
Support for Client-side (Peer-to-Peer) Testing.
Origin elements are now presented on Test Setup and Test Execution screens as Touchstone may not be the origin for all message exchanges.
Support for multiple destinations in Test Setup and Test Execution.
Conformance checks are being done against multiple origins and destinations that could be involved in test executions.
Support for user-defined variables in Test Setup.
Test Setup (and reexecution of new Test Executions) will pull latest test scripts.
There is no need any more to create new Test Setups when test scripts change in the system.
When user clicks on Test Script, Fixture, and Profile links in old test executions, the latest Test Scripts and Fixtures are NOT displayed. The ones that were used at the time of execution are displayed.
New Exchanges screen that displays all messages exchanges (Touchstone and Client initiated messages).
This screen allows users to filter for Response codes and overall Operation assertion status for their test systems. This allows users to find all “bad” response codes from their test systems, for example.
This screen is also useful in Client-side testing as request messages that do not match the user test execution can be found here.
Improvements to Test Script Execution screen layout.
Support for PATCH operation.
Support for conformance operation via HTTP OPTIONS.
Addition of Connectathon11 Test Scripts.
Track 1 - Patient
Track 2 - Terminology
Track 3 - CDS on FHIR
Track 4 - DAF
Track 6 - FHIR Genomics
Track 7 - Lab Order Lab Report
Track 9 - PATCH
Upgrade of FHIR Validator to FHIR DSTU2 (v1.2.0-7493) a.k.a DSTU 2.1 Java RI - current trunk as of 12/30/2015.
TestSetup search is now wild-carded on Test Execution search page.
Link to test system’s Conformance statement is now provided on Test System and Test System list screens.