The Path to Continua Certification - Continua Health Alliance - The Path To... · Training...
94
Copyright© 2012 Continua Health Alliance ® All Rights Reserved The Path to Continua Certification October 9 th , 2013 Kelvin Lim – TCWG Chair (Roche)
Transcript of The Path to Continua Certification - Continua Health Alliance - The Path To... · Training...
Copyright© 2012 Continua Health Alliance ® All Rights Reserved
The Path to Continua Certification
October 9th, 2013
Kelvin Lim – TCWG Chair (Roche)
Training Description • Continua Path to Certification training
is designed to help Continua
implementers better understand the
Continua Certification process.
Part 1
Process Part 2
Tools
Copy of slides
Direct from Kelvin after the training
Or
http://bit.ly/continua-ptc
Agenda
Background / Overview / Basics
Details - Process
Details - Test Tool
What’s next?
Guidelines Certification Logo
Guidelines
Continua member companies selects
connectivity standards and publish
Guidelines for strict interoperability.
Certification and Logo
Recognizable logo signifying the promise
of interoperability with other certified
products.
5
Certification Goal
Assurance that a device has been
designed to meet the requirements of the
Continua DG
6
Breaking Down an Interoperability Architecture
Enabling PCH at the Interface
Health
Record
Network
(HRN)
Interface
Personal Device
Weight Scale
Pulse Oximeter
Independent
Living Activity
Cardio / Strength
Medication
Adherence
Glucose Meter
Pulse /
Blood Pressure
Thermometer
Physical Activity
Peak Flow
Electrocardiogram
Insulin Pump
Aggregation
Manager
Personal
Area
Network
(PAN)
Interface
Wide
Area
Network
(WAN)
Interface
Telehealth
Service
Center
Health
Records/
Networks
EHR
PHR
NHIN
HIE
WiFi, 2G, 3G &
4G
IHE PCD-01 packaged
in SOAP over HTTP
HL7 CDA R2-based
PHMR packaged in
SOAP over HTTP
Interface Stack Diagram
Scope of Certification Program
In Scope
Compliance Testing
Interoperability
Testing
Out of Scope
Non-functional testing
User Interface testing
Regulatory testing
Continua Tools / Software
• Continua provides tools to assist vendors in product development and testing. • CESL http://bit.ly/download-cesl
• mCESL http://bit.ly/download-mcesl
• Test Tool http://bit.ly/download-testtool
CESL
Speed the adoption
Reference source code
Testing Prototypes
Basis for Continua Test Tool
Creation of reference
devices for IOP
mCESL
Continua Reference Device Code (Mobile) PAN - Reference Manager Application
WAN - developed in C++ and JAVA.
Available as an SDK and Reference Application developed
for the Android Nexus platform
Continua Test Tool
Helps ensure you can pass all conformance tests.
Recommended for internal pre-testing before going to test lab.
Reference Code vs. Test Tool
Design/Development Test
CESL / mCESL
Continua
Test Tool
Contains reference code,
agent/manager
implementation to assist in
development and interop
testing
Checks conformance
against Continua DG and
underlying standards
Test Tool Schedule
http://bit.ly/test-tool-schedule
Certification Specification
• Explains certification requirements.
• List of applicable test suites
http://bit.ly/cert-spec
Continua Plugfests
• Test Lab Engineers
• Continua Certification Experts
• Tech Ops Dir
• Certified Devices
• Devices in development
http://plugfest.continuaalliance.org
IOP Testing
• Interoperability test procedures
http://bit.ly/test-iop
• Run against already certified
devices if available
• Devices are available at Continua
Plugfest events.
Email Application Email the completed application
http://bit.ly/continua-cert-register to
Application Questions • Product Name, SKU, Manufacturer
Information
• Device Specializations
• Transport Certification Information
• Product Implementation Conformance
Statements
Types of Certification
Type A
New product.
Type O
Re-labeling of a Type
A or Type D by a
second vendor.
Type D
Derivative
Type U
update
Scheduling Test
• Allow 1-2 weeks for certification.
– Send your device to test lab at least 3
working days before start of certification.
Test Lab Choose a Continua Test Lab
http://www.continuaalliance.org/products-
certification-process/continua-test-labs at the time
of Certification Application.
Not required that you attend test lab for testing.
Required that you be available via phone, email.
Continua Test Labs
Herndon, VA,
USA
Malaga, Spain
Taipei, Taiwan
Korea Beijing, China
Basingstoke,
UK
http://www.at4wireless.com/
http://test.tta.or.kr/English/
http://emcite.com/english/
http://ul.com/
Coming soon,
UK
Data / Protocol
(i.e. 11073 PHD)
Testing conformance to data and messaging standards.
Transport
Testing conformance to
transport specification and interoperability at
the transport level.
IOP
Testing conformance to Continua Interoperability Guidelines
Scope of Certification Program
IOP Testing
http://bit.ly/test-iop
Test with other devices
Home, at work, at test lab, at
Plugfest…
IOP
External Test Requirements
Transport and Continua
tests can be done in
parallel.
Transport Certification
must be obtained
before Continua Admin
approves a device as
Continua Certified.
Transport
Test Lab Conducts the Testing
• Test Lab will conduct the testing
required by the Certification
Specification and report the results
back to the member company.
• Member company need to submit the
official test results to the Certification
Administrator.
• Hands-off policy Data / Protocol
(i.e. 11073 PHD)
Self Test • Derivative
– Removal of Transport
– Change on how data is transmitted in 20601.
• Bluetooth LE Agent
• HRN Sender
• See Continua Certification Specification
http://bit.ly/cert-spec for list of Test Suites.
BT LE Agent (Self Test)
Test tool is run via self-declaration
Email results to
Results reviewed by
Tech Op. Director
HRN Sender (Self Test)
Test tool is run via self-declaration
Tests DG and PHM spec.
Email results to
Results reviewed by
Tech Op. Director
HRN
Waiver
INCONC / Fail due
to Test Tool or DG
Fill in waiver
http://bit.ly/continu
a-waiver
Email to Tech. Op.
Dir. for review
Device
Under
Test
Continua Certifies Full Systems
Some vendors may implement a part
of a full solution, but not a whole
solution. However, a full solution
must be provided to Continua for
certification.
Logo applies to
the full solution. Stollmann
BlueMod+P25/G2/IEEE/415
Freescale i.MX Linux AHD
Reference Platform
90 Day Grace Period
Within 90 days, you
have the option.
Test Tool
version 1
Test Tool
version 2
Inconclusive Result Summary
If an inconclusive result, review
‘Inconclusive Results Summary’.
Description, Reason, Bug ID…
http://bit.ly/inconclusive-results
Upon successful completion of testing…
Test complete.
Submit all
results,
waiver, signed
Certification
Mark License
Agreement
Continua
invoices listing
fee.
Member pays
listing fee and
provide
marketing text,
image… etc.
Fees
Listing Fee (Continua)
$0 - $5,000 depending on
membership level and
certification type.
Testing Fee (if use Test Lab)
$5,000 - $8,500 depending on
device complexity.
http://bit.ly/cert-fees
Certification Mark License
Sign in order to use the Continua Certified logo.
Logo usage guide.
http://bit.ly/cert-license
Use the Logo Continua Certification Logo Manual http://bit.ly/logo-manual
Agenda
Background / Overview / Basics
Details - Process
Details - Test Tool
What’s next?
Test Tool
Using the Compliance Test Tool
Topics
• Download and general overview
• Hardware requirements
• PICS/PIXIT concepts
• Configuring a Test Campaign
• Running the test cases.
Step 1: Download
Free for all Continua Members
http://bit.ly/download-testtool
47
Step 2: Install Continua Test Tool is composed of 2 blocks
48
Continua Test Tool
User Interface
TM Lite
Test Cases
Technology Package
1. Install TM Lite
2. Install Technology
Package
Step 3: Set up External HW
49
External HW: USB
50
Manager Test Tool: Keil MCB2370 Board + CESL Firmware
Agent Test Tool: No hardware required
• Keil Board: http://www.keil.com/mcb2300/mcb2370.asp
• Keil Contact: Look for your local sales distributor at http://www.keil.com/distis/
External HW: Bluetooth HDP
51
• Dev Board: http://www.stollmann.de/de/module/bluetooth-development-kits/bluedev-
p25g2hdp.html
• USB Dongle: http://www.stollmann.de/de/module/bluetooth-produkte/bluehdp-usb.html
• Stollmann Contact: Mr. Florian Herrmann [email protected]
Agent Test Tool: Stollmann BlueDev+P25/G2/HPD or BlueHDP+USB
Manager Test Tool: Stollmann BlueDev+P25/G2/HPD or BlueHDP+USB
External HW: Bluetooth LE
52 PTS Bluetooth LE Dongle:
http://www.gvinedesigns.com/shopping/bluetooth/product_detail.cfm?pid=142
Agent Test Tool: PTS Bluetooth LE Dongle
Manager Test Tool: PTS Bluetooth LE Dongle
External Hardware: ZigBee
53 • Freescale Board: MC1322x USB Kit with MC13226 chip
http://www.freescale.com/webapp/sps/site/prod_summary.jsp?code=1322x_Dev_Kits
Agent Test Tool: Freescale MC1322x USB Dongle + CESL Manager FW
Manager Test Tool: Freescale MC1322x USB Dongle + CESL Agent FW
External Hardware: WAN/HRN
54
WAN and HRN do not need external hardware
Direct Connection with an Ethernet Cable
Indirect Connection through Local Network
Step 4: Downloading Test Tool
Documents
• Continua Test Tool Documents are available in
Continua Members Area, inside the “Test and
Certification” Working Group (TCWG) folder:
https://cw.continuaalliance.org/wg/TCWG/document/in
dex?dir=748
• Test Tool documentation includes:
• Usage documents: Explain how to operate the Test Tool
• Test Procedures (TSS&TP): Detail the verifications
performed in each test case
• Test Cases Reference List
55
Step 5: Working with Test
Tool
1. Create a Project
2. Fill in the PICS information
3. Check the Static Conformance
Review
4. Fill in the PIXIT information
5. Configure Test Tool General
Parameters
6. Test
Project Creation
PICS/PIXIT Information
• PICS: Protocol Implementation Conformance
Statement.
• PIXIT: Protocol Implementation eXtra Information
for Testing.
• Set of Supported/unsupported features of the
device and additional information.
• Provided by Manufacturer Implementation
dependant.
58
PICS Information
59
• Step 1: Go to PICS Editor
• Step 2: Select Device Role
• Step 3: Select Value (TRUE/FALSE)
• Fields:
– Name: Code for PICS.
– Caption: Description of the feature.
– Group Name: Related Standard.
– Mandatory: Status of the PICS, Conditional (C)
or Optional ( ).
PICS Information
60
Selecting the Role
Selecting the Transport
Selecting the Specialization(s)
Selecting the
Configuration(s)
Other features
PICS Information
66
• Once all PICS have been filled in, check the
Static Conformance Review (SCR)
– If SCR Errors = 0
• PICS are Consistent.
• It does not make sure that they are correct.
– If SCR Errors ≠ 0
• Inconsistency!!!!
• Some PICS are not properly set.
• Hint: Check the description.
• Change until SCR Errors = 0.
PICS Information
67
PICS Information
68
PIXIT Information
69
• Step 1: Go to PIXIT Editor
• Step 2: Select Device Role
• Step 3: Set Value
• Fields:
– Name: Code for PIXIT.
– Caption: Description of the feature.
– Group Name: Related Standard.
– Units: Units used for the value (if applicable).
PIXIT Information
70
PIXIT Information
71
• Most important PIXIT: Config-ID
– Identification number of the Configuration that is
being tested.
– If the device supports more than one
Configuration, the full Test Suite needs to be
executed for each one of them.
– Example: Config-ID=400 for Pulse Oximeter with
Standard Configuration 0x0190.
How to export PICS/PIXIT
72
PICS/PIXIT vs. Configurations
73
• Agents may implement multiple configurations
– Create a different project to test each configuration
– Fill PICS/PIXIT according to features implemented in configuration that you are
going to test and identify the configuration in PIXIT I_AG_OXP_007
Where do I go from here?
Cert Incentive for New Members
New Members
• If you join Continua between now and December 31, 2013, you get:
– All existing benefits of Continua membership (CESL code, free Test Tool, matchmaking, etc.).
– PLUS –
• Free certification within first year of Continua membership.
Notes Regarding this Certification Incentive:
1. Only one offer per company/subsidiary. 2. Covers certification for one device
specialization and one transport. Additional device specializations/transports follow typical fees.
3. Does not cover retest fee. 4. The deadline refers to the date company is
ready for certification (device is at Test Lab, certification application has been received and approved). Actual test completion date is dependent on Test Lab volumes.
BoD Approved!
Emerging Markets Incentive This emerging markets incentive qualifies new members from
either a developing region or from a small company.
A company may qualify by
being a company originating
out of a defined Developing
Area (OECD GDP of less than
$15K per Capita).
A company may qualify if:
•less than 20 full-time employees
(in all company divisions).
•Less than $4M annual gross
revenues.
•Less than $4M in total assess
(as indicated on balance sheet).
Developing
Region
Small
Company
Qualifying Benefits 1. Company pays only $1000 for their first year, $2,500 for their second and full Contributor costs in their third year of
Continua membership.
2. Company receives one free listing fee (subject to the listing fee only and excludes the testing fee).
3. Company may participate in Continua Plugfests and Continua Connects (subject to existing fees).
4. Company in the Developing Region category will receive all Contributor membership benefits except they are limited to a
maximum of 2 participants at each Summit. Leadership roles are also not available to this category.
To sign-up, please contact Continua Administration.
Resources/Reference Material Certification Process
overview is available on
Continua website.
http://www.continuaalliance
.org/products/certification-
process
Contacts
Certification contact
TCWG chair, Kelvin Lim
Continua Technical Operations Director, Michael Kirwan
Continua Certified Experts
• Raul Gonzalez Gomez (AT4 Wireless) [email protected]
• Elisabeth Ruiz Jimenez (AT4 Wireless) [email protected]
• Xiaochen Chen (TMC) [email protected]
• Kanghae Lee (TTA) [email protected]
http://bit.ly/certexpert
How to Get Involved
• Join our discussions online.
https://cw.continuaalliance.org/wg/TCWG/dashboard
• Join our discussions in the telco.
TCWG meets every two weeks:
• Tuesdays, 9-10:30 am US Eastern Time
• Calendar details:
https://cw.continuaalliance.org/wg/TCWG/calendar
Extras
Q&A
• Is my product a Type D or Type U?
• When do I qualify for Type O?
• Can you tell me more about transport
certification?
• How do I certify a partial Continua
solution?
Q: Is my product a Type D or Type U?
Type D and Type U Examples*
84
Type D Type U
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
UI Application
Hardware
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
New UI
Application
Hardware
USB, BT, Zigbee
drivers
IEEE 11073 PHD
software
UI Application
Hardware
USB, BT, Zigbee
drivers
IEEE 11073 PHD
software
UI Application
New
Hardware**
* Assuming no data size or
timing changes are introduced.
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
UI Application
Hardware
New USB, BT,
Zigbee driver(s)
IEEE 11073 PHD
software
UI Application
Hardware
Note: Policies may vary depending on the specifics of your implementation. Below are examples only.
Refer to the Certification Specification for more details.
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
base protocol
UI Application
Hardware
IEEE 11073 Device
Specialization(s)
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
base protocol
Hardware
UI Application
New IEEE 11073 Device
Specialization(s)
Q: When do I qualify for Type O?
Type O Examples (Second Vendor)
Type A
OEM
creates
items in
green.
Type O
Second
vendor
creates
items in
orange.
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
UI Application
Hardware
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
New UI
Application
Hardware
No additional
testing
needed!
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
UI Application
Hardware
IEEE 11073 Device
Specialization(s)
USB, BT, Zigbee
driver(s)
IEEE 11073 PHD
software
Hardware
UI Application
New IEEE 11073 Device
Specialization(s) Type A
OEM
creates
items in
green.
Type O
Second
vendor
creates
items in
orange.
Type D testing
needed.
Q: Can you tell me more about
transport certification?
USB PHDC Certification Options:
Test Labs and Compliance Workshops
• Charge a fee.
• Available on demand.
• Available to both USB-IF and non-USB-IF members.
• USB PHDC test labs can be found at: http://www.usb.org/developers/compliance/labs/.
USB-IF Test Labs USB-IF Compliance Workshops
• Offer more interoperability options.
• Free to USB-IF members. (Not available for non-USB-IF members.)
• Upcoming Compliance Workshops: – Available from
http://www.usb.org/developers/events/compshop/.
USB PHDC Test Suite
• USB PHDC Test Suite is fully automated.
• To get a copy:
– Go to site: http://www.usb.org/developers/tools/
and download USB20CV R1.4.9.7
Bluetooth HDP/MCAP Certification
Options: Test Labs and Self-Declaration
• Charge a fee.
• Available on demand.
• Bluetooth Qualified Test Facility https://www.bluetooth.org/apps/qualificati
on/bqtf.aspx
• Can be run by the vendor or module provider.
• May be manual or automated.
• Automated tests available from www.bluetooth.org. HDP tests are free. MCAP tests have a license fee.
BT HDP/MCAP Test Labs BT HDP/MCAP Self-Declaration
More info on testing
https://www.bluetooth.org/Building/Product/TestProduct.htm
Bluetooth HDP/MCAP Test Suite
• Bluetooth Profile Tuning Suite (PTS) has automated both the HDP and MCAP test suites. – PTS is free to Bluetooth Associate and Promoter members
(paying members) and costs $7500 to Adopters (Adopter membership is free).
– HDP automated test suites are available free of charge to Bluetooth members and are required to be run automated.
– MCAP automated test suites available for a license fee to Bluetooth SIG members ($750). These can also be run manually for vendors not wishing to pay the fee.
Zigbee HCP Certification Option:
Test Labs
• Charge a fee.
• Available on demand.
• Test labs as well as certification process is shown here:
– http://www.zigbee.org/Certification/CertificationProcess.aspx
Zigbee Test Labs
Q: How to I certify a partial Continua
solution?
Examples of Full System Requirement
Example 1: Multiple Legacy Devices
communicate to hub over a non-
standardized interface
Non-s
tandard
ized
inte
rface
Contin
ua PA
N in
terfa
ce
Hub
Certification applies to the hub plus the
devices that communicate to the hub.
Logo can be placed on the hub or
packaging that contains the full system.
Example 2: Software Manufacturer provides
Continua application software to be run on top of a
reference set of hardware
Software manufacturer must provide the
hardware and any interface software
required for certification. Software
manufacturer must ensure their
customers have the pieces to obtain the
full Continua solution.
Logo can be placed on software
application packaging or distribution
media (ex. CD, SanDisk).
