Slide 1
Slide 1 text
Data Collection requirements for Mobile
Connected Health
An End User Development approach
Jose Juan Dominguez Veiga – jose.dominguez@insight-centre.org
@josmasflores
Slide 2
Slide 2 text
José Dominguez
jose.dominguez@insight-centre.org
@josmasflores
Mobile!2016 Oct. 2016 2
Slide 3
Slide 3 text
Agenda
• Closed Loop Digital Therapeutics
• Interviews
• Summary of Main Findings
• End User Development
• App Inventor Main Limitations and some
Potential Solutions
• Current (and Future) Work
Mobile!2016 Oct. 2016 3
Slide 4
Slide 4 text
DIGITAL
THERAPEUTICS
Slide 5
Slide 5 text
Mobile!2016 Oct. 2016 5
According to Health Standards
Slide 6
Slide 6 text
Mobile!2016 Oct. 2016 6
Picture credits:
http://my.medixprt.com/assets/img/ite
m/brief-3.png
http://www.kingsfund.org.uk/sites/file
s/kf/media/8-technologies-1-
smartphone.png
http://www.kingsfund.org.uk/sites/file
s/kf/media/8-technologies-4-
therapeutics.png
Slide 7
Slide 7 text
Typical Digital Therapeutics Architecture
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 7
Slide 8
Slide 8 text
DT Architecture: meet Bob
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 8
Slide 9
Slide 9 text
DT Architecture: meet Mary
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 9
Slide 10
Slide 10 text
DT Architecture: Intervention parameters
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 10
Slide 11
Slide 11 text
DT Architecture: Data collection
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 11
Slide 12
Slide 12 text
DT Architecture: inner subject loop
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 12
Slide 13
Slide 13 text
DT Architecture: external loop
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016 13
Slide 14
Slide 14 text
WHO BUILDS AND
PAYS FOR ALL THIS?
Slide 15
Slide 15 text
Interviews
12 Researchers, 4 countries, 4 different institutions:
• Mechanical and Electronic Engineering
• Sports and Exercise Science
• Neuroscience
• Physiotherapy
• Psychology
• Health Promotion and Education
Mobile!2016 Oct. 2016 15
Slide 16
Slide 16 text
Interviews
12 Researchers, 4 countries, 4 different institutions:
• Mechanical and Electronic Engineering
• Sports and Exercise Science
• Neuroscience
• Physiotherapy
• Psychology
• Health Promotion and Education
Mobile!2016 Oct. 2016 16
http://vignette4.wikia.nocookie.net/halo/images/7/71/Halo_3_Logo.png
Slide 17
Slide 17 text
Interviews II
Mobile!2016 Oct. 2016 17
https://static01.nyt.com/images/2015/03/26/business/MACHINE/MACHINE-blog427.jpg
Slide 18
Slide 18 text
Interviews III
Mobile!2016 Oct. 2016 18
https://obolobo.files.wordpress.com/2014/03/i-beg.jpg
Slide 19
Slide 19 text
Interviews IV
Mobile!2016 Oct. 2016 19
http://rlv.zcache.com/will_code_for_food_mug-r99e03ff348fe4a7a822a3397d5a40543_x7jsd_8byvr_512.jpg
Slide 20
Slide 20 text
Interviews V
Mobile!2016 Oct. 2016 20
http://verysmartbrothas.com/images/planb.png
Slide 21
Slide 21 text
Jeff Patton, the Spice Girls and Johnny Rotten
Mobile!2016 Oct. 2016 21
http://jpattonassociates.com/dont_know_what_i_want/
Slide 22
Slide 22 text
Mobile!2016 Oct. 2016 22
Slide 23
Slide 23 text
Mobile!2016 Oct. 2016 23
Slide 24
Slide 24 text
Mobile!2016 Oct. 2016 24
Slide 25
Slide 25 text
Do it yourself…
if you can?
Slide 26
Slide 26 text
End User Development
A set of methods, techniques and tools that
allow users of software systems, who are
acting as non-professional software
developers, at some point to create,
modify, or extend a software artifact.
Lieberman, H, Paterno, F, Klann, M, and Wulf, V. (2006). End-user development: An emerging paradigm.
Mobile!2016 Oct. 2016 26
Slide 27
Slide 27 text
End User Development
A set of methods, techniques and tools that
allow users of software systems, who are
acting as non-professional software
developers, at some point to create,
modify, or extend a software artifact.
Lieberman, H, Paterno, F, Klann, M, and Wulf, V. (2006). End-user development: An emerging paradigm.
Mobile!2016 Oct. 2016 27
Slide 28
Slide 28 text
End User Development: Examples
Mobile!2016 Oct. 2016 28
Image credits:
http://sine.ni.com/cms/images/casestudies/a14_02.jpg
http://brainimaging.waisman.wisc.edu/~tjohnstone/Image9.gif
https://upload.wikimedia.org/wikipedia/commons/thumb/5/50/OpenOffice.org_Calc.png/400px-OpenOffice.org_Calc.png
Slide 29
Slide 29 text
End User Development: MIT App Inventor
Mobile!2016 Oct. 2016 29
Slide 30
Slide 30 text
End User Development: MIT App Inventor II
Mobile!2016 Oct. 2016 30
Slide 31
Slide 31 text
MAIN FINDINGS:
REQUIREMENTS
Slide 32
Slide 32 text
Interview findings
• 11 out of 12 want to use it
– At least for prototyping
Mobile!2016 Oct. 2016 32
http://img.pixfans.com/2014/12/lan_party.jpg
Slide 33
Slide 33 text
Interview findings II
• Different levels of abstraction in the data
Mobile!2016 Oct. 2016 33
Slide 34
Slide 34 text
Interview findings II
• Different levels of abstraction in the data
Mobile!2016 Oct. 2016 34
Slide 35
Slide 35 text
Interview findings III
• Social feedback loop
Mobile!2016 Oct. 2016 35
Slide 36
Slide 36 text
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
DT Architecture: external loop
Mobile!2016 Oct. 2016 36
Slide 37
Slide 37 text
Interview findings III
• Social feedback loop
Mobile!2016 Oct. 2016 37
Slide 38
Slide 38 text
Interview findings IV
• Security and Privacy concerns
are only as important as
Ethical concerns
Mobile!2016 Oct. 2016 38
https://cfa-wpengine.netdna-ssl.com/investor/files/2014/12/Staying-off-the-slippery-slope-ethics-advice-for-those-new-to-the-industry.jpg
Slide 39
Slide 39 text
Mobile!2016 Oct. 2016 39
https://speakerdeck.com/josmas/a-homespun-decentralised-diy-data-science-research-pipeline-for-the-internet-of-star-your-star-things
Slide 40
Slide 40 text
Mobile!2016 Oct. 2016 40
https://speakerdeck.com/josmas/a-homespun-decentralised-diy-data-science-research-pipeline-for-the-internet-of-star-your-star-things
Slide 41
Slide 41 text
Google APIs Terms and Conditions. Section 5: Content
b. Submission of Content
Some of our APIS allow the submission of content. Google does not
acquire any ownership of any intellectual property rights in the content
that you submit to our APIs through your API Client, except as expressly
provided in the Terms. For the sole purpose of enabling Google to
provide, secure, and improve the APIs (and the related ser- vice(s)) and
only in accordance with the applicable Google privacy policies, you give
Google a perpetual, irrevocable, worldwide, sublicensable, royalty-
free, and non-exclusive license to Use content submitted, posted, or
displayed to or from the APIs through your API Client. ”Use” means use,
host, store, modify, communicate, and publish. Before you submit
content to our APIs through your API Client, you will ensure that you
have the necessary rights (including the necessary rights from your end
users) to grant us the license.
Mobile!2016 Oct. 2016 41
Slide 42
Slide 42 text
Google APIs Terms and Conditions. Section 5: Content
b. Submission of Content
Some of our APIS allow the submission of content. Google does not
acquire any ownership of any intellectual property rights in the content
that you submit to our APIs through your API Client, except as expressly
provided in the Terms. For the sole purpose of enabling Google to
provide, secure, and improve the APIs (and the related service(s)) and
only in accordance with the applicable Google privacy policies, you give
Google a perpetual, irrevocable, worldwide, sublicensable, royalty-free,
and non-exclusive license to Use content submitted, posted, or displayed
to or from the APIs through your API Client. ”Use” means use, host,
store, modify, communicate, and publish. Before you submit content to
our APIs through your API Client, you will ensure that you have the
necessary rights (including the necessary rights from your end users) to
grant us the license.
Mobile!2016 Oct. 2016 42
Slide 43
Slide 43 text
Google APIs Terms and Conditions. Section 5: Content
b. Submission of Content
Some of our APIS allow the submission of content. Google does not
acquire any ownership of any intellectual property rights in the content
that you submit to our APIs through your API Client, except as expressly
provided in the Terms. For the sole purpose of enabling Google to
provide, secure, and improve the APIs (and the related service(s)) and
only in accordance with the applicable Google privacy policies, you give
Google a perpetual, irrevocable, worldwide, sublicensable, royalty-
free, and non-exclusive license to Use content submitted, posted, or
displayed to or from the APIs through your API Client. ”Use” means use,
host, store, modify, communicate, and publish. Before you submit
content to our APIs through your API Client, you will ensure that you
have the necessary rights (including the necessary rights from your end
users) to grant us the license.
Mobile!2016 Oct. 2016 43
Slide 44
Slide 44 text
Mobile!2016 Oct. 2016 44
https://speakerdeck.com/josmas/a-homespun-decentralised-diy-data-science-research-pipeline-for-the-internet-of-star-your-star-things
Slide 45
Slide 45 text
APP INVENTOR
MAIN LIMITATIONS
Slide 46
Slide 46 text
It is not as easy as it may seem…
• Gets complicated easily
Mobile!2016 Oct. 2016 46
Slide 47
Slide 47 text
Mobile!2016 Oct. 2016 47
Slide 48
Slide 48 text
It is not as easy as it may seem… II
• Asynchronous calls
Mobile!2016 Oct. 2016 48
Slide 49
Slide 49 text
Mobile!2016 Oct. 2016 49
Slide 50
Slide 50 text
It is not as easy as it may seem… III
• UI style of programming
Mobile!2016 Oct. 2016 50
Slide 51
Slide 51 text
Mobile!2016 Oct. 2016 51
Slide 52
Slide 52 text
Mobile!2016 Oct. 2016 52
Slide 53
Slide 53 text
Lack of support for most Background Processes
• Only the Texting component “listens” when the app is not running.
Mobile!2016 Oct. 2016 53
Slide 54
Slide 54 text
Limited Export to Java
• There is only experimental support for exporting to Java
• Other types of Textual coding would be helpful
Mobile!2016 Oct. 2016 54
Slide 55
Slide 55 text
Limited Layout and Styling functionality
• It is difficult to create an App that looks OK, straight out the MIT server
Mobile!2016 Oct. 2016 55
Slide 56
Slide 56 text
CURRENT
(AND FUTURE)
WORK
Slide 57
Slide 57 text
Current work
• A Pedometer working as a background process
Mobile!2016 Oct. 2016 57
Slide 58
Slide 58 text
Current work
• A Pedometer working as a background process
• Diary functionality with external, configurable forms (ESM)
Mobile!2016 Oct. 2016 58
Slide 59
Slide 59 text
Future work
• Integration with a Context aware framework
Mobile!2016 Oct. 2016 59
Slide 60
Slide 60 text
Future work
• Integration with a Context aware framework
• A BLE framework (not the current available extension)
Mobile!2016 Oct. 2016 60
Slide 61
Slide 61 text
Future work
• Integration with a Context aware framework
• A BLE framework (not the current available extension)
• On-device ML with WEKA
Mobile!2016 Oct. 2016 61
Slide 62
Slide 62 text
Questions?
I am interviewing more researchers!
jose.dominguez@insight-centre.org
@josmasflores
62
2: Wearable data collected
1: Set Intervention parameters
3: Not enough walk detected
4: Intervention range exceeded
Operational API
Notifications
Data Service
SERVICES
Mobile!2016 Oct. 2016