Slide 1

Slide 1 text

DISCNGINE CONNECTOR Spotfire Connector for Pipeline Pilot Release 5.3 2020

Slide 2

Slide 2 text

Agenda Introduction Connector Modules Deployment Architecture 2

Slide 3

Slide 3 text

Company Paris 2004 ~50 employees >70 customers worldwide More Information: www.discngine.com SOFTWARE FOR LIFE SCIENCES RESEARCH

Slide 4

Slide 4 text

References

Slide 5

Slide 5 text

5 Business Expertise Data acquisition and analysis – Sample management

Slide 6

Slide 6 text

6 Business Expertise Scientfics Data Science

Slide 7

Slide 7 text

Business Expertise Cheminformatics & Bioinformatics 7

Slide 8

Slide 8 text

INTRODUCTION Objectives 01 8

Slide 9

Slide 9 text

Objective Scientific Data Science TIBCO Spotfire BIOVIA Pipeline Pilot 9

Slide 10

Slide 10 text

Objective Visual analytics + Scientific data handling Bidirectional Any Spotfire Client Analyst, Consumer, Business Author, Automation Any Science Chemistry, Biology, Imaging, ADMET... Data: Binary objects, molecules, images, sequences… API: Events, Visualizations, Job Control… 2 3 1 10

Slide 11

Slide 11 text

Objective Citizen Developer Data Functions Calculated Columns Automation Services Experienced Developer JavaScript SDK IronPython Web Development 11

Slide 12

Slide 12 text

DISCNGINE CONNECTOR Components in the Connector suite 02 12

Slide 13

Slide 13 text

Server-side Spotfire authoring Bi-directional data exchange Pipeline Pilot Data Functions & Calculated Columns Pipeline Pilot Automation Tasks Dynamic Spotfire authoring Client Automation SDK and S.W.A.P.P 13

Slide 14

Slide 14 text

Pipeline Pilot Data Functions & Calculated Columns Objective ▪ Easy to use bi-directional data integration between a Spotfire document and Pipeline Pilot protocols What are TIBCO Spotfire Data Functions? A way to integrate external software for data retrieval and processing Used by TIBCO to integrate with: R, SAS, Matlab, S+ Can be extended with the public API Use standardized integration mechanisms and interfaces supported by TIBCO 14

Slide 15

Slide 15 text

Pipeline Pilot Data Functions Use cases ▪ Retrieve data from the execution of a protocol without developing an interface ▪ Send multiple Spotfire records to Pipeline Pilot for processing > E.g. an entire data table, marked rows, selected columns... ▪ Interact with Pipeline Pilot protocols based on events > Forms in text areas, changed document property, changed marked records > Write back to a database/filesystem ▪ Deliver custom data tables to Web Player users 15

Slide 16

Slide 16 text

Pipeline Pilot Data Functions A Spotfire extension based on the Data Function API ▪ Data only integration > SBDF in/out > Parameters in/out > Pipeline Pilot Global Variables in/out > Works with images, structures, sequences… ▪ Runs in all clients > Analyst > Web Player Consumer > Web Player Business Author > Automation ▪ No programming skills required! 16

Slide 17

Slide 17 text

Pipeline Pilot Data Functions Starting with Connector v5.1, several data tables can be generated from one protocol execution 17

Slide 18

Slide 18 text

Pipeline Pilot Calculated Columns Extend Spotfire Calculated Columns concept to use Pipeline Pilot protocols as new column calculation engines ▪ Spotfire Standard functions > Concatenate([IDNUMBER],'-',[CL_SIZE]) > Sum([Sales]) / Sum([Sales]) OVER (Intersect(All([Axis.Color]), [Axis.X])) ▪ Connector Pipeline Pilot Calculated Columns functions > executeProtocol_String('Protocols/Expression Functions/Calculate', [Structure ], 'ECFP_6’) 18 New in v5.3

Slide 19

Slide 19 text

Pipeline Pilot Calculated Columns executeProtocol_String('Protocols/Expression Functions/Calculate', [Structure ], 'ECFP_6’) 19 New in v5.3

Slide 20

Slide 20 text

Pipeline Pilot Calculated Columns executeProtocol_String('Protocols/Expression Functions/Calculate', [Structure ], 'ECFP_6’) Data Column Parameter Path to Pipeline Pilot protocol 20 New in v5.3

Slide 21

Slide 21 text

Client Automation SDK Objective ▪ Allow developers to programmatically interact with the Spotfire C# client API through JavaScripting ▪ Runs in both Analyst and Web Player clients ▪ Leverage modern JavaScript Libraries (Angular, React.js, D3.js, Vue.js…) ▪ Works with Pipeline Pilot and any other web capable technology (J2EE, Node.js, Python, php, Apex…) ▪ Used to build advanced mashup applications > Web application + Spotfire documents 21

Slide 22

Slide 22 text

Client Automation SDK spotfireDocument .addDataTable(sbdfFileURL) .addPage("Comparison Of Mean Ranges") .addBoxPlot(jsonConfig); 22

Slide 23

Slide 23 text

Client Automation SDK 23 spotfireDocument .addDataTable(sbdfFileURL) .addPage("Comparison Of Mean Ranges") .addBoxPlot(jsonConfig);

Slide 24

Slide 24 text

S.W.A.P.P Spotfire Web Application for Pipeline Pilot ▪ A low-code framework to streamline Pipeline Pilot protocol integration ▪ Based on Client Automation SDK ▪ Low code > Declare the Pipeline Pilot protocol > Map the parameters to a web form (Wizard) > Define actions on the Spotfire document based on protocol output files ▪ Co-Developed with AstraZeneca ▪ Developed with React.js 24

Slide 25

Slide 25 text

S.W.A.P.P: Spotfire Web Application for Pipeline Pilot 25

Slide 26

Slide 26 text

S.W.A.P.P: Register Protocol 1/2 26

Slide 27

Slide 27 text

S.W.A.P.P: Register Protocol 2/2 27

Slide 28

Slide 28 text

S.W.A.P.P: Execute (Form is created automatically) 28

Slide 29

Slide 29 text

S.W.A.P.P: Software Architecture Spotfire Web Application for Pipeline Pilot Discngine Client Automation Extension Spotfire Web Player HTML+JS React.js Pipeline Pilot Server Web (http) Data (http) Discngine Client Automation API 29

Slide 30

Slide 30 text

S.W.A.K: Software Architecture Spotfire Web Application for Knime Server (coming soon) Discngine Client Automation Extension Spotfire Web Player HTML+JS React.js KNIME Server Web (http) Data (http) Discngine Client Automation API 30

Slide 31

Slide 31 text

Pipeline Pilot Automation Tasks Objective ▪ Generate a Spotfire Document server-side from the execution of a Pipeline Pilot protocol 31

Slide 32

Slide 32 text

Pipeline Pilot Automation Tasks Use case ▪ Spotfire Document generated server-side with dynamic content On Schedule / Event Pipeline Pilot Protocol with Automation Tasks components New Document prepared and stored in the Spotfire Library User Notification 32

Slide 33

Slide 33 text

Pipeline Pilot Automation Tasks Automation Custom Tasks ▪ Pipeline Pilot Login > Allow execution of a PP Data Function ▪ IronPython Executor > Do anything you want… Pipeline Pilot Components ▪ Spotfire Automation Tasks Writers > Open & Save DXP, add pages, add charts, run script... ▪ Spotfire Automation Script Runner > Execute the Automation task from a PP protocol > Uses Spotfire WebService Rest API 33

Slide 34

Slide 34 text

Summary 34 Simple: Add new columns with Expressions UI: Default Data First: Retrieve or transform multiple data tables UI:Text Areas Interactive: Build Web Applications with Spotfire UI:Full Web + Spotfire Visuals Scheduled: Generate/Edit Spotfire Documents server-side Pipeline Pilot Calculated Columns Pipeline Pilot Data Functions … Spotfire Web Application for Pipeline Pilot / SDK … Pipeline Pilot Automation Services Tasks

Slide 35

Slide 35 text

Summary 35 Simple: Add new columns with Expressions UI: Default Data First: Retrieve or transform multiple data tables UI:Text Areas Interactive: Build Web Applications with Spotfire UI:Full Web + Spotfire Visuals Scheduled: Generate/Edit Spotfire Documents server-side Pipeline Pilot Calculated Columns Pipeline Pilot Data Functions … Spotfire Web Application for Pipeline Pilot / SDK … Pipeline Pilot Automation Services Tasks

Slide 36

Slide 36 text

Summary 36 Simple: Add new columns with Expressions UI: Default Data First: Retrieve or transform multiple data tables UI:Text Areas Interactive: Build Web Applications with Spotfire UI:Full Web + Spotfire Visuals Scheduled: Generate/Edit Spotfire Documents server-side Pipeline Pilot Calculated Columns Pipeline Pilot Data Functions … Spotfire Web Application for Pipeline Pilot / SDK … Pipeline Pilot Automation Services Tasks

Slide 37

Slide 37 text

Summary 37 Simple: Add new columns with Expressions UI: Default Data First: Retrieve or transform multiple data tables UI:Text Areas Interactive: Build Web Applications with Spotfire UI:Full Web + Spotfire Visuals Scheduled: Generate/Edit Spotfire Documents server-side Pipeline Pilot Calculated Columns Pipeline Pilot Data Functions … Spotfire Web Application for Pipeline Pilot / SDK … Pipeline Pilot Automation Services Tasks

Slide 38

Slide 38 text

DEPLOYMENT Installation, Licensing, Security 03 38

Slide 39

Slide 39 text

Security SSO & Connector Authenticator ▪ Compatible with Pipeline Pilot authentication mechanism ▪ Compatible with Spotfire SSO configuration (e.g Kerberos) ▪ Optionally: A specific Authentication extension is provided with the Connector to enable transparent authentication of Spotfire users using a Pipeline Pilot session ID 39

Slide 40

Slide 40 text

Deployment Spotfire extensions ▪ Provided as a single .sdn file Pipeline Pilot components and protocols ▪ Provided as a Component Collection (single zip file) Compatibility ▪ Spotfire 7.11 LTS, 10.3 LTS ▪ Pipeline Pilot 2017 R2 → 2020 40

Slide 41

Slide 41 text

Licensing Developer annual licenses ▪ Developers can use the product to create protocols and applications that uses Connector components ▪ End-users can execute protocols and application with no restriction Product Code Product Pack of 5 Pack of 10 Additionnal license DNGSPODF Pipeline Pilot Data Functions and Calculated Columns 15 000 € 25 000 € 2 500 € DNGSPOCAS Client Automation SDK for Web Developers 12 000 € 20 000 € 2 000 € DNGSPOCAPP Client Automation SDK for Pipeline Pilot 15 000 € 25 000 € 2 500 € DNGSPOAUTO Pipeline Pilot Automation Tasks 9 000 € 15 000 € 1 500 € DNGSPOCONN Connector Suite (all extensions above) 28 000 € 45 000 € 4 500 € 41

Slide 42

Slide 42 text

ARCHITECTURE Public API extension points 04 42

Slide 43

Slide 43 text

Spotfire Architecture 43

Slide 44

Slide 44 text

Spotfire Architecture Windows Client Web Client “Headless” Client 44

Slide 45

Slide 45 text

Discngine Connector Spotfire Extensions Pipeline Pilot 45

Slide 46

Slide 46 text

More information Documentation ▪ https://connector.discngine.com Support ▪ [email protected] ▪ https://discngineusergroup.slack.com/ 46

Slide 47

Slide 47 text

+33 1 80 48 66 70 [email protected] Discngine, 79 avenue Ledru-Rollin, 75012 Paris – France www.discngine.com Thanks!