Universal Data Connectivity for Applications

CData Software CTO Tomas Restrepo による、データ連携のトレンドと方法論。

Transcript

1. © 2019 CData Software Inc. | www.cdata.com See the world as a database Universal Data Connectivity for Applications www.cdata.com
2. Data is Increasingly Fragmented SaaS is now the system of record. 58% of companies are running almost completely on SaaS applications.
3. © 2019 CData Software Inc. | www.cdata.com Insights on Data Fragmentation • The volume of relevant data for enterprises is growing exponentially, and IDC’s Data Age projects that it will reach 158 zettabytes (ZB) by 2025. • By 2025, Network World predicts that public cloud environments will host nearly 50% of all enterprise data. • Gartner has predicted that by the year 2022, 85 percent of the data the enterprise needs will not be within the four walls of the business.
4. © 2019 CData Software Inc. | www.cdata.com Long-Tail Data Connectivity APIs Continue Growth As SaaS Adoption Becomes More Pervasive Specialized & Emerging Tech Smartsheet, Reckon, ExactOnline, MailChimp Relational / RDBMS MySQL, SQL, PostgreSQL Universal SaaS & Cloud Storage Salesforce, SAP, Dynamics, BigQuery, MongoDB Vertical Apps & Services Marketo, Eloqua, Splunk, ServiceNow, HubSpot
5. © 2019 CData Software Inc. | www.cdata.com The Result? Data integration will continue to become more complex, resource- intensive, and time-consuming.
6. © 2019 CData Software Inc. | www.cdata.com Data Integration Challenges Breadth vs. Depth BREADTH DEPTH
7. © 2019 CData Software Inc. | www.cdata.com • FreshBooks • Intacct • Microsoft Dynamics GP • QuickBooks • QuickBooks Online • QuickBooks Point-Of-Sale • Reckon • Sage 50 UK • Xero Accounting • Kintone • MoneyForward Accounting • Active Directory • Basecamp • Dynamics 365 / AX / GP / NAV • Exact Online • Google Apps • JIRA • Magento • Microsoft Exchange • Microsoft Project • Microsoft SharePoint • NetSuite ERP • Office 365 • SAP NetWeaver • ServiceNow • Smartsheet • Twilio ERP & Collaboration • Amazon Redshift • Apache HBase • Apache Hive • Apache Spark • Azure Cosmos DB • Cassandra • Couchbase • DynamoDB • Elasticsearch • Google BigQuery • IBM Cloudant • MongoDB • MySQL • Redis • SQL Server • xBase NoSQL, Big Data, RDBMS CRM & Marketing • DoubleClick CM / DFP • Google AdWords • Google Analytics • Highrise • HubSpot • Magento • MailChimp • Marketo • Microsoft Dynamics 365 / CRM • NetSuite CRM • Oracle Marketing (Eloqua) • Oracle Sales Cloud • Salesforce.com • SendGrid • SugarCRM • YouTube & Analytics • Zoho CRM Files & Services • Box • CSV/TSV • Email • Excel Files • Google Spreadsheets • JSON • LDAP • OData • XML eCommerce/Finance • Authorize.Net • E*TRADE • PayPal • Quandl • Square more online: www.cdata.com/drivers/ Available Data Sources 200+ SQL-Enabled Drivers
8. © 2019 CData Software Inc. | www.cdata.com Partners & Integrated Applications Broad application to Data Management & Integration Technologies … … … BI & ANALYTICS … … … … … DATA INTEGRATION DATA GOVERNANCE DATA WAREHOUSING AI & MACHINE LEARNING DATA PREPARATION DATA STORAGE DATA VIRTUALIZATION
9. © 2019 CData Software Inc. | www.cdata.com Partners & Customers in Japan Broad application to Data Management & Integration Technologies
10. © 2019 CData Software Inc. | www.cdata.com Provider Considerations How we categorize drivers Protocols SOAP REST OData TCP
11. © 2019 CData Software Inc. | www.cdata.com Provider Considerations How we categorize drivers Data Model Relational Document / NoSQL Key / Value Hierachical Raw Stores
12. © 2019 CData Software Inc. | www.cdata.com Provider Considerations How we categorize drivers Metadata Static Dynamic Hybrid Row-scan
13. © 2019 CData Software Inc. | www.cdata.com Provider Considerations How we categorize drivers Authentication Basic / NTLM / Kerberos API Tokens OAuth / JWT TLS Client Certificates SSO (SAML / OAuth)
14. © 2019 CData Software Inc. | www.cdata.com Provider Considerations How we categorize drivers Capabilities Aggregations Joins Filtering Sorting Paging Bulk Operations
15. © 2019 CData Software Inc. | www.cdata.com Provider Architecture How We Build Our Drivers
16. © 2019 CData Software Inc. | www.cdata.com Technology Stack How We Build Our Drivers • Source Specific Customization Wire-protocol logic is written once to conform to an internal interface • Standards Conformance Connectivity standards (ODBC / JDBC / ADO.NET / Excel /BizTalk etc.), called edition wrappers, are coded on top of an internal interface. • Automation & Code Generation The same wrappers are used for all our drivers, ensuring any client compatibility work is reflected on every single driver.
17. © 2019 CData Software Inc. | www.cdata.com Next-Generation Data Connectivity Full-Featured And Consistent SQL Access To Any Supported Data Source  Comprehensive SQL-92 Engine Support for rich SQL syntax across all of our drivers, deeply nested queries, and an extensive set of SQL filters and formulas. Metadata Discovery Robust Metadata discovery capabilities with extensive schema exploration, including table definitions, columns, keys, data types, & relationships. Replication & Caching Embedded commands make it easy to copy data to local and cloud data stores, such as Oracle, SQL Server, Google Cloud SQL, etc. String, Date, and Numeric Functions A growing set of embedded functions that can manipulate column values into the desired result. Examples include Regex, JSON, and XML processing. Collaborative Query Processing Extends data source capabilities through additional client- side processing, when needed. Enables analytic summaries of data, such as SUM, AVG, MAX, MIN. Embedded Remoting MySQL and TDS wire protocol hosting offers seamless Linked Server access and remote connectivity from other standard drivers.     
18. © 2019 CData Software Inc. | www.cdata.com CData Sync
19. © 2019 CData Software Inc. | www.cdata.com CData Sync Simple-to use ETL tool  100+ SaaS / Cloud data sources  20+ destination connectors
20. © 2019 CData Software Inc. | www.cdata.com Sync Scenarios Source and Destination Connectors for data replication Data archival / Backup Operational reporting BI / Analytics
21. © 2019 CData Software Inc. | www.cdata.com CData Cloud Hub
22. © 2019 CData Software Inc. | www.cdata.com Cloud Hub Secure Cloud Data Integration for SaaS Applications
23. © 2019 CData Software Inc. | www.cdata.com Cloud Hub: MySql / TDS Secure Cloud Data Integration for SaaS Applications • Virtual Databases Each data source connection is a virtual Database. • Compatibility MySql and SQL Server wire protocol compatibility. • Connectivity Wide support for tools like Tableau Online, Bolt BI, AWS QuickSight, Google Data Studio, Looker, Power Apps, and more! • Protocol Support OData v2 / v4. • Data Virtualization Control entities / columns exposed. Access control. • Action support Expose stored procedures from data sources as OData actions. MySQL / TDS OData
24. © 2019 CData Software Inc. | www.cdata.com Q & A Questions?