Smart XML Platform

Smart XML Platform is a solution for companies that have to validate, verify and process huge amounts of data stored in XML files.

Transcript

1. Smart XML Platform XML files ingestion and calculation powered by Cloudera Ecosystem
2. Introduction oThere is plenty of tools for handling data in JSON oMany companies still keep their data in XML format oIn XML you have a default way to validate against a schema
3. Business use case oToday companies have terabytes of data oUsually stored in XML files oFiles have to be validated against an XSD schema oWe also need a logical validation: is the information coherent with other data?
4. Smart XML Platform Three steps: oReading the data oPerform business logic oValidation oAggregation oWrite the result on HDFS
5. We made it FAST oIt runs on Cloudera Distribution including Hadoop (CDH) oArchive files are partitioned on HDFS oRead and analyzed with Apache Spark
6. Ingestion and Calculation Flow
7. Workflow Ingestion Processing Persistence
8. A flexible solution oProvide the XML Schema Definition File (XSD) oSmart XML Engine will analyze data formats oSpecify additional business constraints using JSON oSpecify processing operations via another JSON file oReady to go!
9. The dashboard