Importance of collaboration among programmers and data scientists by Rafael del Hoyo & Jorge Vea-murguía at Big Data Spain 2015

El gran auge de arquitecturas distribuidas, tales como Spark, está haciendo posible la creación de nuevas y avanzadas aplicaciones de toma de decisiones basadas en el procesamiento de datos en tiempo real (Streaming Analytics). En el desarrollo de estas nuevas aplicaciones aparece una “nueva” figura (o antigua depende el enfoque realizado), el denominado científico de datos. Su principal rol, aunque no el único), es la generación del modelo que permita la extracción de conocimiento a partir de los datos existentes. Por otra parte, existe el desarrollador de soluciones o equipo de desarrollo que se ocupa de integrar el modelo/s desarrollados en la solución o software preexistente o en el software nuevo a realizar. La colaboración de ambos es vital para cerrar en tiempo y presupuesto el desarrollo de esa nueva herramienta de toma de decisiones.

Session presented at Big Data Spain 2015 Conference
16th Oct 2015
Kinépolis Madrid
http://www.bigdataspain.org
Event promoted by: http://www.paradigmatecnologico.com
Abstract: http://www.bigdataspain.org/program/fri/slot-36.html#spch36.1

Transcript

2. Importance of collaboration among Programmers and Data Scientists #1 ITAINNOVA at the 4thED BIG DATA Spain @ITAINNOVA · www.itainnova.es · #BDS15 Jorge Vea Murguía jveamurguia@itainnova.es Rafael del Hoyo rdelhoyo@itainnova.es @neuralconcept
3. Importance of collaboration among Programmers and Data Scientists @ITAINNOVA · www.itainnova.es · #BDS15 DEVELOP A COOL ADVANCED INTELLIGENT SERVICE ITAINNOVA at the 4thED BIG DATA Spain
4. Importance of collaboration among Programmers and Data Scientists @ITAINNOVA · www.itainnova.es · #BDS15 Data Scientist I love Data I like to make new algorithms to discover patterns and program in R, Matlan and Mathematica. Deep Learning is the future and I can do anything with Python ITAINNOVA at the 4thED BIG DATA Spain
5. Importance of collaboration among Programmers and Data Scientists @ITAINNOVA · www.itainnova.es · #BDS15 Programmer I know a lot of different programming languages as java , sql, c++ , also the latest technologies of BigData Spark, Map-Reduce, mongodb. Also known design patterns, I love SOA, and to build distributed architectures, I like in my home to integrate different systems, with different OS I use Agile methodologies of development ITAINNOVA at the 4thED BIG DATA Spain
6. Collaboration Problem: Content @ITAINNOVA · www.itainnova.es · #BDS15 Programmer vs Data Scientis SOA, Orient Object programming, BPMN, Design Patterns Neural Networks, Artificial Intelligent, Statistics, Semantics ITAINNOVA at the 4thED BIG DATA Spain
7. Collaboration Problem: Programming Language @ITAINNOVA · www.itainnova.es · #BDS15 Programmer vs Data Scientis HTML, JAVASCRIPT, JAVA, C++, J2EE Matlab, R, Python ITAINNOVA at the 4thED BIG DATA Spain
8. Collaboration Problem: Legacy Systems @ITAINNOVA · www.itainnova.es · #BDS15 Programmer vs Data Scientis JAVA, C++, J2EE ITAINNOVA at the 4thED BIG DATA Spain
9. SOLUTION A ITAINNOVA at the 4thED BIG DATA Spain @ITAINNOVA · www.itainnova.es · #BDS15 Programmer vs Data Scientis I learn JAVA, J2EE, C++ SOA … I learn Semantic Processing, Artificial Intelligent, R
10. Solution ITAINNOVA ITAINNOVA at the 4thED BIG DATA Spain @ITAINNOVA · www.itainnova.es · #BDS15 Collaboration among Programmers and Data Scientists Need for New Tools • Ecosystem Spark • Ease to use • Graphical view • BPMN Business language description • Ease conversion algorithms as a service (SOA)
11. Importance of collaboration among Programmers and Data Scientists #1 ITAINNOVA at the 4thED BIG DATA Spain @ITAINNOVA · www.itainnova.es · #BDS15 Importance of collaboration among Programmers and Data Scientists #1 ITAINNOVA at the 4thED BIG DATA Spain @ITAINNOVA · www.itainnova.es · #BDS15 SEDE CENTRAL ITAINNOVA Instituto Tecnológico de Aragón María de Luna, 7-8 50018 Zaragoza (Spain) Tfno: +34 976 010 000 moriarty@itainnova.es Rafa del Hoyo rdelhoyo@itainnova.es @neuralconcept Jorge Vea-murguía jveamurguia@itainnova.es