Slide 1

Slide 1 text

Operational Intelligence Nuwan Bandara Solutions Architect - WSO2 @nuwanbando

Slide 2

Slide 2 text

Data, Information & Knowledge http://spreadgoodpractice.blogspot.com/2010/12/model-4-data-information-knowledge.html

Slide 3

Slide 3 text

Producers of data movement temp power institute people storage servers applications POS router camera vibration

Slide 4

Slide 4 text

Produces of information

Slide 5

Slide 5 text

Knowledge o Deriving meaning from information o Co-relation o Historical analysis o Mathematical analysis o Model driven analysis o Graphs & charts based comparison

Slide 6

Slide 6 text

Wisdom o Act upon knowledge o Business decisions (when to invest / when to withdraw) o When to compete o Tactics and strategies o Automated decision making o Triggering alerts / email / SMS o Device control (Temperature control / traffic control etc.) o Failover decision making o Elastic scaling decision making

Slide 7

Slide 7 text

So what is intelligence o Collective correlated knowledge which enables informed decision (wisdom) making https://dmaiph.wordpress.com/2015/01/28/time-consuming-tasks-your-small-business-should- outsource/

Slide 8

Slide 8 text

Looking back at data collection o Collecting right (?) data is the key o Collection method is important o Storing the un-sorted, need a proper thought process

Slide 9

Slide 9 text

Operational data o The type of data that is core to the system of operation resource usage of the cloud container useage app usage App Cloud Echosystem raw material product manufature material inventory demand statistics product inventory Manufacturing Plant

Slide 10

Slide 10 text

Conversion of data to information o Data correlation o Data graphs and trees o Application of dimensions o Summarization o Data dictionary reference

Slide 11

Slide 11 text

When should we posses information o At all stages of the operation o i.e.: An application pushed through development, testing, staging and production lifecycle o At each stage the knowledge we gather is different, hence information has a different shape at each step

Slide 12

Slide 12 text

An example o Deploying an elastically scaling middleware platform for application development & integration app server bus api gateway elastic nodes / containers data nodes

Slide 13

Slide 13 text

The application o Class / package dependencies & associations o Exception / stack trace logs o Memory / load statistics o Database connection statistics o JMX channel data on garbage collection / deadlocks / heap usage etc. Package (p0) Class (cp0) Package (p1) Class (cp1) Package (p1) Class (cp1) data bridge / event receiver exception / error logs memory / load stats JMX application

Slide 14

Slide 14 text

Application server & server container o Server logs o JMX channel data of the server o Server health check o Memory / processor / network usage o Response times o Container health o Container load o Container storage space stats application (a1) service (s2) service (s1) server logs server JMX container stats server response time container app server data bridge / event receiver

Slide 15

Slide 15 text

Integration platform o Mediation statistics o Workflow statistics o Data services query history / audit o MQ statistics o Container statistics o Integration platform latency o Request-response log containers c1 c2 c3 c4 cn bps log esb log kafka log data bridge / event receiver

Slide 16

Slide 16 text

API platform o Load balancer logs – container routing / fail-over stats o API subscriber statistics o API usage statistics o API lifecycle statistics containers c1 c2 c3 cn load balancer data bridge / event receiver api gateway api store api publisher API subscriber stats LB logs container stats API usage stats API lifecycle stats

Slide 17

Slide 17 text

Information factory data bridge / event receiver realtime near realtime / batch realtime info feed summarized / co-related feed

Slide 18

Slide 18 text

Knowledge factory data bridge / event receiver realtime near realtime / batch realtime info feed summarized / co-related feed Machine learning lambda loop back loop back intelegence ML feed back ML feed back

Slide 19

Slide 19 text

Decision enablers data bridge / event receiver realtime near realtime / batch realtime info feed summarized / co-related feed Machine learning lambda loop back loop back intelegence ML feed back ML feed back integration engine APIs dashboards topics

Slide 20

Slide 20 text

Operational intelligence reference model application (a1) service (s2) service (s1) server logs server JMX container stats server response time app server data bridge / event receiver containers c1 c2 c3 c4 cn bps log esb log kafka log data bridge / event receiver containers c1 c2 c3 cn load balancer api gateway api store api publisher API subscriber stats LB logs container stats API usage stats API lifecycle stats realtime near realtime / batch realtime info feed summarized / co-related feed Machine learning lambda loop back loop back intelegence ML feed back ML feed back integration engine APIs dashboards topics

Slide 21

Slide 21 text

Knowledge is power "Technology is so much fun but we can drown in our technology. The fog of information can drive out knowledge." -- Daniel J. Boorstin

Slide 22

Slide 22 text

//Questions ? Thank You