Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
VISP Testbed - A Toolkit for Modeling and Evalu...
Search
Christoph Hochreiner
February 13, 2017
Research
0
230
VISP Testbed - A Toolkit for Modeling and Evaluating Resource Provisioning Algorithms for Stream Processing Applications
Presentation at the ZEUS workshop 2017 in Lugano, Switzerland.
Christoph Hochreiner
February 13, 2017
Tweet
Share
More Decks by Christoph Hochreiner
See All by Christoph Hochreiner
PhD Defense
chochreiner
0
290
Nomadic Applications Traveling in the Fog
chochreiner
0
210
Bridging Gaps in Cloud Manufacturing with 3D Printing
chochreiner
0
380
VISP: An Ecosystem for Elastic Data Stream Processing for the Internet of Things
chochreiner
0
480
Elastic Stream Processing for the Internet of Things
chochreiner
0
450
Cost-Efficient Scheduling Of Elastic Processes In Hybrid Clouds
chochreiner
1
310
Privacy-Aware Scheduling for Inter-Organizational Processes
chochreiner
0
100
Other Decks in Research
See All in Research
論文紹介: COSMO: A Large-Scale E-commerce Common Sense Knowledge Generation and Serving System at Amazon (SIGMOD 2024)
ynakano
1
420
Neural Fieldの紹介
nnchiba
2
740
CoRL2024サーベイ
rpc
2
1.7k
AWS 音声基盤モデル トーク解析AI MiiTelの音声処理について
ken57
0
150
ことばの意味を計算するしくみ
verypluming
9
1.4k
o1 pro mode の調査レポート
smorce
0
130
医療支援AI開発における臨床と情報学の連携を円滑に進めるために
moda0
0
160
博士学位論文予備審査 / Scaling Telemetry Workloads in Cloud Applications: Techniques for Instrumentation, Storage, and Mining
yuukit
1
1.7k
言語と数理の交差点:テキストの埋め込みと構造のモデル化 (IBIS 2024 チュートリアル)
yukiar
5
1.1k
非ガウス性と非線形性に基づく統計的因果探索
sshimizu2006
0
570
大規模日本語VLM Asagi-VLMにおける合成データセットの構築とモデル実装
kuehara
5
1.3k
Building Height Estimation Using Shadow Length in Satellite Imagery
satai
3
230
Featured
See All Featured
Gamification - CAS2011
davidbonilla
80
5.2k
Done Done
chrislema
182
16k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
356
29k
Designing for humans not robots
tammielis
250
25k
YesSQL, Process and Tooling at Scale
rocio
172
14k
Mobile First: as difficult as doing things right
swwweet
223
9.5k
Faster Mobile Websites
deanohume
306
31k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
251
21k
Raft: Consensus for Rubyists
vanstee
137
6.8k
Designing Experiences People Love
moore
140
23k
Transcript
VISP TESTBED A Toolkit for Modeling and Evaluating Resource Provisioning
Algorithms for Stream Processing Applications Christoph Hochreiner
Motivation
Stream Processing Application 3 Temperature Filter (1) Transform Data (3)
Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Data Sensor Temperature Sensor Stream Processing Operator Data Transmission Manufacturing Machine
Stream Processing Application Deployment 4 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 4 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 5 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 5 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 6 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 6 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Steps to design resource provisioning algorithms 7 Design algorithm Evaluate
algorithm Benchmark algorithm
VISP Testbed
VISP Testbed 9 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Process streaming data
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Route streaming data
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Provision computational resources
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Monitor activities
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Optimize resource provisioning
VISP Runtime - Base Line Algorithms ‣ Fixed Provisioning -
Over Provisioning - Under Provisioning ‣ Threshold Based Provisioning - CPU - Memory - Queue Size 11 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
VISP Runtime - Topologies 12 Operator 1 Operator 2 Operator
4 Source Sink Operator 3 Operator 1 Operator 2 Operator 3 Source Sink Distance Speed Average Speed Aggregation Analysis Manufacturing Machine Manufacturing Machine Manufacturing Machine Calculate Performance (O3) Calculate Availability (O4) Calculate Quality (O5) Monitor Temperature (O6) Calculate OEE (O7) Filter Availability (O2) Generate Report (O9) Inform User (O8) Distribute Data (O1) Availability Sensor (S1) Production Sensor (S2) Temperature Sensor (S3) Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Data Provider Replay data streams with ‣ predefined arrival pattern
at ‣ predefined generation velocities with ‣ predefined volumes and ‣ predefined message structures. 13 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Data Provider - Arrival Pattern 14 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Real World Arrival
Data Provider - Arrival Pattern 15 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Constant Arrival Real World Arrival
Data Provider - Arrival Pattern 16 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Constant Increase Real World Arrival
Data Provider - Arrival Pattern 17 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Pulsating Arrival Real World Arrival
Data Provider - Arrival Pattern 18 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Spikes Real World Arrival
Data Provider - Arrival Pattern 19 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Constant Arrival Constant Increase Pulsating Arrival Spikes Real World Arrival
Data Provider - Message Structures ‣ Simple messages to trigger
data processing events ‣ GPS time-series from taxis ‣ Sensor data from manufacturing machines 20 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Reporting ‣ Aggregate information from monitoring data ‣ Generate KPIs
‣ Generate figures 21 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Reporting 22 Data Provider VISP Runtime Data Processing Resource Provisioning
Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Conclusion
Conclusion VISP Testbed provides a toolkit ‣to replay data streams
and reproduce evaluation results ‣to benchmark custom resource provisioning algorithm against existing ones 24
Outlook
Outlook ‣Increase benchmark algorithm library ‣Increase topology library and stream
processing operator library ‣Integrate topologies and data from the DEBS Grand Challenges ‣Provide the VISP Testbed as a Service 26
Q & A Christoph Hochreiner c.hochreiner@infosys.tuwien.ac.at https://github.com/visp-streaming/