Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
VISP Testbed - A Toolkit for Modeling and Evalu...
Search
Christoph Hochreiner
February 13, 2017
Research
0
250
VISP Testbed - A Toolkit for Modeling and Evaluating Resource Provisioning Algorithms for Stream Processing Applications
Presentation at the ZEUS workshop 2017 in Lugano, Switzerland.
Christoph Hochreiner
February 13, 2017
Tweet
Share
More Decks by Christoph Hochreiner
See All by Christoph Hochreiner
PhD Defense
chochreiner
0
330
Nomadic Applications Traveling in the Fog
chochreiner
0
210
Bridging Gaps in Cloud Manufacturing with 3D Printing
chochreiner
0
380
VISP: An Ecosystem for Elastic Data Stream Processing for the Internet of Things
chochreiner
0
510
Elastic Stream Processing for the Internet of Things
chochreiner
0
470
Cost-Efficient Scheduling Of Elastic Processes In Hybrid Clouds
chochreiner
1
310
Privacy-Aware Scheduling for Inter-Organizational Processes
chochreiner
0
100
Other Decks in Research
See All in Research
Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagery
satai
3
490
利用シーンを意識した推薦システム〜SpotifyとAmazonの事例から〜
kuri8ive
1
210
Type Theory as a Formal Basis of Natural Language Semantics
daikimatsuoka
1
240
Looking for Escorts in Sydney?
lunsophia
1
120
プロシェアリング白書2025_PROSHARING_REPORT_2025
circulation
1
890
EOGS: Gaussian Splatting for Efficient Satellite Image Photogrammetry
satai
4
300
AI エージェントを活用した研究再現性の自動定量評価 / scisci2025
upura
1
120
(NULLCON Goa 2025)Windows Keylogger Detection: Targeting Past and Present Keylogging Techniques
asuna_jp
2
540
SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagery
satai
3
220
RapidPen: AIエージェントによるペネトレーションテスト 初期侵入全自動化の研究
laysakura
0
1.6k
Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
satai
3
220
ストレス計測方法の確立に向けたマルチモーダルデータの活用
yurikomium
0
720
Featured
See All Featured
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
181
54k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Unsuck your backbone
ammeep
671
58k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
138
34k
Facilitating Awesome Meetings
lara
54
6.4k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.3k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2.1k
The Cult of Friendly URLs
andyhume
79
6.5k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
Visualization
eitanlees
146
16k
Transcript
VISP TESTBED A Toolkit for Modeling and Evaluating Resource Provisioning
Algorithms for Stream Processing Applications Christoph Hochreiner
Motivation
Stream Processing Application 3 Temperature Filter (1) Transform Data (3)
Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Data Sensor Temperature Sensor Stream Processing Operator Data Transmission Manufacturing Machine
Stream Processing Application Deployment 4 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 4 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 5 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 5 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 6 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Stream Processing Application Deployment 6 Temperature Filter (1) Transform Data
(3) Calculate OEE (4) Update Dashboard (5) Analyze Temperature (2) Production Da Temperature Stream Proce Operator Data Transmis Manufacturin Machine Incoming Data Time 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 3 4 3 4 3 4 1 2 5 3 4 1 Stream Processing Operator Computational Resources
Steps to design resource provisioning algorithms 7 Design algorithm Evaluate
algorithm Benchmark algorithm
VISP Testbed
VISP Testbed 9 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Process streaming data
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Route streaming data
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Provision computational resources
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Monitor activities
VISP Runtime 10 Data Provider VISP Runtime Data Processing Resource
Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies Optimize resource provisioning
VISP Runtime - Base Line Algorithms ‣ Fixed Provisioning -
Over Provisioning - Under Provisioning ‣ Threshold Based Provisioning - CPU - Memory - Queue Size 11 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
VISP Runtime - Topologies 12 Operator 1 Operator 2 Operator
4 Source Sink Operator 3 Operator 1 Operator 2 Operator 3 Source Sink Distance Speed Average Speed Aggregation Analysis Manufacturing Machine Manufacturing Machine Manufacturing Machine Calculate Performance (O3) Calculate Availability (O4) Calculate Quality (O5) Monitor Temperature (O6) Calculate OEE (O7) Filter Availability (O2) Generate Report (O9) Inform User (O8) Distribute Data (O1) Availability Sensor (S1) Production Sensor (S2) Temperature Sensor (S3) Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Data Provider Replay data streams with ‣ predefined arrival pattern
at ‣ predefined generation velocities with ‣ predefined volumes and ‣ predefined message structures. 13 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Data Provider - Arrival Pattern 14 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Real World Arrival
Data Provider - Arrival Pattern 15 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Constant Arrival Real World Arrival
Data Provider - Arrival Pattern 16 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Constant Increase Real World Arrival
Data Provider - Arrival Pattern 17 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Pulsating Arrival Real World Arrival
Data Provider - Arrival Pattern 18 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Spikes Real World Arrival
Data Provider - Arrival Pattern 19 Data Provider VISP Runtime
Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies 0 5 10 15 20 0 5 10 15 20 25 30 35 Data Volume Time Constant Arrival Constant Increase Pulsating Arrival Spikes Real World Arrival
Data Provider - Message Structures ‣ Simple messages to trigger
data processing events ‣ GPS time-series from taxis ‣ Sensor data from manufacturing machines 20 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Reporting ‣ Aggregate information from monitoring data ‣ Generate KPIs
‣ Generate figures 21 Data Provider VISP Runtime Data Processing Resource Provisioning Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Reporting 22 Data Provider VISP Runtime Data Processing Resource Provisioning
Resource Optimization QoS Monitoring Activity Tracking Reporting Graph Generation Data Aggregation KPI Calculation Monitoring Data Monitoring Data Data Stream Arrival Pattern Generation Speed Generation Duration Baseline Algorithm Custom Algorithm Topologies
Conclusion
Conclusion VISP Testbed provides a toolkit ‣to replay data streams
and reproduce evaluation results ‣to benchmark custom resource provisioning algorithm against existing ones 24
Outlook
Outlook ‣Increase benchmark algorithm library ‣Increase topology library and stream
processing operator library ‣Integrate topologies and data from the DEBS Grand Challenges ‣Provide the VISP Testbed as a Service 26
Q & A Christoph Hochreiner
[email protected]
https://github.com/visp-streaming/