Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Auralization of road vehicles using spectral mo...
Search
Chinmay Pendharkar
April 08, 2013
Research
0
180
Auralization of road vehicles using spectral modeling synthesis
Masters Thesis presentation on auralization of road vehicles using spectral modeling synthesis
Chinmay Pendharkar
April 08, 2013
Tweet
Share
More Decks by Chinmay Pendharkar
See All by Chinmay Pendharkar
Audio Fundamentals - Pd
notthetup
0
75
DNSSEC and Bind
notthetup
1
130
Garageband And Podcasting
notthetup
0
50
Audio Fundamentals - HTML5 Audio
notthetup
0
99
Audio Fundamentals - Oscillators
notthetup
0
48
Audio Fundamentals - Basics
notthetup
0
100
Robots and Pi
notthetup
2
120
What I’ve learnt about Environmental Sound Design
notthetup
0
210
Audio Editing with Audacity
notthetup
0
55
Other Decks in Research
See All in Research
EarthMarker: A Visual Prompting Multimodal Large Language Model for Remote Sensing
satai
3
340
時系列データに対する解釈可能な 決定木クラスタリング
mickey_kubo
2
700
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
monochromegane
0
250
VAGeo: View-specific Attention for Cross-View Object Geo-Localization
satai
3
380
定性データ、どう活かす? 〜定性データのための分析基盤、はじめました〜 / How to utilize qualitative data? ~We have launched an analysis platform for qualitative data~
kaminashi
6
1k
ウッドスタックチャン:木材を用いた小型エージェントロボットの開発と印象評価 / ec75-sato
yumulab
1
410
ストレス計測方法の確立に向けたマルチモーダルデータの活用
yurikomium
0
570
チャッドローン:LLMによる画像認識を用いた自律型ドローンシステムの開発と実験 / ec75-morisaki
yumulab
1
430
SSII2025 [SS1] レンズレスカメラ
ssii
PRO
2
940
NLP2025 WS Shared Task 文法誤り訂正部門 ehiMetrick
sugiyamaseiji
0
190
電通総研の生成AI・エージェントの取り組みエンジニアリング業務向けAI活用事例紹介
isidaitc
1
220
生成的推薦の人気バイアスの分析:暗記の観点から / JSAI2025
upura
0
180
Featured
See All Featured
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
Code Reviewing Like a Champion
maltzj
524
40k
Automating Front-end Workflow
addyosmani
1370
200k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.6k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2.1k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
48
5.4k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Docker and Python
trallard
44
3.4k
Build The Right Thing And Hit Your Dates
maggiecrowley
36
2.8k
Producing Creativity
orderedlist
PRO
346
40k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
15
1.5k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Transcript
Auralization of road vehicles using spectral modeling synthesis Chinmay Pendharkar,
Applied Acoustics, Chalmers, 2011 Monday, April 8, 13
• LISTEN Project • Auralization • Sound Synthesis • Spectral
Modeling Synthesis (SMS) • SMS Implementation for Vehicle Sounds • Listening Test • Results and Analysis • Q & A Organization Monday, April 8, 13
LISTEN Project Monday, April 8, 13
LISTEN Project • Collaboration - KTH, Konstfack, SU, II. Monday,
April 8, 13
LISTEN Project • Collaboration - KTH, Konstfack, SU, II. •
Software Demonstrator/Simulator Monday, April 8, 13
LISTEN Project • Collaboration - KTH, Konstfack, SU, II. •
Software Demonstrator/Simulator • Qualitative listening of urban soundscapes Monday, April 8, 13
LISTEN Demonstrator Monday, April 8, 13
LISTEN Demonstrator • Auralization of Urban Soundscapes Monday, April 8,
13
LISTEN Demonstrator • Auralization of Urban Soundscapes • Qualitative vs
Quantitative Analysis Monday, April 8, 13
LISTEN Demonstrator • Auralization of Urban Soundscapes • Qualitative vs
Quantitative Analysis Monday, April 8, 13
Auralization • Source + Propagation Monday, April 8, 13
Auralization Monday, April 8, 13
Auralization • Source Modeling Monday, April 8, 13
Auralization • Source Modeling • Vehicles as sound sources. •
Amplitude / Level • Frequency • Directivity • Non-Stationary sound. Monday, April 8, 13
Auralization • Recordings - Large and Inflexible • 6 seconds
- 853KB • For each velocity, vehicle type, ... Monday, April 8, 13
Auralization Monday, April 8, 13
Auralization • What if..? Monday, April 8, 13
Auralization • What if..? • Extract the important ‘features’ Monday,
April 8, 13
Auralization • What if..? • Extract the important ‘features’ •
Calculate waveforms ‘on the fly’ Monday, April 8, 13
Auralization • What if..? • Extract the important ‘features’ •
Calculate waveforms ‘on the fly’ • Parameters to change the sound Vehicle Model Speed Monday, April 8, 13
Sound Synthesis Monday, April 8, 13
Sound Synthesis • Electronic Generation of Audio Waveforms Monday, April
8, 13
Sound Synthesis • Electronic Generation of Audio Waveforms • Model
to Waveform Monday, April 8, 13
Sound Synthesis • Electronic Generation of Audio Waveforms • Model
to Waveform • Computer Music Origin Monday, April 8, 13
Sound Synthesis • Electronic Generation of Audio Waveforms • Model
to Waveform • Computer Music Origin • Current Uses • Electronic Music Production, • Games • Interactive Media Monday, April 8, 13
Sound Synthesis Monday, April 8, 13
Sound Synthesis • Flexible Model Monday, April 8, 13
Sound Synthesis • Flexible • Real Time Model Monday, April
8, 13
Sound Synthesis • Flexible • Real Time • Low Memory
Requirement Model ~10KB vs 1MB Monday, April 8, 13
Sound Synthesis Monday, April 8, 13
Sound Synthesis • Types Monday, April 8, 13
Sound Synthesis • Types • Additive Synthesis Monday, April 8,
13
Sound Synthesis • Types • Additive Synthesis • Frequency Modulation
Synthesis Monday, April 8, 13
Sound Synthesis • Types • Additive Synthesis • Frequency Modulation
Synthesis • Physical Synthesis Monday, April 8, 13
Sound Synthesis • Types • Additive Synthesis • Frequency Modulation
Synthesis • Physical Synthesis • Spectral Modeling Synthesis Monday, April 8, 13
Sound Synthesis Monday, April 8, 13
Sound Synthesis • Vehicle Sounds • Tonal Component - Engine
Noise • Noise Component - Tyre Noise Monday, April 8, 13
Sound Synthesis • Vehicle Sounds • Tonal Component - Engine
Noise • Noise Component - Tyre Noise • Non - Stationary Monday, April 8, 13
Spectral Modeling Synthesis (SMS) Monday, April 8, 13
Spectral Modeling Synthesis (SMS) • Xavier Serra and Julius Smith,
1990 Monday, April 8, 13
Spectral Modeling Synthesis (SMS) • Xavier Serra and Julius Smith,
1990 • Modeling musical instruments Monday, April 8, 13
Spectral Modeling Synthesis (SMS) • Xavier Serra and Julius Smith,
1990 • Modeling musical instruments • Deterministic + Stochastic Decomposition Monday, April 8, 13
Spectral Modeling Synthesis (SMS) • Xavier Serra and Julius Smith,
1990 • Modeling musical instruments • Deterministic + Stochastic Decomposition • Tonal Sounds + Noise Monday, April 8, 13
SMS Demo Monday, April 8, 13
SMS Demo • Original • Tonal (Deterministic) • Noise (Stochastic)
• ReSynthesis Monday, April 8, 13
SMS Demo • Original • Tonal (Deterministic) • Noise (Stochastic)
• ReSynthesis Monday, April 8, 13
SMS Demo • Original • Tonal (Deterministic) • Noise (Stochastic)
• ReSynthesis Monday, April 8, 13
SMS Demo • Original • Tonal (Deterministic) • Noise (Stochastic)
• ReSynthesis Monday, April 8, 13
SMS Demo • Original • Tonal (Deterministic) • Noise (Stochastic)
• ReSynthesis Monday, April 8, 13
• LISTEN Project • Auralization • Sound Synthesis • Spectral
Modeling Synthesis (SMS) • SMS Implementation for Vehicle Sounds • Listening Test • Results and Analysis • Q & A Organization Monday, April 8, 13
SMS Algorithm STFT Analysis Original Audio Peak Detection Peak Tracking
Peak Trajectories Tonal ReSynth Residual Audio Residual Parameterization Residual Parameters Noise ReSynth ReSynth Audio Monday, April 8, 13
SMS Algorithm STFT Analysis Original Audio Peak Detection Peak Tracking
Peak Trajectories Tonal ReSynth Residual Audio Residual Parameterization Residual Parameters Noise ReSynth ReSynth Audio Tonal Analysis Monday, April 8, 13
SMS Algorithm STFT Analysis Original Audio Peak Detection Peak Tracking
Peak Trajectories Tonal ReSynth Residual Audio Residual Parameterization Residual Parameters Noise ReSynth ReSynth Audio Tonal Analysis Noise Analysis Monday, April 8, 13
SMS Algorithm STFT Analysis Original Audio Peak Detection Peak Tracking
Peak Trajectories Tonal ReSynth Residual Audio Residual Parameterization Residual Parameters Noise ReSynth ReSynth Audio Tonal Analysis Noise Analysis Synthesis Monday, April 8, 13
SMS Algorithm Tonal Analysis • Original Audio - Peak Trajectories
STFT Analysis Original Audio Peak Detection Peak Tracking Peak Trajectories Monday, April 8, 13
SMS Algorithm STFT Monday, April 8, 13
SMS Algorithm STFT • Short Term Fourier Transform (STFT) Monday,
April 8, 13
SMS Algorithm STFT • Short Term Fourier Transform (STFT) •
Fourier Analysis of Short Time Instances Monday, April 8, 13
SMS Algorithm STFT • Short Term Fourier Transform (STFT) •
Fourier Analysis of Short Time Instances • Sliding Window Analysis Monday, April 8, 13
SMS Algorithm Peak Detection Monday, April 8, 13
SMS Algorithm Peak Detection • Gradient Based Detection Monday, April
8, 13
SMS Algorithm Peak Detection • Gradient Based Detection Monday, April
8, 13
SMS Algorithm Peak Detection • Gradient Based Detection Monday, April
8, 13
SMS Algorithm Peak Detection • Gradient Based Detection • Interpolation
due to DFT Sampling. Monday, April 8, 13
SMS Algorithm Peak Detection • Gradient Based Detection • Interpolation
due to DFT Sampling. Monday, April 8, 13
SMS Algorithm Peak Tracking Monday, April 8, 13
SMS Algorithm Peak Tracking • Frequency Guides - Peak Trajectories
Monday, April 8, 13
SMS Algorithm Peak Tracking • Frequency Guides - Peak Trajectories
• Gradually Varying Sinusoids Monday, April 8, 13
SMS Algorithm Peak Tracking • Frequency Guides - Peak Trajectories
• Gradually Varying Sinusoids • Doppler Shift Monday, April 8, 13
SMS Algorithm Peak Tracking • Frequency Guides - Peak Trajectories
• Gradually Varying Sinusoids • Doppler Shift Monday, April 8, 13
SMS Algorithm Peak Trajectories Monday, April 8, 13
SMS Algorithm Noise Analysis • Original Audio & Tonal Synthesis
- Residual Parameters Original Audio Peak Trajectories Tonal ReSynth Residual Audio Residual Parameterization Residual Parameters Monday, April 8, 13
SMS Algorithm Residual Calculation Monday, April 8, 13
SMS Algorithm Residual Calculation • Original - Tonal = Residual
Monday, April 8, 13
SMS Algorithm Residual Calculation • Original - Tonal = Residual
• Spectrum Subtraction Monday, April 8, 13
SMS Algorithm Residual Calculation • Original - Tonal = Residual
• Spectrum Subtraction Monday, April 8, 13
SMS Algorithm Residual Parameterization Monday, April 8, 13
SMS Algorithm Residual Parameterization • Perceptual Model Monday, April 8,
13
SMS Algorithm Residual Parameterization • Perceptual Model • Noise Energy
per Critical Band Monday, April 8, 13
SMS Algorithm Residual Parameterization • Perceptual Model • Noise Energy
per Critical Band Monday, April 8, 13
SMS Algorithm - Residual Parameters Monday, April 8, 13
SMS Algorithm Complete Model Monday, April 8, 13
SMS Algorithm Complete Model • Peak Trajectories Monday, April 8,
13
SMS Algorithm Complete Model • Peak Trajectories Monday, April 8,
13
SMS Algorithm Complete Model • Peak Trajectories • Residual Parameters
Monday, April 8, 13
SMS Algorithm Complete Model • Peak Trajectories • Residual Parameters
Monday, April 8, 13
SMS Algorithm Complete Model • Peak Trajectories • Residual Parameters
6 seconds - 80KB Monday, April 8, 13
SMS Algorithm Synthesis • Peak Trajectories - Tonal Sound •
Residual Parameters - Noise Peak Trajectories Tonal ReSynth Residual Parameters Noise ReSynth ReSynth Audio Monday, April 8, 13
SMS Algorithm Tonal Synthesis Monday, April 8, 13
SMS Algorithm Tonal Synthesis • Peak Trajectories - Sinusoid Waveform
Monday, April 8, 13
SMS Algorithm Tonal Synthesis • Peak Trajectories - Sinusoid Waveform
• x[n] = A[n]*cos(w[n]) Monday, April 8, 13
SMS Algorithm Tonal Synthesis • Peak Trajectories - Sinusoid Waveform
• x[n] = A[n]*cos(w[n]) + + = = Monday, April 8, 13
SMS Algorithm Residual Synthesis Monday, April 8, 13
SMS Algorithm Residual Synthesis • Residual Parameters - Noise Monday,
April 8, 13
SMS Algorithm Residual Synthesis • Residual Parameters - Noise •
Interpolation Monday, April 8, 13
SMS Algorithm Residual Synthesis • Residual Parameters - Noise •
Interpolation • Random Phase Assignment Monday, April 8, 13
SMS Algorithm Residual Synthesis • Residual Parameters - Noise •
Interpolation • Random Phase Assignment • Inverse Fourier Transform Monday, April 8, 13
SMS Algorithm Residual Synthesis • Residual Parameters - Noise •
Interpolation • Random Phase Assignment • Inverse Fourier Transform • Overlap and Add Synthesis Monday, April 8, 13
SMS Algorithm Residual Synthesis • Overlap and Add Synthesis Monday,
April 8, 13
SMS Algorithm STFT Analysis Original Audio Peak Detection Peak Tracking
Peak Trajectories Tonal ReSynth Residual Audio Residual Parameterization Residual Parameters Noise ReSynth ReSynth Audio Tonal Analysis Noise Analysis Synthesis Monday, April 8, 13
• LISTEN Project • Auralization • Sound Synthesis • Spectral
Modeling Synthesis (SMS) • SMS Implementation for Vehicle Sounds • Listening Test • Results and Analysis • Q & A Organization Monday, April 8, 13
SMS for Vehicle Sounds • Multi Pass Analysis • Trajectory
Energy Filtering • Residual parameter smoothing Monday, April 8, 13
SMS for Vehicle Sounds • Multi Pass Analysis • Analysis
Window - Frequency Dependence Monday, April 8, 13
SMS for Vehicle Sounds • Multi Pass Analysis - Pyramid
Analysis • Vary window length for each ‘Pass’ Monday, April 8, 13
SMS for Vehicle Sounds Monday, April 8, 13
SMS for Vehicle Sounds • Multi Pass Analysis Monday, April
8, 13
SMS for Vehicle Sounds • Multi Pass Analysis • Frequency
band - Pass Monday, April 8, 13
SMS for Vehicle Sounds • Multi Pass Analysis • Frequency
band - Pass Pass 1 Pass 2 Pass 3 Monday, April 8, 13
SMS for Vehicle Sounds • Trajectory Energy Filtering • Too
many trajectories - Filter by ‘Importance’ Monday, April 8, 13
SMS for Vehicle Sounds Monday, April 8, 13
SMS for Vehicle Sounds • Fluctuating Residual Parameter Monday, April
8, 13
SMS for Vehicle Sounds • Fluctuating Residual Parameter • Smoothen
Monday, April 8, 13
SMS for Vehicle Sounds • Fluctuating Residual Parameter • Smoothen
Monday, April 8, 13
SMS on Vehicle Sounds • Bus (39km/h) • Original •
Tonal • Noise • ReSynth Monday, April 8, 13
SMS on Vehicle Sounds • Bus (39km/h) • Original •
Tonal • Noise • ReSynth Monday, April 8, 13
SMS on Vehicle Sounds • Bus (39km/h) • Original •
Tonal • Noise • ReSynth Monday, April 8, 13
SMS on Vehicle Sounds • Bus (39km/h) • Original •
Tonal • Noise • ReSynth Monday, April 8, 13
SMS on Vehicle Sounds • Bus (39km/h) • Original •
Tonal • Noise • ReSynth Monday, April 8, 13
SMS on Vehicle Sounds • Open Astra (45 km/h) •
Volvo V70 (50 km/h) • IV Medium-Heavy (40km/h) • Bus (86km/h) Monday, April 8, 13
SMS on Vehicle Sounds • Open Astra (45 km/h) •
Volvo V70 (50 km/h) • IV Medium-Heavy (40km/h) • Bus (86km/h) Monday, April 8, 13
SMS on Vehicle Sounds • Open Astra (45 km/h) •
Volvo V70 (50 km/h) • IV Medium-Heavy (40km/h) • Bus (86km/h) Monday, April 8, 13
SMS on Vehicle Sounds • Open Astra (45 km/h) •
Volvo V70 (50 km/h) • IV Medium-Heavy (40km/h) • Bus (86km/h) Monday, April 8, 13
SMS on Vehicle Sounds • Open Astra (45 km/h) •
Volvo V70 (50 km/h) • IV Medium-Heavy (40km/h) • Bus (86km/h) Monday, April 8, 13
• LISTEN Project • Auralization • Sound Synthesis • Spectral
Modeling Synthesis (SMS) • SMS Implementation for Vehicle Sounds • Listening Test • Results and Analysis • Q & A Organization Monday, April 8, 13
Listening Test Monday, April 8, 13
Listening Test • Perceptual Similarity of Sounds Monday, April 8,
13
Listening Test • Perceptual Similarity of Sounds • 18 Sounds
- 72 Combination Monday, April 8, 13
Listening Test • Perceptual Similarity of Sounds • 18 Sounds
- 72 Combination • Paired Sound Test Monday, April 8, 13
Listening Test • Perceptual Similarity of Sounds • 18 Sounds
- 72 Combination • Paired Sound Test • 3 Questions • Realism • Annoyance • Speed Monday, April 8, 13
Listening Test • Perceptual Similarity of Sounds • 18 Sounds
- 72 Combination • Paired Sound Test • 3 Questions • Realism • Annoyance • Speed • 27 Participants Monday, April 8, 13
Listening Test Results Monday, April 8, 13
Listening Test Results • Significant Difference Match Pair t-test -
90% Monday, April 8, 13
Spectral Analysis Monday, April 8, 13
• LISTEN Project • Auralization • Sound Synthesis • Spectral
Modeling Synthesis (SMS) • SMS Implementation for Vehicle Sounds • Listening Test • Results and Analysis • Q & A Organization Monday, April 8, 13
Analysis - Applications Monday, April 8, 13
Analysis - Applications • Applying propagation to Sound Model Monday,
April 8, 13
Analysis - Applications • Applying propagation to Sound Model •
Direct Frequency-Domain Changes Monday, April 8, 13
Analysis - Applications • Applying propagation to Sound Model •
Direct Frequency-Domain Changes • Less Memory Requirement Monday, April 8, 13
Analysis - Applications • Applying propagation to Sound Model •
Direct Frequency-Domain Changes • Less Memory Requirement • Interaction Real-Time Synthesis Monday, April 8, 13
Analysis - Applications Monday, April 8, 13
Analysis - Applications • Binaural calculation of propagation Monday, April
8, 13
Analysis - Applications • Binaural calculation of propagation • Multiple
source height - issue Monday, April 8, 13
Analysis - Applications • Binaural calculation of propagation • Multiple
source height - issue • SMS can ‘separate’ engine and tyre Monday, April 8, 13
Conclusion Monday, April 8, 13
Conclusion • SMS works great for vehicle sounds. Monday, April
8, 13
Conclusion • SMS works great for vehicle sounds. • Less
memory and more flexible Monday, April 8, 13
Conclusion • SMS works great for vehicle sounds. • Less
memory and more flexible • Fine tuning for effectively and efficiency. Monday, April 8, 13
Conclusion • SMS works great for vehicle sounds. • Less
memory and more flexible • Fine tuning for effectively and efficiency. • Can produce perceptually similar sounds. Monday, April 8, 13
Future Work Monday, April 8, 13
Future Work • Automated Parameter Estimation Monday, April 8, 13
Future Work • Automated Parameter Estimation • Improved Noise Model
Monday, April 8, 13
Future Work • Automated Parameter Estimation • Improved Noise Model
• Transients Modeling Monday, April 8, 13
Future Work • Automated Parameter Estimation • Improved Noise Model
• Transients Modeling • Support for Binaural Propagation calculation Monday, April 8, 13
Thanks! Monday, April 8, 13