Crafting Instruments In Code

Links https://github.com/josephwilk/presentations/blob/master/2018/craft/README.md

Transcript

1. Crafting Instruments in code @josephwilk https://en.wikipedia.org/wiki/Silver_Apples
2. @repl_electric http://www.repl-electric.com
3. http://www.repl-electric.com @repl_electric
4. http://www.repl-electric.com @repl_electric
5. Noise Silver Apples
6. Samples “Real-world noise of any sort has a very wide frequency range, far wider and more complex than any electronically generated sound.” Jon Hopkins https://en.wikipedia.org/wiki/Jon_Hopkins
7. Channel (Right) Channel (Left) Frames 44100 1 second Sample 16bits Frame n+1 Frame n+3 Frame n+4 Frame n Frame n+2 176k Sample 16bits Amplitude of sound wave Stereo http://soundfile.sapp.org/doc/WaveFormat/
8. Samples as DATA [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.4 0.5 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.3 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.3 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.1 0.6 0.3 0.5 0.3 0.2 0.4 0.3 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.5 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.5 0.1 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.2 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.5 0.1 0.5 0.3 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.1 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 [0.5 0.2 0.3 0.5 0.3 0.2 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] .3 0.2 0.4 0.5 0.5 0.2 0.3] .3 0.2 0.5 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0. [0.5 0.2 0.3 0.5 0. [0.5 0.2 0.3 0.5 0. 0.4 0.5 0.5 0.2 0.3] 0.4 0.5 0.5 0.2 0.3]
9. Fundamental frequency Midi note Root mean squared amplitude Spectral-centroid Spectral-irregularity Spectral-inharmonicity Spectral skewness Spectral kurtosis http://jamiebullock.github.io/LibXtract/documentation/
10. Fundamental frequency Midi note Volume Brightness of Sound Noisiness of a sound How harmonic Spectrum skew Pitchiness http://jamiebullock.github.io/LibXtract/documentation/
11. Query and use it demo T-sne “magical ability to create compelling two-dimensional “maps” from data with hundreds or even thousands of dimensions” https://lvdmaaten.github.io/tsne/
12. Gene Kogan
13. https://www.instagram.com/p/Bft_6KVHa9l/?taken-by=livecodez https://twitter.com/xululululuuum
14. Patching https://en.wikipedia.org/wiki/Wendy_Carlos
17. https://vcvrack.com/ https://vcvrack.com/
18. Code https://supercollider.github.io/
19. Code
20. Code
22. Procedural Property based testing (Quickcheck) Genetic & https://en.wikipedia.org/wiki/%C3%89liane_Radigue
23. Generators Properties All things that are a square should have 4 sides of equal length (fn [] (let [color (gen/rgb-color) size (gen/int)] (build-a-square color size))) Property Based Testing https://en.wikipedia.org/wiki/QuickCheck
24. Property Based Testing Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave
25. Property Based Testing Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave
26. Fitness ?
27. https://twitter.com/Finger_smudger
28. Playing instruments in odd ways https://en.wikipedia.org/wiki/Daphne_Oram
29. Emacs Is A Operating System d[*_*]b /|!|\ _| |_ Is A Musical Instrument Yes Really
30. Emacs Demo https://vimeo.com/265188142
31. d[x_x]b /|!|\ _/ \_ https://vimeo.com/265189088 Scratching Samples With Emacs
33. Knob Twiddling Demo https://vimeo.com/269049832
34. Machine Learning https://en.wikipedia.org/wiki/Else_Marie_Pade
35. https://nsynthsuper.withgoogle.com/ Neural Synthesizer
36. Wavenet Decoder Amplitude of sound wave 16 temporal features Amplitude of sound wave Feedforward Sample Sample [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 512
37. https://vimeo.com/269039623
38. AI https://chrisdonahue.github.io/wavegan/
39. CreativITY https://en.wikipedia.org/wiki/Suzanne_Ciani
40. Joseph Wilk