Slide 1

Slide 1 text

Crafting Instruments in code @josephwilk https://en.wikipedia.org/wiki/Silver_Apples

Slide 2

Slide 2 text

@repl_electric http://www.repl-electric.com

Slide 3

Slide 3 text

http://www.repl-electric.com @repl_electric

Slide 4

Slide 4 text

http://www.repl-electric.com @repl_electric

Slide 5

Slide 5 text

Noise Silver Apples

Slide 6

Slide 6 text

Samples “Real-world noise of any sort has a very wide frequency range, far wider and more complex than any electronically generated sound.” Jon Hopkins https://en.wikipedia.org/wiki/Jon_Hopkins

Slide 7

Slide 7 text

Channel (Right) Channel (Left) Frames 44100 1 second Sample 16bits Frame n+1 Frame n+3 Frame n+4 Frame n Frame n+2 176k Sample 16bits Amplitude of sound wave Stereo http://soundfile.sapp.org/doc/WaveFormat/

Slide 8

Slide 8 text

Samples as DATA [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.4 0.5 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.3 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.3 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.1 0.6 0.3 0.5 0.3 0.2 0.4 0.3 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.5 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.5 0.1 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.2 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.5 0.1 0.5 0.3 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.1 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 [0.5 0.2 0.3 0.5 0.3 0.2 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] .3 0.2 0.4 0.5 0.5 0.2 0.3] .3 0.2 0.5 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0. [0.5 0.2 0.3 0.5 0. [0.5 0.2 0.3 0.5 0. 0.4 0.5 0.5 0.2 0.3] 0.4 0.5 0.5 0.2 0.3]

Slide 9

Slide 9 text

Fundamental frequency Midi note Root mean squared amplitude Spectral-centroid Spectral-irregularity Spectral-inharmonicity Spectral skewness Spectral kurtosis http://jamiebullock.github.io/LibXtract/documentation/

Slide 10

Slide 10 text

Fundamental frequency Midi note Volume Brightness of Sound Noisiness of a sound How harmonic Spectrum skew Pitchiness http://jamiebullock.github.io/LibXtract/documentation/

Slide 11

Slide 11 text

Query and use it demo T-sne “magical ability to create compelling two-dimensional “maps” from data with hundreds or even thousands of dimensions” https://lvdmaaten.github.io/tsne/

Slide 12

Slide 12 text

Gene Kogan

Slide 13

Slide 13 text

https://www.instagram.com/p/Bft_6KVHa9l/?taken-by=livecodez https://twitter.com/xululululuuum

Slide 14

Slide 14 text

Patching https://en.wikipedia.org/wiki/Wendy_Carlos

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

https://vcvrack.com/ https://vcvrack.com/

Slide 18

Slide 18 text

Code https://supercollider.github.io/

Slide 19

Slide 19 text

Code

Slide 20

Slide 20 text

Code

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

Procedural Property based testing (Quickcheck) Genetic & https://en.wikipedia.org/wiki/%C3%89liane_Radigue

Slide 23

Slide 23 text

Generators Properties All things that are a square should have 4 sides of equal length (fn [] (let [color (gen/rgb-color) size (gen/int)] (build-a-square color size))) Property Based Testing https://en.wikipedia.org/wiki/QuickCheck

Slide 24

Slide 24 text

Property Based Testing Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave

Slide 25

Slide 25 text

Property Based Testing Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave

Slide 26

Slide 26 text

Fitness ?

Slide 27

Slide 27 text

https://twitter.com/Finger_smudger

Slide 28

Slide 28 text

Playing instruments in odd ways https://en.wikipedia.org/wiki/Daphne_Oram

Slide 29

Slide 29 text

Emacs Is A Operating System d[*_*]b /|!|\ _| |_ Is A Musical Instrument Yes Really

Slide 30

Slide 30 text

Emacs Demo https://vimeo.com/265188142

Slide 31

Slide 31 text

d[x_x]b /|!|\ _/ \_ https://vimeo.com/265189088 Scratching Samples With Emacs

Slide 32

Slide 32 text

No content

Slide 33

Slide 33 text

Knob Twiddling Demo https://vimeo.com/269049832

Slide 34

Slide 34 text

Machine Learning https://en.wikipedia.org/wiki/Else_Marie_Pade

Slide 35

Slide 35 text

https://nsynthsuper.withgoogle.com/ Neural Synthesizer

Slide 36

Slide 36 text

Wavenet Decoder Amplitude of sound wave 16 temporal features Amplitude of sound wave Feedforward Sample Sample [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 512

Slide 37

Slide 37 text

https://vimeo.com/269039623

Slide 38

Slide 38 text

AI https://chrisdonahue.github.io/wavegan/

Slide 39

Slide 39 text

CreativITY https://en.wikipedia.org/wiki/Suzanne_Ciani

Slide 40

Slide 40 text

Joseph Wilk