Pro Yearly is on sale from $80 to $50! »

Crafting Instruments In Code

Crafting Instruments In Code

3c28deaff162aeda44f2e0bcdca1dacf?s=128

Joseph Wilk

May 11, 2018
Tweet

Transcript

  1. Crafting Instruments in code @josephwilk https://en.wikipedia.org/wiki/Silver_Apples

  2. @repl_electric http://www.repl-electric.com

  3. http://www.repl-electric.com @repl_electric

  4. http://www.repl-electric.com @repl_electric

  5. Noise Silver Apples

  6. Samples “Real-world noise of any sort has a very wide

    frequency range, far wider and more complex than any electronically generated sound.” Jon Hopkins https://en.wikipedia.org/wiki/Jon_Hopkins
  7. Channel (Right) Channel (Left) Frames 44100 1 second Sample 16bits

    Frame n+1 Frame n+3 Frame n+4 Frame n Frame n+2 176k Sample 16bits Amplitude of sound wave Stereo http://soundfile.sapp.org/doc/WaveFormat/
  8. Samples as DATA [0.5 0.2 0.3 0.5 0.3 0.2 0.4

    0.5 0.5 0.2 0.3] [0.4 0.5 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.3 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.3 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.1 0.6 0.3 0.5 0.3 0.2 0.4 0.3 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.5 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.5 0.1 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.2 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.5 0.1 0.5 0.3 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.1 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 [0.5 0.2 0.3 0.5 0.3 0.2 [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] .3 0.2 0.4 0.5 0.5 0.2 0.3] .3 0.2 0.5 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0. [0.5 0.2 0.3 0.5 0. [0.5 0.2 0.3 0.5 0. 0.4 0.5 0.5 0.2 0.3] 0.4 0.5 0.5 0.2 0.3]
  9. Fundamental frequency Midi note Root mean squared amplitude Spectral-centroid Spectral-irregularity

    Spectral-inharmonicity Spectral skewness Spectral kurtosis http://jamiebullock.github.io/LibXtract/documentation/
  10. Fundamental frequency Midi note Volume Brightness of Sound Noisiness of

    a sound How harmonic Spectrum skew Pitchiness http://jamiebullock.github.io/LibXtract/documentation/
  11. Query and use it demo T-sne “magical ability to create

    compelling two-dimensional “maps” from data with hundreds or even thousands of dimensions” https://lvdmaaten.github.io/tsne/
  12. Gene Kogan

  13. https://www.instagram.com/p/Bft_6KVHa9l/?taken-by=livecodez https://twitter.com/xululululuuum

  14. Patching https://en.wikipedia.org/wiki/Wendy_Carlos

  15. None
  16. None
  17. https://vcvrack.com/ https://vcvrack.com/

  18. Code https://supercollider.github.io/

  19. Code

  20. Code

  21. None
  22. Procedural Property based testing (Quickcheck) Genetic & https://en.wikipedia.org/wiki/%C3%89liane_Radigue

  23. Generators Properties All things that are a square should have

    4 sides of equal length (fn [] (let [color (gen/rgb-color) size (gen/int)] (build-a-square color size))) Property Based Testing https://en.wikipedia.org/wiki/QuickCheck
  24. Property Based Testing Generators reverb echo tube distort delay Sine

    Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave
  25. Property Based Testing Generators reverb echo tube distort delay Sine

    Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Generators reverb echo tube distort delay Sine Wave Square Wave Pulse Wave Sound Fx Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave Tube Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave Pulse Wave delay Square Wave reverb reverb Pulse Wave Square Wave delay Pulse Wave Square Wave Square Wave Square Wave Square Wave reverb reverb Pulse Wave reverb reverb reverb Square Wave delay reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb reverb Pulse Wave Pulse Wave reverb Pulse Wave reverb reverb Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave Sound Fx delay Pulse Wave Square Wave Square Wave Square Wave Square Wave Square Wave
  26. Fitness ?

  27. https://twitter.com/Finger_smudger

  28. Playing instruments in odd ways https://en.wikipedia.org/wiki/Daphne_Oram

  29. Emacs Is A Operating System d[*_*]b /|!|\ _| |_ Is

    A Musical Instrument Yes Really
  30. Emacs Demo https://vimeo.com/265188142

  31. d[x_x]b /|!|\ _/ \_ https://vimeo.com/265189088 Scratching Samples With Emacs

  32. None
  33. Knob Twiddling Demo https://vimeo.com/269049832

  34. Machine Learning https://en.wikipedia.org/wiki/Else_Marie_Pade

  35. https://nsynthsuper.withgoogle.com/ Neural Synthesizer

  36. Wavenet Decoder Amplitude of sound wave 16 temporal features Amplitude

    of sound wave Feedforward Sample Sample [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] [0.5 0.2 0.3 0.5 0.3 0.2 0.4 0.5 0.5 0.2 0.3] 512
  37. https://vimeo.com/269039623

  38. AI https://chrisdonahue.github.io/wavegan/

  39. CreativITY https://en.wikipedia.org/wiki/Suzanne_Ciani

  40. Joseph Wilk