Save 37% off PRO during our Black Friday Sale! »

Parsing Binary Data

B5b39c8f21b5bb1ab97852ed32c888ab?s=47 Jan Krutisch
June 29, 2012
Programming
0
79

Parsing Binary Data

A lighting talk about parsing binary data in ruby with bindata gem.

B5b39c8f21b5bb1ab97852ed32c888ab?s=128

Jan Krutisch

June 29, 2012
Tweet

More Decks by Jan Krutisch

See All by Jan Krutisch
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
3
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
37
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
170
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
1.5k
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
92
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
150
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
64

Other Decks in Programming

See All in Programming
023b04c98f39cc041293d780352432ff?s=48 koic
12
1.1k
62384887995a0ce07ec4f86b89f5ec9e?s=48 aosa4054
0
260
38de416c9984b22bff1d2b049c7d51a8?s=48 fossamagna
1
120
9e64d2069945742c818421e884603b44?s=48 ushisantoasobu
1
470
5059d3f370ad7e1f4d8de4be79ae1a2c?s=48 rvirus0817
0
200
A10e41b0a61d59f2258d7f6172c33479?s=48 kaityo256
2
120
04a6843ddf4b5a57950cfa2cddf44adc?s=48 vaibhav30699
0
630
8f84b7d8869ef6005d89b378e8661f7c?s=48 masuda220
PRO
9
4.7k
Bd34d8c4bc464a2bec2792579c759cd1?s=48 b4tchkn
1
120
7eca3e06edc3c69004aaf57de51900c2?s=48 ajstarks
3
5k
58d2fa98345951d9a57fdd6cfd5d0f64?s=48 aszx87410
2
360
635e53b96114c922fa5486b418895960?s=48 fadis
7
4.5k

Featured

See All Featured
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
56
5.7k
D83926c323d4f9289f947b4b4e76b939?s=48 jensimmons
210
11k
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
16
960
5b9fe87ec1faa67a4599782930f45ec9?s=48 sstephenson
149
12k
5f50f94346fbcb23706f0707169317a4?s=48 aarron
261
37k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
91
9k
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
295
110k
7cbd3f5f922d798cc312eaf596de7ae6?s=48 iamctodd
33
3.1k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
660
55k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
271
17k
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
253
11k
E195ae45320d9202eaa01c9f1d31a416?s=48 marktimemedia
15
760

Transcript

  1. Parsing and Writing Binary Data in Ruby Jan Krutisch @halfbyte

    jan.krutisch@mindmatters.de

  2. señor developer

  3. None

  4. Protracker "mod" files

  5. Binary Format

  6. None

  7. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents

  8. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes)

  9. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs

  10. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs

  11. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs Array of Integers

  12. Simple Approach

  13. Serializer / Deserializer

  14. Different Datatypes

  15. Protracker Datatypes

  16. Protracker Datatypes ‣ 8Bit signed binary blobs

  17. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8

  18. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?)

  19. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings

  20. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings ‣ Int4 (Yes, that‘s a signed halfbyte)

  21. And this...

  22. None

  23. Procedural Mess

  24. Declarative

  25. gem "bindata"

  26. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  27. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  28. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  29. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  30. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  31. array :patterns, :type => Pattern, :initial_length => lambda { pattern_table.max

    + 1 }
  32. None

  33. Demo

  34. señor developer http://senordevelopershop.spreadshirt.de/ (europe) http://senordeveloper.spreadshirt.com/ (intl)