Parsing Binary Data

B5b39c8f21b5bb1ab97852ed32c888ab?s=47 Jan Krutisch
June 29, 2012
Programming
0
56

Parsing Binary Data

A lighting talk about parsing binary data in ruby with bindata gem.

B5b39c8f21b5bb1ab97852ed32c888ab?s=128

Jan Krutisch

June 29, 2012
Tweet

More Decks by Jan Krutisch

See All by Jan Krutisch
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
3
120
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
35
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
79
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
1.4k
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
79
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
120
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
56

Other Decks in Programming

See All in Programming
37618b4d60cf3d1f43f7196253264edc?s=48 numeroanddev
0
270
Dee9a95c0e5483692c54cc5e60e8b09e?s=48 yusuke57
0
230
B8403d102456248570005ee7fb2ba0f7?s=48 tooppoo
3
390
1d1580fb0945b0ffadff18e28bead3c5?s=48 adarapata
0
200
110cd4dcaed019b3bd9809e541afdeb6?s=48 okuramasafumi
0
200
0aa238a274c2397214b20d6eed58939b?s=48 moomooya
0
280
3499a1d71fa70b8ee44816ca9e7329fe?s=48 bells17
1
400
7eca3e06edc3c69004aaf57de51900c2?s=48 ajstarks
2
310
817e89f88197980860f1854b74fbee25?s=48 lcdsmao
2
330
1d6af7b4c56fbf84d81ebaee4a8ac2e8?s=48 mnaruse
1
150
9fbbe5d0b8e2ee1cdc3a576b55a2d63d?s=48 uzimaru0000
0
230
A8341bc33e5d88f607328d5a82fa42e1?s=48 smartcamp
0
250

Featured

See All Featured
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
240
20k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
164
6.7k
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
257
16k
15f2b8221f247985a27a627d2ece72f0?s=48 pauljervisheath
193
15k
Ae14cc4491ac334f9cd23f9f93b4305e?s=48 orderedlist
325
34k
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
497
36k
282d599b414022eba5096510f675b6e2?s=48 chrislema
169
13k
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
236
23k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
1
270
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
681
180k
245cee81a9c424266e5e401d844ea881?s=48 lara
587
60k
9128d500301ae51524e887bb680f471d?s=48 caitiem20
300
16k

Transcript

  1. Parsing and Writing Binary Data in Ruby Jan Krutisch @halfbyte

    jan.krutisch@mindmatters.de

  2. señor developer

  3. None

  4. Protracker "mod" files

  5. Binary Format

  6. None

  7. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents

  8. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes)

  9. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs

  10. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs

  11. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs Array of Integers

  12. Simple Approach

  13. Serializer / Deserializer

  14. Different Datatypes

  15. Protracker Datatypes

  16. Protracker Datatypes ‣ 8Bit signed binary blobs

  17. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8

  18. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?)

  19. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings

  20. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings ‣ Int4 (Yes, that‘s a signed halfbyte)

  21. And this...

  22. None

  23. Procedural Mess

  24. Declarative

  25. gem "bindata"

  26. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  27. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  28. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  29. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  30. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  31. array :patterns, :type => Pattern, :initial_length => lambda { pattern_table.max

    + 1 }
  32. None

  33. Demo

  34. señor developer http://senordevelopershop.spreadshirt.de/ (europe) http://senordeveloper.spreadshirt.com/ (intl)