Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Parsing Binary Data

B5b39c8f21b5bb1ab97852ed32c888ab?s=47 Jan Krutisch
June 29, 2012
Programming
0
62

Parsing Binary Data

A lighting talk about parsing binary data in ruby with bindata gem.

B5b39c8f21b5bb1ab97852ed32c888ab?s=128

Jan Krutisch

June 29, 2012
Tweet

More Decks by Jan Krutisch

See All by Jan Krutisch
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
3
120
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
35
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
110
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
1.4k
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
84
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
58

Other Decks in Programming

See All in Programming
3ed241740309c9b4adfeccc6212465b0?s=48 mfunaki
1
440
E1db053f2c2f3d3b49a5f5b9b0c7f20f?s=48 kazaman97
0
210
15bd11f2c2c5e3dd854153d03a102b0d?s=48 standfm
0
270
2102a6b8760bd6f57f672805723dd83a?s=48 line_developers_tw
0
550
832ece085bfe2c7c5b0ed6be62d7e675?s=48 steipete
PRO
2
170
3931098ae486b6df619050c63e24f6cc?s=48 osyo
1
370
4782d92d3deeb4ab527ba6f867bf07c3?s=48 mizdra
7
4.9k
Fbe54abf4094d19f1548783d072a7fa7?s=48 adoranwodo
0
260
405fe9ab689473f267e2cfbd95f78c75?s=48 kyonmm
2
2.2k
D12a80cab206033a820ccff8319f957b?s=48 s_uryu
0
240
Ca87f7d72481ab028a167a45ba1783d9?s=48 7603
0
180
E473e5af1263c050599921981db46068?s=48 akatsukinewgrad
0
230

Featured

See All Featured
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
251
11k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
18
650
7653c7c449918ff6542880a8c284f5e7?s=48 jponch
103
5k
245cee81a9c424266e5e401d844ea881?s=48 lara
172
9.5k
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
500
36k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
272
16k
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
165
19k
48c098b6579220a67a6ba949be6e4b5a?s=48 revolveconf
200
9.6k
A9a491b0fcbe0fbce3d64063a37add99?s=48 rmw
11
740
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
684
180k
0fe2973fa8d27d96547e43322341183a?s=48 swwweet
206
6.8k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
84
7.8k

Transcript

  1. Parsing and Writing Binary Data in Ruby Jan Krutisch @halfbyte

    jan.krutisch@mindmatters.de

  2. señor developer

  3. None

  4. Protracker "mod" files

  5. Binary Format

  6. None

  7. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents

  8. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes)

  9. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs

  10. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs

  11. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs Array of Integers

  12. Simple Approach

  13. Serializer / Deserializer

  14. Different Datatypes

  15. Protracker Datatypes

  16. Protracker Datatypes ‣ 8Bit signed binary blobs

  17. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8

  18. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?)

  19. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings

  20. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings ‣ Int4 (Yes, that‘s a signed halfbyte)

  21. And this...

  22. None

  23. Procedural Mess

  24. Declarative

  25. gem "bindata"

  26. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  27. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  28. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  29. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  30. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  31. array :patterns, :type => Pattern, :initial_length => lambda { pattern_table.max

    + 1 }
  32. None

  33. Demo

  34. señor developer http://senordevelopershop.spreadshirt.de/ (europe) http://senordeveloper.spreadshirt.com/ (intl)