Parsing Binary Data

B5b39c8f21b5bb1ab97852ed32c888ab?s=47 Jan Krutisch
June 29, 2012
Programming
0
61

Parsing Binary Data

A lighting talk about parsing binary data in ruby with bindata gem.

B5b39c8f21b5bb1ab97852ed32c888ab?s=128

Jan Krutisch

June 29, 2012
Tweet

More Decks by Jan Krutisch

See All by Jan Krutisch
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
3
120
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
35
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
90
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
1.4k
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
82
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
130
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
57

Other Decks in Programming

See All in Programming
3f4e0340909015791f1712c52b116da7?s=48 tamadon
1
330
9e9eb825c69d719f2d3c32bdd3bc971e?s=48 atp
3
630
342dde780fe56d44bdeada4bb429145a?s=48 codingluka
3
1.2k
5bd19ec9172dcb6dd3cb8033d88b262e?s=48 rom1000
1
190
1fe64ebb176498be5f73ab51986c6b7b?s=48 davidfowl
9
3.6k
Bf5ee9059859ed5d855b5ff4680e63e2?s=48 track3jyo
4
770
70adfe7679427fa498899769e632b672?s=48 itok
1
310
51f4d2341131b6b9bfa996bdb9b8dfa8?s=48 showmant
3
760
5b8d20aa7d63c5d391b1c881e1764460?s=48 quasilyte
2
340
993ef638264def4334358f986fb4a91d?s=48 uhyo
1
400
2bedb1eb8f841cd3c3ae584600b016e0?s=48 okunokentaro
1
490
D79e3b0b78ca7027eb61d73028d45ad6?s=48 uchi_k
2
920

Featured

See All Featured
5f83ef806155b403c3393160ce51f955?s=48 jlugia
216
16k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
218
14k
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
5
310
9375a9529679f1b42b567a640d775e7d?s=48 schacon
144
6.5k
170b760e0147792d0140e59ec78e9893?s=48 eitanlees
108
9.6k
Aebc2d07a50011e2a30d38435fde564a?s=48 jrom
113
7k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
267
16k
245cee81a9c424266e5e401d844ea881?s=48 lara
169
9.3k
E43f8dfd01057f8304f5f8fb9a294d7d?s=48 jeffersonlam
325
15k
E195ae45320d9202eaa01c9f1d31a416?s=48 marktimemedia
5
200
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
499
36k
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
285
110k

Transcript

  1. Parsing and Writing Binary Data in Ruby Jan Krutisch @halfbyte

    jan.krutisch@mindmatters.de

  2. señor developer

  3. None

  4. Protracker "mod" files

  5. Binary Format

  6. None

  7. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents

  8. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes)

  9. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs

  10. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs

  11. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs Array of Integers

  12. Simple Approach

  13. Serializer / Deserializer

  14. Different Datatypes

  15. Protracker Datatypes

  16. Protracker Datatypes ‣ 8Bit signed binary blobs

  17. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8

  18. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?)

  19. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings

  20. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings ‣ Int4 (Yes, that‘s a signed halfbyte)

  21. And this...

  22. None

  23. Procedural Mess

  24. Declarative

  25. gem "bindata"

  26. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  27. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  28. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  29. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  30. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  31. array :patterns, :type => Pattern, :initial_length => lambda { pattern_table.max

    + 1 }
  32. None

  33. Demo

  34. señor developer http://senordevelopershop.spreadshirt.de/ (europe) http://senordeveloper.spreadshirt.com/ (intl)