Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Parsing Binary Data

B5b39c8f21b5bb1ab97852ed32c888ab?s=47 Jan Krutisch
June 29, 2012
Programming
0
73

Parsing Binary Data

A lighting talk about parsing binary data in ruby with bindata gem.

B5b39c8f21b5bb1ab97852ed32c888ab?s=128

Jan Krutisch

June 29, 2012
Tweet

More Decks by Jan Krutisch

See All by Jan Krutisch
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
3
120
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
36
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
1.5k
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
140
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
92
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
150
B5b39c8f21b5bb1ab97852ed32c888ab?s=48 halfbyte
0
63

Other Decks in Programming

See All in Programming
D3be793aaf76ed1915295001712ce0f1?s=48 jrfk
0
730
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
PRO
0
240
7252086bae9203045dd7f5664fd96a07?s=48 manuelmeyer
0
130
A5f52fd719e8e9a5c9e74f8b179dced7?s=48 lutecia16v
0
600
F73ac5e3ccf3d4dbfffff61b14d2335c?s=48 pakio
0
440
2b67c3578e104daca8c6609e5be43d8d?s=48 balconia
0
160
Ac6dba8ce93944d17714de362ca17e54?s=48 muryoimpl
0
150
845fae80ed8b704a88b32500b3db4c53?s=48 sailplanetw
1
170
8d7983d03db1fb756ccdbcbf7b760f98?s=48 yamada1826
0
350
Be33a704f251c77162896ac5ba03e9ac?s=48 azuki
0
220
A5e5ee2fb9e4ce3c728ed9e3ef6e916f?s=48 joker1007
12
2k
B9012970f22b84c5b344ffa6f8a884d5?s=48 camaelon
0
150

Featured

See All Featured
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
372
43k
A16eb159db895e3b01d3dc95767ad595?s=48 jonyablonski
35
1.6k
15f2b8221f247985a27a627d2ece72f0?s=48 pauljervisheath
195
16k
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
69
3.1k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
687
180k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
91
8.8k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
33
2.3k
0c6fd6a08d0f898159cda7cafcacf07f?s=48 afnizarnur
180
14k
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
128
21k
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
58
3.7k
C620790ae5bf5b50c245b2e0ef95f338?s=48 deanohume
294
28k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
287
47k

Transcript

  1. Parsing and Writing Binary Data in Ruby Jan Krutisch @halfbyte

    jan.krutisch@mindmatters.de

  2. señor developer

  3. None

  4. Protracker "mod" files

  5. Binary Format

  6. None

  7. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents

  8. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes)

  9. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs

  10. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs

  11. ‣ Instrument Metadata ‣ Sample Data ‣ Pattern Data ‣

    Sequence Data Mod File Contents Array of Structs (=Array of Hashes) Array of Blobs Arrays of Arrays of Arrays of Structs Array of Integers

  12. Simple Approach

  13. Serializer / Deserializer

  14. Different Datatypes

  15. Protracker Datatypes

  16. Protracker Datatypes ‣ 8Bit signed binary blobs

  17. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8

  18. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?)

  19. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings

  20. Protracker Datatypes ‣ 8Bit signed binary blobs ‣ UInt8 ‣

    UInt16 (Endianness?) ‣ \0-Terminated/Padded Strings ‣ Int4 (Yes, that‘s a signed halfbyte)

  21. And this...

  22. None

  23. Procedural Mess

  24. Declarative

  25. gem "bindata"

  26. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  27. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  28. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  29. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  30. class ProtrackerModule < BinData::Record endian :big string :name, :length =>

    20, :trim_padding => true array :samples, :type => Sample, :length => 31 uint8 :pattern_table_length uint8 :unused array :pattern_table, :type => :uint8, :initial_length => 128 [...]

  31. array :patterns, :type => Pattern, :initial_length => lambda { pattern_table.max

    + 1 }
  32. None

  33. Demo

  34. señor developer http://senordevelopershop.spreadshirt.de/ (europe) http://senordeveloper.spreadshirt.com/ (intl)