My favorite script, "dsl.rb"

RubyKaigi 2024事後勉強会 https://smarthr.connpass.com/event/319010/

Transcript

1. My favorite script, "dsl.rb" May 31, 2024 in RubyKaigi 2024 事後勉強会 @yui-knk Yuichiro Kaneko
2. About me Yuichiro Kaneko yui-knk (GitHub) / spikeolaf (Twitter) Treasure Data Engineering Manager of Applications Backend CRuby committer, mainly develop parser generator and parser Lrama LALR (1) parser generator (2023, Ruby 3.3) Love LR parser
3. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan The Bison Slayer The parser monster Parser界の黎明卿 The world is now in the great age of parsers. People are setting sail into the vast sea of parsers. - RubyKaigi 2023 LT- Yuichiro Kaneko https://twitter.com/kakutani/status/1657762294431105025/ NEW !!! NEW !!!
4. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan
5. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan Turn back the clock
6. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan EXTRA STAGE “Ripper” CHALLENGE 19
7. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan How Ripper is implemented?
8. How parse.y is used parse.y is a source of ripper.y parse.y parse.c parse.h Lrama ripper.y tool/id2token.rb tools/preproc.rb Lrama ripper.c
9. Comments in parse.y is transformed to C codes in ripper.y Comments are not comments !! parse.y is two-faced parse.y ripper.y
10. “dsl.rb” is fantastic “ext/ripper/tools/dsl.rb” “tools/preproc.rb” requires “dsl.rb” This is my favorite script !! Less than 100 lines but very hacky
11. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan Today’s main topic
12. How parse.y is used parse.y is a source of ripper.y parse.y parse.c parse.h Lrama ripper.y tool/id2token.rb tools/preproc.rb Lrama ripper.c tools/dsl.rb
13. preproc.rb preproc.rb processes input file line by line /*% ripper: stmts_add!($:1, $:3) %*/ match /*% ripper: stmts_add!($:1, $:3) %*/ processed
14. Ruby codes in C comments
15. In parse.y, C codes and Ruby codes in C’s comment exist In ripper.y, Ruby codes are transformed to C codes Mixture of C and Ruby parse.y ripper.y C codes Ruby codes C codes
16. Of course, they are here Of course, method_missing and const_missing are used
17. “dsl.rb” is fantastic !!! “p = p” !? undef lambda, hash, class
18. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan What's happening?
19. #1. Split the code Split a comment into options and “@code” Generate DSL instance class DSL options @error @brace @ fi nal @code
20. #2. eval @code Eval @code, then method_missing and/or const_missing will be called const_missing method_missing method_missing
21. #3. method_missing method_missing generates C code #stmts_new! call with no arguments then translated to dispatch0 function call
22. #3. method_missing #stmts_add! call with 2 arguments then translated to variable setup codes and dispatch2 function call
23. #4. DSL#generate Finally, the last value is assigned to "p->s_lvalue" by #generate
24. Tips #1 p = p = "p" As you know, "p" is "struct parser_params *p” What is Kernel#p method? Double assignments is for warning suppression "warning: assigned but unused variable - p"
25. Tips #2 undef is needed for lambda, hash, class events Otherwise method_missing is not called
26. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan After RubyKaigi…
27. PR #10766 PR was created by nobu on May 12 RubyKaigi was May 15-17 I wan in Okinawa https://github.com/ruby/ruby/pull/10766
28. No more get_value No need to write get_value anymore!
29. DSL#initialize get_value is automatically inserted by DSL
30. Support [$:n, ...] No need to write rb_ary_new_from_args or rb_ary_new […] can be used instead of that
31. Support [$:n, ...] Actually […] is expanded to rb_ary_new_from_args
32. Re fi ne Array !! Redefine Array#to_s Impact is limited by refinements
33. $:n[i] and $:n[i..j] to splat head in ripper is an array with 3 elements Want to splat the array when invoke defs event
34. No magic Simply define #[] method
35. p = p = "p" is improved Remove double assignments by using default value of argument Intention is more clear than previous codes
36. Summary “ext/ripper/tools/dsl.rb” Is less than 200 lines but very powerful Contains real world examples of #eval #method_missing #const_missing #binding Refinements (<- New!)
37. Conclusions It’s fun to use black magic !!
38. May 15th - 17th, 2024 NAHA CULTURAL ARTS THEATER NAHArt, Okinawa, Japan Thank you !!!