たのしいRubyの構文解析ツアー

ԘҪඒ࡙ !TIJPJNN!DPF@

.BS
ࣛࣇౡ3VCZձٞ
ͨͷ͍͠3VCZͷߏจղੳπΞʔ

View Slide

ࣗݾ঺հ
(JU)VC!TIJPJNN
5XJUUFS!DPF@
גࣜձࣾΤεɾΤϜɾΤε
'VLVPLBSCग़਎"TBLVTBSCҭͪ
ࡀ͔Βࡀ·ͰࣛࣇౡʹॅΜͰ͍·ͨ͠
͜ͷ͋ͨΓ
ࣾձ՝୊ʹऔΓ૊Έ͍ͨ3VCZେ޷͖ΤϯδχΞ͕
ηΧϯυΩϟϦΞʹΤεɾΤϜɾΤεΛબΜͩཧ༝
IUUQTUFDICNTNTDPKQFOUSZ

View Slide

ࣛࣇౡ3VCZձٞͷςʔϚ
ͱ͍͏͜ͱͰɺ࠷ۙݸਓతʹڵຯ͕޿͕ͬͨ
3VCZͷ಺ଆͷੈքͷ͓࿩Λ͍ͨ͠ͱࢥ͍·͢
IUUQTLSVCZDPNLBHPTIJNBSVCZLBJHJBCPVU
3VCZͰ޿͕Δੈքɺ3VCZͰ͸͡ΊΑ͏

View Slide

ͱ͸͍͑
ʮ3VCZͷ಺ଆͷੈքʯͱ͍ͬͯ΋ɺ
࣮ࡍʹ͸ͱͯ΋޿େͰ͍ΖΜͳ੾Γޱ͕͋Γ·͢Ͷ

View Slide

ʮ3VCZͷ಺ଆͷੈքʯ
ࠓճ͸ͦͷதͰ΋
ɹ3VCZ .3*
͕
ɹͲΜͳ;͏ʹίʔυΛ࣮ߦ͍ͯ͠Δͷ͔
ͷҰ෦Ͱ͋Δߏจղੳʹ
εϙοτϥΠτΛ౰ͯͯΈ͍ͨͱࢥ͍·͢

View Slide

ʮ3VCZͷ಺ଆͷੈքʯ
·ͣ͸3VCZ͕ίʔυΛ࣮ߦ͢Δ·Ͱʹ
3VCZ .3*
ͷ಺ଆͰͲΜͳ͜ͱ͕ى͍ͬͯ͜Δͷ͔
ͦͷશମ૾ΛோΊͯΈ͍ͨͱࢥ͍·͢

View Slide

3VCZ͕ίʔυΛ࣮ߦ͢Δ·ͰͷྲྀΕ
ιʔείʔυ 1 + 2

View Slide

ιʔείʔυ 1 + 2
࣮ߦ

View Slide

ιʔείʔυΛ
ҙຯతʹղऍ͢Δॲཧ
ιʔείʔυΛ
୯ޠ୯Ґʹ੾Γग़͢ॲཧ
ߏจղੳ
ιʔείʔυ
ࣈ۟ղੳ
1 + 2

View Slide

ιʔείʔυΛ
ҙຯతʹղऍͨ͠໦ߏ଄ͷσʔλ
ߏจղੳ
ιʔείʔυ
ࣈ۟ղੳ
1 + 2
(OPCALL@1:0-1:5

(LIT@1:0-1:1 1)

:+

(LIST@1:4-1:5

(LIT@1:4-1:5 2) nil)))
ߏจ໦

View Slide

ߏจղੳ
ίϯύΠϧ
ιʔείʔυ
ࣈ۟ղੳ
1 + 2
(OPCALL@1:0-1:5

(LIT@1:0-1:1 1)

:+

(LIST@1:4-1:5

(LIT@1:4-1:5 2) nil)))
ߏจ໦

View Slide

ϓϩάϥϜΛ࣮ࡍʹ࣮ߦ͢Δ໋ྩྻ
ߏจղੳ
ίϯύΠϧ
ιʔείʔυ
:"37όΠτίʔυ
ࣈ۟ղੳ
1 + 2
== disasm: #@-e:1 (1,0)-(1,5)> (catch: false)

0000 putobject 1 ( 1)[Li]

0002 putobject 2

0004 send , nil

0007 leave
(OPCALL@1:0-1:5

(LIT@1:0-1:1 1)

:+

(LIST@1:4-1:5

(LIT@1:4-1:5 2) nil)))
ߏจ໦

View Slide

ߏจղੳ
ίϯύΠϧ
ιʔείʔυ
:"37όΠτίʔυ
ࣈ۟ղੳ
:"37্Ͱ࣮ߦ
1 + 2


0002 putobject 2

0004 send , nil

0007 leave
(OPCALL@1:0-1:5

(LIT@1:0-1:1 1)

:+

(LIST@1:4-1:5

(LIT@1:4-1:5 2) nil)))
ߏจ໦

View Slide

ߏจղੳ
ίϯύΠϧ
ιʔείʔυ
:"37όΠτίʔυ
ࣈ۟ղੳ
:"37্Ͱ࣮ߦ
࣮ߦ݁Ռ > 3
1 + 2


0002 putobject 2

0004 send , nil

0007 leave
(OPCALL@1:0-1:5

(LIT@1:0-1:1 1)

:+

(LIST@1:4-1:5

(LIT@1:4-1:5 2) nil)))
ߏจ໦

View Slide

ຊൃදͰͷείʔϓ
3VCZ .3*
ͷ಺ଆͷੈքͰɺ
3VCZ͕ιʔείʔυΛಡΈղ͍͍ͯ͘աఔΛ
3VCZͱҰॹʹମݧͯ͠Έ͍ͨͱࢥ͍·͢
ߏจղੳ
ίϯύΠϧ
ιʔείʔυ
:"37όΠτίʔυ
ࣈ۟ղੳ
:"37্Ͱ࣮ߦ
࣮ߦ݁Ռ
ߏจ໦

View Slide

.3*ͷߏจղੳ

View Slide

ύʔαͱεΩϟφ
ύʔαͱݺ͹ΕΔؔ਺͕
ߏจղੳΛߦ͏
εΩϟφͱݺ͹ΕΔؔ਺͕
ࣈ۟ղੳΛߦ͏
ߏจղੳ
ίϯύΠϧ
ιʔείʔυ
:"37όΠτίʔυ
ࣈ۟ղੳ
:"37্Ͱ࣮ߦ
࣮ߦ݁Ռ
ߏจ໦

View Slide

.3*ʹ͓͚ΔεΩϟφͷओͳ͸ͨΒ͖
ιʔείʔυ͔Β୯ޠΛ੾Γग़͠ɺ
ɹᶃͦͷ୯ޠͷछྨΛࣔ͢ه߸ΛܾΊΔ
ɹᶄͦͷ୯ޠͷ࣮ମΛද͢஋Λͭ͘Δ
ɹᶅ୯ޠ͝ͱʹه߸ʹ஋Λඥ͚ͮͯύʔαʹ౉͢
ͱ͍͏ॲཧΛߦ͏

View Slide

;ͨͨͼ͋Δͱ͜Ζʹ͜Μͳιʔείʔυ͕
1 + 2

View Slide

ᶃ୯ޠ͝ͱʹछྨΛࣔ͢ه߸ΛܾΊΔ
U*/5&(&3 b` U*/5&(&3
1 + 2
੔਺஋
Ճࢉه߸
੔਺஋

ه߸
ҙຯ

View Slide

ᶄͦͷ୯ޠͷ࣮ମΛද͢஋Λͭ͘Δ
͜ͷ஋͸ޙͰߏจ໦Λ࡞ΔͨΊͷࡐྉʹͳΔ
/0%&@-*5
1 + 2
/0%&@-*5
਺஋Λද͢஋
਺஋Λද͢஋

Ճࢉه߸

b`

View Slide

ᶅ୯ޠ͝ͱʹه߸ʹ஋Λඥ͚ͮͯύʔαʹ౉͢
1 + 2
ه߸
/0%&@-*5 /0%&@-*5
஋ Ճࢉه߸

b`
U*/5&(&3 U*/5&(&3

View Slide

.3*ʹ͓͚Δύʔαͷओͳ͸ͨΒ͖
εΩϟφ͔Βه߸Λड͚औͬͯ
ɹᶃه߸Λࣗ෼ࣗ਎ͷελοΫʹͨΊΔ
ɹᶄελοΫ಺ͷه߸ͷฒͼ͕ߏจنଇʹҰக͢Δͱɺ
ɹɹΑΓந৅౓ͷߴ͍ه߸΁ม׵͢Δ
ɹᶅม׵ʹϑοΫͯ͠ߏจ໦Λ૊ΈཱͯΔ
ͱ͍͏ॲཧΛߦ͏

View Slide

ͪΐͬͱෳࡶͳͷͰɺ
·ͣ͸ύʔαͷجຊతͳ࢓૊Έ͔Β
֬ೝͯ͠Έ͍ͨͱࢥ͍·͢
˞.3*͕ར༻͍ͯ͠Δ#JTPOʹΑΔύʔαͷ৔߹

View Slide

ύʔα͸ࣗ෼ࣗ਎ͷதʹه߸ΛͨΊ͓ͯͨ͘Ίͷ
ελοΫΛ͍࣋ͬͯΔ
εΩϟφ͔Βड͚औͬͨه߸͸
λΠϛϯάΛਤͬͯελοΫʹૹΒΕΔ
͜ΕΛʮه߸Λγϑτ͢Δʯͱ͍͏

ύʔαͷ͘͠ΈελοΫ
U*/5&(&3
b`
U*/5&(&3

View Slide

ύʔα͸ࣗ෼ࣗ਎ͷதʹͨ͘͞ΜͷߏจنଇΛ͍࣋ͬͯΔ
ߏจنଇʹ͸ͲΜͳ಺༰͕ఆٛ͞Ε͍ͯΔ͔ͱ͍͏ͱʜ
ύʔαͷ͘͠Έߏจنଇ
ߏจنଇྫ

View Slide

ᶃͲΜͳه߸͕ͲΜͳॱ൪ͰฒͿ΂͖͔
ύʔαͷελοΫʹγϑτ͞ΕΔ֤ه߸͸
͍ͣΕ͔ͷنଇʹఆٛ͞ΕͨॱʹฒͿඞཁ͕͋Δ
ύʔαͷ͘͠Έߏจنଇ
ߏจنଇྫᶃU*/5&(&3 b` U*/5&(&3ͷॱͰฒͿ

U*/5&(&3 b` U*/5&(&3

View Slide

ᶄฒΜͩه߸ྻΛͲΜͳه߸ʹม׵͢Δ͔
ελοΫ಺ͷه߸͕ಛఆͷنଇͷॱ൪௨Γʹἧ͏ͱɺ
ͦͷه߸ྻ͸ΑΓந৅౓ͷߴ͍ผͷه߸΁ม׵͞ΕΔ
͜ΕΛʮؐݩʯͱݺͿ

ύʔαͷ͘͠Έߏจنଇ ؐݩ

ม׵ઌ ม׵ݩ
ߏจنଇྫᶄॱ൪௨Γʹه߸͕ฒΜͩΒFYQS΁ؐݩ͢Δ
U*/5&(&3 b` U*/5&(&3
FYQS

View Slide

ᶅ௥ՃͰͲΜͳॲཧΛߦ͏͔ Φϓγϣϯ

ؐݩʹϑοΫͯ͠௥ՃͰ೚ҙͷॲཧΛߦ͏͜ͱ͕Ͱ͖Δ
͜ͷॲཧͷ͜ͱΛʮΞΫγϣϯʯͱݺͿ

.3*Ͱ͸ΞΫγϣϯΛར༻ͯ͠ߏจ໦Λ૊Έཱ͍ͯͯΔ
/0%&@-*5
਺஋

/0%&@-*5
਺஋

b`
Ճࢉه߸

ύʔαͷ͘͠Έߏจنଇ ΞΫγϣϯ

ߏจنଇྫᶅ ௥Ճͷॲཧ
ؐݩʹϑοΫͯ͠ߏจ໦Λ૊ΈཱͯΔ
ߏจ໦
ه߸ͷ஋

View Slide

͜͜·Ͱͷ࿩Λ౿·͑ͯɺ.3*ͷύʔα͕
εΩϟφɺελοΫɺߏจنଇΛۦ࢖ͯ͠
ߏจ໦Λ࡞Γ্͛Δ·Ͱͷ
جຊతͳಈ͖Λ௥͍͔͚ͯΈ·͠ΐ͏

View Slide

ύʔα͸εΩϟφ͔ΒૹΒΕ͖ͯͨه߸Λ
ελοΫ΁γϑτ͢Δ
ύʔαͷελοΫ U*/5&(&3
b`
U*/5&(&3

View Slide

ελοΫ಺ʹͨ·ͬͨه߸ྻ͕
͍ͣΕ͔ͷߏจنଇʹҰக͢Δͱʜ
ύʔαͷελοΫ U*/5&(&3
b`
U*/5&(&3
U*/5&(&3 b` U*/5&(&3
FYQS
ߏจنଇ ྫ

View Slide

ελοΫ಺ͷه߸ྻ͸
ͦͷنଇʹΑͬͯఆΊΒΕͨผͷه߸ʹؐݩ͞ΕΔ
ύʔαͷελοΫ FYQS
U*/5&(&3 b` U*/5&(&3
FYQS
ߏจنଇ ྫ

View Slide

ؐݩલɺελοΫ಺ͷ֤ه߸ʹ͸
ͦΕͧΕͷ࣮ମΛද͢஋͕ඥ͍͍ͮͯΔ
஋
ύʔαͷελοΫ
/0%&@-*5
/0%&@-*5 Ճࢉه߸
U*/5&(&3 b` U*/5&(&3

View Slide

ύʔα͸ؐݩʹϑοΫͯ͠ɺΞΫγϣϯ಺Ͱ
͜ΕΒͷ஋Λࡐྉʹߏจ໦Λ૊ΈཱͯΔ
/0%&@-*5
਺஋

/0%&@-*5
਺஋

b`
Ճࢉه߸

/0%&@01$"--

ߏจ໦ͷࡐྉ
૊ΈཱͯΒΕͨߏจ໦
/0%&@-*5
਺஋

/0%&@-*5
਺஋

View Slide

૊ΈཱͯΒΕͨߏจ໦͸ؐݩޙͷه߸ʹඥ͚ͮΒΕΔ
/0%&@01$"--

/0%&@-*5
਺஋

/0%&@-*5
਺஋

ߏจ໦
ύʔαͷελοΫ
FYQS

View Slide

࠷ऴతʹ͸͢΂ͯͷιʔείʔυΛಡΈऴ͑ͯɺ
ελοΫ಺ͷه߸ྻ͕ه߸QSPHSBN΁ؐݩ͞Εͨ࣌఺Ͱ
ߏจղੳ͕ऴྃ͢Δ
ύʔαͷελοΫ
QSPHSBN

View Slide

ه߸QSPHSBN͕ؐݩ͞Εͨ࣌఺Ͱߏจ໦ͷ૊Έཱͯ΋
׬ྃ͠ɺ͜ͷߏจ໦͸ͦͷޙ:"37όΠτίʔυ΁
ίϯύΠϧ͞ΕΔ
/0%&@01$"--

/0%&@-*5
਺஋

/0%&@-*5
਺஋

ߏจ໦
QSPHSBN
ύʔαͷελοΫ

View Slide


View Slide

·ͣ͸ߏจղੳͷ༷ࢠΛಡΉʹ͋ͨͬͯ
ศརͳπʔϧΛ͝঺հ͠·͢

View Slide

ߏจղੳศརπʔϧ
Φϓγϣϯ
3VCZͷιʔείʔυΛ࣮ߦ͢Δͱ͖ɺ
ɹίϚϯυʹɹɹΦϓγϣϯΛ͚ͭΔ͜ͱͰ
ߏจղੳͷաఔͷϩάΛඪ४ग़ྗ͢Δ͜ͱ͕Ͱ͖Δ
ruby -y
$ ruby -ye ‘1 + 2’

…
-y

View Slide

.3*ͷ࣮ࡍͷߏจنଇ͸.3*ͷιʔείʔυʹؚ·ΕΔ
QBSTFZʹఆٛ͞Ε͍ͯΔ
/**********************************************************************

parse.y -

$Author$

created at: Fri May 28 18:02:42 JST 1993

Copyright (C) 1993-2007 Yukihiro Matsumoto

**********************************************************************/

// …

%%

// …

%%

// …
IUUQTHJUIVCDPNSVCZSVCZCMPCW@@QBSTFZ

Ͱғ·Ε͍ͯΔ෦෼ʹߏจنଇ͕ఆٛ͞Ε͍ͯΔ
QBSTFZϑΝΠϧ

View Slide

QBSTFZϑΝΠϧ
method_call : primary_value call_op operation2 opt_paren_args

{

$$ = new_qcall(p, $2, $1, $3, $4, &@3, &@$);

nd_set_line($$, @3.end_pos.lineno);

}
ߏจنଇͷಡΈํɹྫQBSTFZ- ؆ུԽ͍ͯ͠·͢

View Slide

QBSTFZϑΝΠϧ

{

$$ = new_qcall(p, $2, $1, $3, $4, &@3, &@$);


}
ؐݩޙͷه߸ ؐݩલͷه߸ྻ
ΞΫγϣϯ Φϓγϣφϧ


View Slide


{

$$ = new_qcall(p, $2, $1, $3, $4, &@3, &@$);


}
QBSTFZϑΝΠϧ
ҙຯ
ᶃQSJNBSZ@WBMVF DBMM@PQ PQFSBUJPO PQU@QBSFO@BSHT͕ฒΜͩΒ
ɹNFUIPE@DBMM΁ؐݩ͢Δ
ᶄؐݩʹϑοΫͯ͠OFX@RDBMMؔ਺ͱOE@TFU@MJOFؔ਺Λݺͼग़͢
ؐݩޙͷه߸ ؐݩલͷه߸ྻ
ΞΫγϣϯ Φϓγϣφϧ


View Slide

ͦΕͰ͸࣮ࡍʹ.3*͕ߏจղੳΛ͢Δ
଍औΓΛ௥͍͔͚ͯΈ·͠ΐ͏
࣮ߦ؀ڥ
ɹ04NBD04.POUFSFZ
ɹ$16"QQMF.
ɹ3VCZ

View Slide

$ ruby -ye ‘1 + 2’

ࠓճղੳ͢Δίʔυ͸

ߏจղੳΛ։࢝͢Δ
$ ruby -y ίϚϯυΛ࢖༻ͯ͠

View Slide

$ ruby -ye ‘1 + 2’

add_delayed_token:7062 (0: 0|0|0)

Starting parse
ߏจղੳΛ։࢝

View Slide

$ ruby -ye ‘1 + 2’


Starting parse

Entering state 0

Stack now 0

Reducing stack by rule 1 (line 1580):

lex_state: NONE -> BEG at line 1581

vtable_alloc:13130: 0x00006000034e9b40

vtable_alloc:13131: 0x00006000034e9b60

cmdarg_stack(push): 0 at line 13144

cond_stack(push): 0 at line 13145

-> $$ = nterm $@1 (1.0-1.0: )
QBSTFZͷߦ໨ʹఆٛ͞Ε͍ͯΔ
ߏจنଇʹैͬͯؐݩΛ։࢝

View Slide

$ ruby -ye ‘1 + 2’


Starting parse

Entering state 0

Stack now 0


lex_state: NONE -> BEG at line 1581

vtable_alloc:13130: 0x00006000034e9b40

vtable_alloc:13131: 0x00006000034e9b60

cmdarg_stack(push): 0 at line 13144

cond_stack(push): 0 at line 13145

-> $$ = nterm $@1 (1.0-1.0: )
ߏจنଇ͸ࠓ͔Βߏจղੳ͢Δ४උΛ
ߦ͏ͨΊͷಛघͳنଇͳͷͰ
ࠓճ͸ৄࡉΛׂѪ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 2

Stack now 0 2

Reading a token

ͦͷ͙͢ޙɺύʔα͸εΩϟφΛ࢖ͬͯ
ιʔείʔυ͔Βه߸ΛಡΈࠐΉ
ه߸ΛಡΈࠐΉ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 2

Stack now 0 2

Reading a token

lex_state: BEG -> END at line 9005

lex_state: END -> END at line 8282

parser_dispatch_scan_event:10499 (1: 0|1|5)

Next token is token "integer literal" (1.0-1.1: 1)

Shifting token "integer literal" (1.0-1.1: 1)
࣍ͷه߸͸JOUFHFSMJUFSBMzͩͬͨ
ͷͷ෦෼

JOUFHFSMJUFSBMz U*/5&(&3
Λγϑτ
˞lJOUFHFSMJUFSBMz͸
ɹߏจنଇ্U*/5&(&3ͱදݱ͞ΕΔ
U*/5&(&3
ύʔαͷελοΫ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 41

Stack now 0 2 41


$1 = token "integer literal" (1.0-1.1: 1)

-> $$ = nterm simple_numeric (1.0-1.1: NODE_LIT)

U*/5&(&3ΛTJNQMF@OVNFSJDʹؐݩ
// parse.y: L5383

simple_numeric : tINTEGER
ύʔαͷελοΫ
TJNQMF@OVNFSJD

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 120

Stack now 0 2 120


$1 = nterm simple_numeric (1.0-1.1: NODE_LIT)

-> $$ = nterm numeric (1.0-1.1: NODE_LIT)

TJNQMF@OVNFSJDΛOVNFSJDʹؐݩ
// parse.y: L5372

numeric : simple_numeric
ύʔαͷελοΫ
OVNFSJD

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 119

Stack now 0 2 119


$1 = nterm numeric (1.0-1.1: NODE_LIT)

-> $$ = nterm literal (1.0-1.1: NODE_LIT)

// parse.y: L4998

literal : numeric
OVNFSJDΛMJUFSBMʹؐݩ
ύʔαͷελοΫ
MJUFSBM

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 106

Stack now 0 2 106


$1 = nterm literal (1.0-1.1: NODE_LIT)

-> $$ = nterm primary (1.0-1.1: NODE_LIT)

// parse.y: L3220

primary : literal
MJUFSBMΛQSJNBSZʹؐݩ
ύʔαͷελοΫ
QSJNBSZ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 106

Stack now 0 2 106




ɾ͜͜·ͰͰͷΛ
ɹه߸QSJNBSZͱͯ͠ղੳͰ͖ͨ
ɾه߸QSJNBSZ͸ɺ͜ͷޙ
ɹͲΜͳه߸ͱ૊Έ߹ΘͤΔ͔ʹΑͬͯ
ɹద༻͢Δߏจنଇͱؐݩઌͷه߸͕
ɹมΘΔ
ɾύʔα͸ɺ͜ͷޙͷ
ɹιʔείʔυʹ͕ଓ͘͜ͱΛ
ɹࠓͷ࣌఺Ͱ͸·ͩ஌Βͳ͍
ύʔαͷελοΫ
QSJNBSZ
ߏจղੳͷݱࡏ஍఺

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 90

Stack now 0 2 90

Reading a token
࣍ͷه߸ΛಡΈࠐΉ
࣍ͷه߸Λ֬ೝ͢ΔͨΊɺ
ύʔα͸εΩϟφΛ࢖ͬͯ
ιʔείʔυ͔Βه߸ΛಡΈࠐΉ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 90

Stack now 0 2 90

Reading a token


lex_state: END -> BEG at line 10181


Next token is token '+' (1.2-1.3: )
࣍ͷه߸͸b`ͩͬͨ
ύʔαͷελοΫ
QSJNBSZ
ύʔα͸࣍ͷه߸͕b`Ͱ͋Δͱ͖
ه߸QSJNBSZʹରͯ͠
ͲΜͳߏจنଇΛద༻͢Δ΂͖͔൑அ͢Δ

View Slide

$ ruby -ye ‘1 + 2’

…

Reading a token






$1 = nterm primary (1.0-1.1: NODE_LIT)

-> $$ = nterm arg (1.0-1.1: NODE_LIT)

QSJNBSZΛBSHʹؐݩ
// parse.y: 2906

arg : primary
ύʔαͷελοΫ
BSH
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 88

Stack now 0 2 88


Shifting token '+' (1.2-1.3: ) b`Λγϑτ
ύʔαͷελοΫ
BSH b`
ղੳΛଓ͚ΔͨΊʹύʔα͸
ઌ΄Ͳ֬ೝͨ࣍͠ͷه߸b`Λ
ελοΫʹγϑτ͢Δ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 88

Stack now 0 2 88


Shifting token '+' (1.2-1.3: )
ɾ͜ͷ࣌఺ͰελοΫ಺ʹ͋Δ
ɹ<BSHb`>ͱ͍͏ه߸ͷฒͼͰ
ɹؐݩͰ͖Δߏจنଇ͸ଘࡏ͠ͳ͍
ύʔαͷελοΫ
BSH b`

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 367

Stack now 0 2 88 367

Reading a token
࣍ʹؐݩͰ͖ΔنଇΛݟ͚ͭΔͨΊɺ
ύʔα͸εΩϟφΛ࢖ͬͯ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 367


Reading a token


lex_state: BEG -> END at line 9005

lex_state: END -> END at line 8282


Next token is token "integer literal" (1.4-1.5: 2)

Shifting token "integer literal" (1.4-1.5: 2)

࣍ͷه߸͸lJOUFHFSMJUFSBMzͩͬͨ
ͷͷ෦෼

lJOUFHFSMJUFSBMz U*/5&(&3
Λγϑτ
ύʔαͷελοΫ
BSH b` U*/5&(&3

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 41

Stack now 0 2 88 367 41


$1 = token "integer literal" (1.4-1.5: 2)

-> $$ = nterm simple_numeric (1.4-1.5: NODE_LIT)

U*/5&(&3ΛTJNQMF@OVNFSJDʹؐݩ
// parse.y: L5383

simple_numeric : tINTEGER
ύʔαͷελοΫ
BSH b` TJNQMF@OVNFSJD

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 120

Stack now 0 2 88 367 120


$1 = nterm simple_numeric (1.4-1.5: NODE_LIT)

-> $$ = nterm numeric (1.4-1.5: NODE_LIT)

TJNQMF@OVNFSJDΛOVNFSJDʹؐݩ
// parse.y: L5372

numeric : simple_numeric
ύʔαͷελοΫ
BSH b` OVNFSJD

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 119

Stack now 0 2 88 367 119


$1 = nterm numeric (1.4-1.5: NODE_LIT)

-> $$ = nterm literal (1.4-1.5: NODE_LIT)

// parse.y: L4998

literal : numeric
OVNFSJDΛMJUFSBMʹؐݩ
ύʔαͷελοΫ
BSH b` MJUFSBM

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 106

Stack now 0 2 88 367 106




// parse.y: L3220

primary : literal
MJUFSBMΛQSJNBSZʹؐݩ
ύʔαͷελοΫ
BSH b` QSJNBSZ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 106

Stack now 0 2 88 367 106




ɾ ઌ΄Ͳͱಉ͘͡

ɾه߸QSJNBSZ͸ɺ͜ͷޙ
ɹͲΜͳه߸ͱ૊Έ߹ΘͤΔ͔ʹΑͬͯ
ɹద༻͢Δߏจنଇͱؐݩઌͷه߸͕
ɹมΘΔ
ɾύʔα͸ɺ͜ͷޙ
ɹιʔείʔυ͕ऴྃ͢Δ͜ͱΛ
ύʔαͷελοΫ
BSH b` QSJNBSZ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 90

Stack now 0 2 88 367 90

Reading a token ࣍ͷه߸ΛಡΈࠐΉ
ͦΕΛ֬ೝ͢ΔͨΊɺύʔα͸
εΩϟφΛ࢖ͬͯ࣍ͷه߸ΛಡΈࠐΉ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 90

Stack now 0 2 88 367 90

Reading a token



Next token is token '\n' (1.5-1.6: )
࣍ͷه߸͸baO վߦίʔυ
ͩͬͨ
ύʔαͷελοΫ
BSH b` QSJNBSZ
ύʔα͸࣍ͷه߸͕baO`Ͱ͋Δͱ͖
ه߸QSJNBSZʹରͯ͠ͲΜͳߏจنଇΛ
ద༻͢Δ΂͖͔൑அ͢Δ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 90

Stack now 0 2 88 367 90

Reading a token





$1 = nterm primary (1.4-1.5: NODE_LIT)

-> $$ = nterm arg (1.4-1.5: NODE_LIT)

QSJNBSZΛBSHʹؐݩ
// parse.y: 2906

arg : primary
ύʔαͷελοΫ
BSH b` BSH
ελοΫʹ
BSH b` BSH͕ฒΜͩ
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602



$1 = nterm arg (1.0-1.1: NODE_LIT)

$2 = token '+' (1.2-1.3: )


-> $$ = nterm arg (1.0-1.5: NODE_OPCALL)

// parse.y: L2745

arg : arg ‘+’ arg
BSHb`BSHΛBSHʹؐݩ
ύʔαͷελοΫ
BSH
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602




$2 = token '+' (1.2-1.3: )



// parse.y: L2745
BSHBSHb`BSH
\

DBMM@CJO@PQ Q b ! !

^
˞؆ུԽ͍ͯ͠·͢

͜ͷߏจنଇʹ͸
ߏจ໦Λ૊ΈཱͯΔͨΊͷ
ΞΫγϣϯ͕ఆٛ͞Ε͍ͯΔ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602




$2 = token '+' (1.2-1.3: )



˞؆ུԽ͍ͯ͠·͢

ߏจ໦Λ૊ΈཱͯΔؔ਺͕
ݺͼग़͞Ε͍ͯΔ
// parse.y: L2745
BSHBSHb`BSH
\

DBMM@CJO@PQ Q b ! !

^

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602




$2 = token '+' (1.2-1.3: )



BSHBSHb`BSH
\

DBMM@CJO@PQ Q b ! !

^
˞؆ུԽ͍ͯ͠·͢

Ҿ਺ʹه߸ͷ஋Λ౉͍ͯ͠Δ
ʜࠨͷBSHͷ஋ ਺஋

b`ʜՃࢉه߸
ʜӈͷBSHͷ஋ ਺஋

// parse.y: L2745

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602




$2 = token '+' (1.2-1.3: )



˞؆ུԽ͍ͯ͠·͢

͜ͷؔ਺Λ࣮ߦ͢Δͱ
૊ΈཱͯΒΕͨߏจ໦͕ฦͬͯ͘Δ
// parse.y: L2745
BSHBSHb`BSH
\

DBMM@CJO@PQ Q b ! !

^

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602




$2 = token '+' (1.2-1.3: )



˞؆ུԽ͍ͯ͠·͢

૊ΈཱͯΒΕͨߏจ໦͕
ؐݩޙͷه߸BSHʹඥͮ͘஋Λද͢
ʹ୅ೖ͞ΕΔ
BSHBSHb`BSH
\

DBMM@CJO@PQ Q b ! !

^
// parse.y: L2745

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 602

Stack now 0 2 88 367 602




$2 = token '+' (1.2-1.3: )



ύʔαͷελοΫ
BSH
/0%&@01$"--

/0%&@-*5
਺஋

/0%&@-*5
਺஋

ߏจ໦
͜ΕʹΑͬͯؐݩޙͷه߸BSHʹ
ߏจ໦͕ඥ͍ͮͨঢ়ଶʹͳΔ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 88

Stack now 0 2 88



$1 = nterm arg (1.0-1.5: node_opcall)

-> $$ = nterm expr (1.0-1.5: node_opcall)

// parse.y: 2051

expr : arg
BSHΛFYQSʹؐݩ
ύʔαͷελοΫ
FYQS
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 75

Stack now 0 2 75



$1 = nterm expr (1.0-1.5: NODE_OPCALL)

-> $$ = nterm stmt (1.0-1.5: NODE_OPCALL)
// parse.y: 1853

stmt : expr
FYQSΛTUNUʹؐݩ
ύʔαͷελοΫ
TUNU
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 73

Stack now 0 2 73



$1 = nterm stmt (1.0-1.5: NODE_OPCALL)

-> $$ = nterm top_stmt (1.0-1.5: NODE_OPCALL)

// parse.y: 1635

top_stmt : stmt
TUNUΛUPQ@TUNUʹؐݩ
ύʔαͷελοΫ
UPQ@TUNU
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 72

Stack now 0 2 72


$1 = nterm top_stmt (1.0-1.5: NODE_OPCALL)

-> $$ = nterm top_stmts (1.0-1.5: NODE_OPCALL)

// parse.y: 1619

top_stmts : top_stmt
UPQ@TUNUΛUPQ@TUNUTʹؐݩ
ύʔαͷελοΫ
UPQ@TUNUT
˞؆ུԽ͍ͯ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 72

Stack now 0 2 72


$1 = nterm top_stmt (1.0-1.5: NODE_OPCALL)

-> $$ = nterm top_stmts (1.0-1.5: NODE_OPCALL)

ɾ͜͜·ͰͰ
ɹΛղੳͰ͖ͨ
ɾ͋ͱ͸վߦίʔυaOΛ
ɹಡΈࠐΜͰ͜ͷߦΛऴ୺ͤ͞Δ
ɹඞཁ͕͋Δ
ύʔαͷελοΫ
UPQ@TUNUT
˞վߦޙʹϝιουݺͼग़͠ͷAA υοτ
͕
ɹଓ͘έʔε͸εΩϟφͰରԠ͍ͯ͠·͕͢
ɹࠓճ͸ղઆΛׂѪ͠·͢

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 71

Stack now 0 2 71


Shifting token '\n' (1.5-1.6: ) baOΛγϑτ
࣍ͷه߸͸aO ߦ຤
ͩͬͨ
ύʔαͷελοΫ
UPQ@TUNUT baO`

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 310



$1 = token '\n' (1.5-1.6: )

-> $$ = nterm term (1.5-1.5: )

// parse.y: 6115

term : ‘\n’
baO`ΛUFSNʹؐݩ
ύʔαͷελοΫ
UPQ@TUNUT UFSN

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 312



$1 = nterm term (1.5-1.5: )

-> $$ = nterm terms (1.5-1.5: )

// parse.y: 6122

terms : term
UFSNΛUFSNTʹؐݩ
ύʔαͷελοΫ
UPQ@TUNUT UFSNT

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 312



$1 = nterm term (1.5-1.5: )

-> $$ = nterm terms (1.5-1.5: )

ɾ͜͜·ͰͰ
ɹaOΛղੳͰ͖ͨ
ɾύʔα͸͜ͷίʔυ͕
ɹ͜͜ͰऴΘΔͷ͔ɺ
ɹ͜ͷޙ͞ΒʹߦҎ্ଓ͍͍ͯ͘ͷ͔Λ
ύʔαͷελοΫ
UPQ@TUNUT UFSNT

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 313


Reading a token

ͦΕΛ֬ೝ͢ΔͨΊɺύʔα͸
εΩϟφΛ࢖ͬͯ࣍ͷه߸ΛಡΈࠐΉ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 313


Reading a token

Now at end of input.

͔͠͠ɺ͜ͷίʔυ͸͜ͷҰߦͰ
ऴ͍ྃͯ͠ΔͷͰ࣍ͷߦ͸ଘࡏ͠ͳ͍
࣍ͷೖྗ͸ͳ͍

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 313


Reading a token

࣍ͷೖྗ͸ͳ͍
ύʔαͷελοΫ
UPQ@TUNUT UFSNT
ύʔα͸࣍ͷه߸͕ଘࡏ͠ͳ͍ͱ͖
ه߸UFSNTʹରͯ͠ͲΜͳߏจنଇΛ
ద༻͢Δ΂͖͔൑அ͢Δ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 313


Reading a token



$1 = nterm terms (1.5-1.5: )

-> $$ = nterm opt_terms (1.5-1.5: )

// parse.y: 6094

opt_terms : terms
UFSNTΛPQU@UFSNTʹؐݩ
ύʔαͷελοΫ
UPQ@TUNUT PQU@UFSNT
ελοΫʹ
UPQ@TUNUT PQU@UFSNT͕ฒΜͩ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 311



$1 = nterm top_stmts (1.0-1.5: NODE_OPCALL)

$2 = nterm opt_terms (1.5-1.5: )

-> $$ = nterm top_compstmt (1.0-1.5: NODE_OPCALL)
// parse.y: 1606

top_compstmt : top_stmts opt_terms
UPQ@TUNUT PQU@UFSNTΛ
UPQ@DPNQTUNUʹؐݩ
ύʔαͷελοΫ
UPQ@DPNQTUNUT

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 70

Stack now 0 2 70


$1 = nterm $@1 (1.0-1.0: )

$2 = nterm top_compstmt (1.0-1.5: NODE_OPCALL)

…

cmdarg_stack(pop): 0 at line 13166

cond_stack(pop): 0 at line 13167

-> $$ = nterm program (1.0-1.5: )

// parse.y: 1580

program : top_compstmt
UPQ@DPNQTUNUΛQSPHSBNʹؐݩ
ύʔαͷελοΫ
QSPHSBN

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 70

Stack now 0 2 70


$1 = nterm $@1 (1.0-1.0: )

$2 = nterm top_compstmt (1.0-1.5: NODE_OPCALL)

…

cmdarg_stack(pop): 0 at line 13166

cond_stack(pop): 0 at line 13167

-> $$ = nterm program (1.0-1.5: )

ύʔαͷελοΫ
QSPHSBN
ɾه߸QSPHSBN΁
ɹؐݩ͢Δ͜ͱ͕Ͱ͖ͨͨΊ
ɹύʔα͸͜͜·ͰͰ
ɹߏจղੳΛऴྃ͢Δ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 1

Stack now 0 1


Shifting token "end-of-input" (1.6-1.6: )

Entering state 3

Stack now 0 1 3

Stack now 0 1 3

Cleanup: popping token "end-of-input" (1.6-1.6: )

Cleanup: popping nterm program (1.0-1.5: )

ελοΫΛۭʹͯ͠
ਖ਼ৗʹೖྗ͕ऴΘͬͨ͜ͱΛ֬ೝ͠ɺ
ॲཧΛऴྃ
ޙॲཧͷͨΊɺ
ೖྗͷऴྃΛදݱ͢Δه߸Λ
ελοΫʹγϑτ

View Slide

$ ruby -ye ‘1 + 2’

…

Entering state 1

Stack now 0 1


Shifting token "end-of-input" (1.6-1.6: )

Entering state 3

Stack now 0 1 3

Stack now 0 1 3

Cleanup: popping token "end-of-input" (1.6-1.6: )

Cleanup: popping nterm program (1.0-1.5: )

a໨త஍΁౸ண

View Slide

͓͔ͭΕ͞·Ͱͨ͠
3VCZͱҰॹʹ८ΔߏจղੳπΞʔ͸
͓ͨͷ͠Έ͍͚ͨͩͨͰ͠ΐ͏͔

View Slide

·ͱΊ
ɹɹΦϓγϣϯ͕͋Ε͹͍ͭͰ΋Ͳ͜Ͱ΋
खܰʹߏจղੳϩάΛग़ྗͰ͖·͢
QBSTFZϑΝΠϧ͕͋Ε͹ΑΓৄࡉʹ
ߏจղੳͷ࣮ࡍΛ֬ೝ͢Δ͜ͱ͕Ͱ͖·͢

-y
Έͳ͞Μ΋ͥͻ͓खݩͷ.3*Ͱ͓ࢼ͍ͩ͘͠͞

View Slide

͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠
4QFDJBMUIBOLTUP ܟশུ

!TQJLFPMBG
!NJOFSPBPLJ
ࢀߟॻ੶
3VCZιʔείʔυ׬શղઆɹୈೋ෦ʮߏจղੳʯ
IUUQTJMPWFSVCZOFUKBSIHCPPL

3VCZͷ͘͠Έɹ̍ࣈ۟ղੳͱߏจղੳ

View Slide

たのしいRubyの構文解析ツアー

たのしいRubyの構文解析ツアー

Misaki Shioi(塩井美咲/しおい)

More Decks by Misaki Shioi(塩井美咲/しおい)

Other Decks in Programming

Featured

Transcript