Share
Embed
Locality of Reference
What is Locality of Reference?
What problem for it?
How to resolve it?
--------
Lower layer studying meetup #1
https://nagoyabin.connpass.com/event/66865/
Kouji Matsui PRO
October 28, 2017
Transcript
27 slides
-
Kouji Matsui - kekyo • NAGOYA city, AICHI pref., JP
• Twitter – @kekyo2 / Facebook • ux-spiral corporation • Microsoft Most Valuable Professional VS and DevTech 2015- • Certified Scrum master / Scrum product owner • Center CLR organizer. • .NET/C#/F#/IL/metaprogramming or like… • Bike rider -
Agenda •Physical side scales •Logical side scales •Data stream between
physicals and logicals •Locality of reference •Anti-locality of reference •Conclusion -
Physical side scales Processor #1 Physical Core #4 Logical Core
#1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #3 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #2 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Processor #2 Physical Core #8 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #7 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #6 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #5 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #17 Processor #3 Physical Core #12 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #11 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #10 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #1 Physical Core #9 Logical Core #1 Logical Core #1 Logical Core #1 Logical Core #33 -
Physical side scales The memory/IO bind at the fixed CPU/Core
(Non configurable) -
Physical side scales The “shared cache memory” bind at the
fixed CPU/Core (Non configurable) -
Physical side scales The “cache memory” bind at the fixed
CPU/Core (Non configurable) The “shared cache memory” bind at the fixed CPU/Core (Non configurable) -
Agenda •Physical side scales •Logical side scales •Data stream between
physicals and logicals •Locality of reference •Anti-locality of reference •Conclusion -
Logical side scales Process #1 Virtual Memory Space Thread #1
Thread #1 Thread #1 Thread #1 Thread #1 Process #2 Virtual Memory Space Thread #1 Thread #1 Thread #1 Thread #1 Thread #11 Process #3 Virtual Memory Space Thread #1 Thread #1 Thread #1 Thread #1 Thread #21 Process #4 Virtual Memory Space Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Process #5 Virtual Memory Space Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 -
Logical side scales Thread #1 Thread #1 Thread #1 Thread
#1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #11 Thread #1 Thread #1 Thread #1 Thread #1 Thread #21 Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 Logical Core #2 Logical Core #1 This is true story Execution context -
Logical side scales Thread #1 Thread #1 Thread #1 Thread
#1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #11 Thread #1 Thread #1 Thread #1 Thread #1 Thread #21 Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 Logical Core #2 Logical Core #1 Switch execution context -
Agenda •Physical side scales •Logical side scales •Data stream between
physicals and logicals •Locality of reference •Anti-locality of reference •Conclusion -
Data stream between physicals and logicals Thread #1 Thread #1
Thread #1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #1 Thread #11 Thread #1 Thread #1 Thread #1 Thread #1 Thread #21 Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 Logical Core #2 Logical Core #1 L1/L2 cache #1 L1/L2 cache #2 L1/L2 cache #4 L1/L2 cache #3 -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #1
Thread #1 Thread #1 Thread #1 Thread #1 Thread #11 Thread #1 Thread #1 Thread #1 Thread #1 Thread #21 Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 Logical Core #2 Logical Core #1 L1/L2 cache #1 L1/L2 cache #2 L1/L2 cache #4 L3 cache #1 L3 cache #2 L1/L2 cache #3 -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #1
Thread #1 Thread #1 Thread #1 Thread #1 Thread #11 Thread #1 Thread #1 Thread #1 Thread #1 Thread #21 Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 Logical Core #2 Logical Core #1 L1/L2 cache #1 L1/L2 cache #2 L1/L2 cache #3 L1/L2 cache #4 L3 cache #1 L3 cache #2 NUMA node bound memory -
Agenda •Physical side scales •Logical side scales •Data stream between
physicals and logicals •Locality of reference •Anti-locality of reference •Conclusion -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #31
Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 L1/L2 cache #4 L3 cache #2 NUMA node bound memory declaredType currentType stopType field FieldInfo[] Thread #33 context Load/Preload -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #31
Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 L1/L2 cache #4 L3 cache #2 NUMA node bound memory __stack0_0 Thread #42 context __stack0_1 __stack0_2 __stack1_0 declaredType currentType local0 local1 field Load/Preload Switch -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #21
Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 L1/L2 cache #3 L1/L2 cache #4 L3 cache #2 NUMA node bound memory declaredType currentType stopType field FieldInfo[] -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #21
Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 L1/L2 cache #3 L1/L2 cache #4 L3 cache #2 NUMA node bound memory declaredType currentType stopType field FieldInfo[] stopType field FieldInfo[] field Load/Preload Switch -
Agenda •Physical side scales •Logical side scales •Data stream between
physicals and logicals •Locality of reference •Anti-locality of reference •Conclusion -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #21
Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 L1/L2 cache #3 L1/L2 cache #4 L3 cache #2 NUMA node bound memory Common value Common value Common value Load/Preload Load/Preload These threads access common value -
Thread #1 Thread #1 Thread #1 Thread #1 Thread #21
Thread #1 Thread #1 Thread #1 Thread #1 Thread #31 Thread #1 Thread #1 Thread #1 Thread #1 Thread #41 Logical Core #4 Logical Core #3 L1/L2 cache #3 L1/L2 cache #4 L3 cache #2 NUMA node bound memory Common value Common value Common value Race condition (Receive coherence penalty) STRATEGY: • Turn to immutable • Hashed indexer Write back Write back -
Agenda •Physical side scales •Logical side scales •Data stream between
physicals and logicals •Locality of reference •Anti-locality of reference •Conclusion -
Conclusion The execution context bounds not THREAD. The code executor
is CPU CORE. CPU cores have structuable nested cache system. Cache miss penalty is large. Cache coherency penalty is large. Both I/O systems too. Important cache-related architecture: ◦ Locality of reference ◦ Immutable -
Thanks join! My blog ◦ http://www.kekyo.net/ Current active project: ◦
IL2C - A translator implementation of .NET intermediate language to C language. ◦ YouTube: http://bit.ly/2xtu4MH ◦ GitHub: https://github.com/kekyo/IL2C