Applications 7 Application Domain Etherpad Lite Document Collaboration Let’s Chat Messaging Lighter Content Management Mud Gaming Todo Task Management Word Finder API Services https://github.com/nodebenchmark/
Event 2 Event 1 Event 3 Root Cause Analysis 12 … … Instruction Stream High I-$ Miss Ratio Inter-event Code Reuse Large Instruction Reuse-distance Large Event Footprint
Root Cause Analysis 16 High I-$ Miss Ratio Inter-event Code Reuse Large Event Footprint Few Event Types Minimal Tight Loops Large Instruction Reuse-distance
Root Cause Analysis 16 High I-$ Miss Ratio Inter-event Code Reuse Large Event Footprint Few Event Types Minimal Tight Loops Large Instruction Reuse-distance Event-driven Applications
Microarchitecture Behaviors Root Cause Analysis 16 High I-$ Miss Ratio Inter-event Code Reuse Large Event Footprint Few Event Types Minimal Tight Loops Large Instruction Reuse-distance Event-driven Applications
Application Characteristics Microarchitecture Behaviors Root Cause Analysis 16 High I-$ Miss Ratio Inter-event Code Reuse Large Event Footprint Few Event Types Minimal Tight Loops Large Instruction Reuse-distance Event-driven Applications
Application Characteristics Microarchitecture Behaviors Root Cause Analysis 16 High I-$ Miss Ratio Inter-event Code Reuse Large Event Footprint Few Event Types Minimal Tight Loops Large Instruction Reuse-distance Event-driven Applications
Exploit Inter-Event Locality 19 1. Retain the reused portion of an event’s footprint in the cache 2. Prefetch the unretained part … … Event 1 Instruction Stream Event 2 Event 3
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache 20 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j k Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j k Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j k … … … … … … … k j Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j k … … … … … … … k j a Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j k … … … … … … … k j a MISS Exploit Inter-Event Locality
2. Prefetch the unretained part 1. Retain the reused portion of an event’s footprint in the cache ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 20 a b c d e f g h i PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache MRU LRU j k Inter-event Locality Lost! … … … … … … … k j a MISS Exploit Inter-Event Locality
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU j
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU j
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU k j
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU j k
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU j k a
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU j k a HIT
Exploit Inter-Event Locality 2. Prefetch the unretained part ▸ LRU Cache Insertion Policy (LIP) (Qureshi et al., [ISCA’07])
▹ Insert incoming line into LRU position, not MRU position 21 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache a b c d e f g h i MRU LRU j k Reused Portion Retained! a HIT
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
▹ Find patterns in miss sequences … … x y z x y z y
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
▹ Find patterns in miss sequences … … x y z x y z y
Exploit Inter-Event Locality 2. Prefetch the unretained part 25 PRINCIPLES PRACTICES 1. Retain the reused portion of an event’s footprint in the cache ▸ Temporal Instruction Fetch Streaming (TIFS) (Ferdman et al., [MICRO’08])
▹ Find patterns in miss sequences … … x y z x y z y z …
queeten
classijp
sakunao
wingnus
hirokiyamazaki
samuraicurry
_sur4j_
motherhoodinadhd
kfujita
dwchiang
bernhardsvt
fullfull
hide2kano
vanstee
bluesmoon
mza
brad_frost
tanoku
bryan
jponch
keathley
eitanlees
philhawksworth
scottboms
pedronauck