Eyeriss Tiling

Transcript

1. Eyeriss Tiling 1 © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved.
2. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 2 Eyeriss – Summary of Notation Parameter Description N batch size H/W input height/width R/S filter height/width E/F output height/width C input channels M output channels U stride P padding Parameter Description m number of ofmap channels stored in the global buffer n number of ofmaps/ifmaps used in a processing pass e width of the PE set (strip-mined if nessary) p number of filters processed by a PE set q number of ifmap/filter channels processed by a PE set r number of PE sets for different ifmap/filter channels t number of PE sets for different filters Conv2D Shape Parameter RS Dataflow Mapping Parameter
3. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 3 Eyeriss – Processing Pass Processing Pass The PE array can run multiple 2-D convolutions from up to q x r channels of p x t filters simultaneously. Multiple ifmaps can also be processed sequentially through the PE array. 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑈 𝑒 − 1 + 𝑅 𝑝 ∗ 𝑡 𝑝 ∗ 𝑡 𝑒 𝑚 1 1 GLB usage formula i𝑓𝑚𝑎𝑝 𝑛 ∗ 𝑞𝑟 ∗ 𝑈 𝑒 − 1 + 𝑅 ∗ 𝑊 ∗ 1𝑏𝑦𝑡𝑒 𝑓𝑖𝑙𝑡𝑒𝑟 𝑝𝑡 ∗ 𝑞𝑟 ∗ 𝑅 ∗ 𝑆 ∗ 1𝑏𝑦𝑡𝑒 b𝑖𝑎𝑠 𝑝𝑡 ∗ 4𝑏𝑦𝑡𝑒s 𝑝𝑠𝑢𝑚 & 𝑜𝑝𝑠𝑢𝑚 𝑛 ∗ 𝑚 ∗ 𝑒 ∗ 𝐹 ∗ 4𝑏𝑦𝑡𝑒𝑠
4. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 4 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑈 𝑒 − 1 + 𝑅 𝑝 ∗ 𝑡 𝑝 ∗ 𝑡 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
5. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 5 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑝 ∗ 𝑡 𝑚 1 1 𝑅𝑒𝑢𝑠𝑒 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
6. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 6 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑝 ∗ 𝑡 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
7. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 7 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
8. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 8 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑝 ∗ 𝑡 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
9. For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1 © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 9 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑚 1 1
10. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 10 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
11. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 11 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 ifmap filter bias ofmap 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
12. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 12 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑈 𝑒 − 1 + 𝑅 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
13. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 13 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑈 𝑒 − 1 + 𝑅 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
14. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 14 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
15. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 15 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
16. For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1 © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 16 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑒 1 1
17. For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1 © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 17 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑒 1 1
18. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 18 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1
19. © 2026 AI System Lab, National Cheng Kung University (NCKU). All rights reserved. 19 Eyeriss – Computation Ordering Computation Ordering • 𝑚 → 𝐶 → 𝐸 → 𝑀 • Final Round 𝐶 𝐶 𝐻 𝑊 𝐹 𝑆 𝑅 𝑀 𝑀 𝐸 𝑝 ∗ 𝑡 𝑚 𝑀 Ifmap filter bias ofmap 𝑒 𝑚 1 1 For simplicity, let us assume that... 𝑀 = 2𝑚 𝑚 = 2𝑝𝑡 𝐸 = 2𝑒 𝐶 = 2𝑞𝑟 N = n = 1