4 3PVHITLFUDI 8IBUEPQBQFSTMPPLMJLF Abstract Introduction Methods Related Work Experiments Conclusion References !Consists of many different sections !Each section seems to have different roles and contents "What should we write in each section? "How to make sure the consistency?
5 'JOFSHSBJOFETLFUDI 8IBUEPQBQFSTMPPLMJLF Methods Related Work Experiments References !Papers are intentionally redundant for better understanding !Repeat of the basic arguments in different resolution "Just focus on structuring the basic arguments! 1. Background 2. Methods 3. Experiments Methods Experiments Background Methods Experiments Background Background Methods Experiments
7 #BTJDBSHVNFOUT #BDLHSPVOE • *OUSPEVDFTUIFQSPCMFNTZPVBEESFTTJOUIJTQBQFS (PBMTBOETFUUJOHTPGUIFUBTL #SJFGTLFUDIPGQSFWJPVTBQQSPBDIFT • %FUBJMFEEFTDSJQUJPOHPFTUP3FMBUFE8PSL 3FNBJOJOHQSPCMFNT UPBEESFTTJOUIJTQBQFS v Describe in this order
9 #BTJDBSHVNFOUT .FUIPET • %FTDSJCFTIPXUPTPMWFUIFQSPCMFNT *OUVJUJWFFYQMBOBUJPO • )PXZPVSNFUIPETTPMWFUIFQSPCMFNT %FUBJMTPGZPVSNFUIPET v Describe in this order
15 &YBNQMF 0VUMJOF Abstract Introduction Methods Related Work Experiments Conclusion References Background • Slightly different in the colored sections • But basically the same as the structure we have seen above
24 'PDVTFEBOBMZTJT &YQFSJNFOUT q Focused analysis • Proposed methods improve the overall performance, but how? ü Do they work as you hypothesized? ü Do they solve the problem you pointed out? Ø Confirming here that the methods mitigate the anisotropic distribution of token representations
33 8IZEPFTJUNBUUFS %POPUDPOGVTFFOETXJUINFBOT X Current Performance ! 9IBTOPUCFFOVTFEJOUIFQSFWJPVTXPSL
TPXFVTF9 X Better Performance Apply X ü Overall performance ü Ablation study ✘ Focused analysis • As you don't have any guess on how/why X works here • "X does something awesome!" • You don't have any hypotheses to test regarding how/why X works ! Shallow contribution
34 8IZEPFTJUNBUUFS %POPUDPOGVTFFOETXJUINFBOT Problem X Current Performance ! 9DBOTPMWFUIJTQSPCMFNMFGUCZUIFQSFWJPVTXPSL
TPXFVTF9 Problem X Better Performance Apply X ü Overall performance ü Ablation study ü Focused analysis • You can check how X solves the problem based on hypotheses • That gives the explanation of why X works here ! Deeper insight into the limitation/generalization of X ! More critical contribution