Share
Embed
Off-axis anisotropy in multivariate functions
Slides for my talk at the RICAM Multivariate Algorithms and Information-Based Complexity Workshop, Nov 6 (my birthday!), 2018
Paul Constantine
November 06, 2018
Transcript
46 slides
-
Off-axis anisotropy in multivariate functions PAUL CONSTANTINE Assistant Professor Department
of Computer Science University of Colorado, Boulder activesubspaces.org! @DrPaulynomial! SLIDES AVAILABLE UPON REQUEST DISCLAIMER: These slides are meant to complement the oral presentation. Use out of context at your own risk. Thanks to: Jeff Hokanson (CU Boulder) Andrew Glaws (CU Boulder, NREL) -
Hypersonic scramjet models Constantine, Emory, Larsson, and Iaccarino (2015) Aerospace
design Lukaczyk, Palacios, Alonso, and Constantine (2014) Integrated hydrologic models Jefferson, Gilbert, Constantine, and Maxwell (2015) Solar cell models Constantine, Zaharatos, and Campanelli (2015) Magnetohydrodynamics models Glaws, Constantine, Shadid, and Wildey (2017) Ebola transmission models Diaz, Constantine, Kalmbach, Jones, and Pankavich (2018) Lithium ion battery model Constantine and Doostan (2017) Automobile design Othmer, Lukaczyk, Constantine, and Alonso (2016) f( x ) -
f( x ) PROPERTIES: Computer model of a physical system
Several independent inputs Deterministic Continuous inputs / outputs “Smoothness” Z f( x ) d x APPROXIMATION OPTIMIZATION INTEGRATION ˜ f( x ) ⇡ f( x ) minimize x f( x ) TO DO: -
f ( x ) ⇡ r X k=1 fk,1( x1)
· · · fk,m( xm) f( x ) ⇡ p X k=1 ak k( x ), k a k0 ⌧ p f ( x ) ⇡ f1( x1) + · · · + fm( xm) Structure-exploiting methods STRUCTURE METHODS Separation of variables [Beylkin & Mohlenkamp (2005)], Tensor-train [Oseledets (2011)], Adaptive cross approximation [Bebendorff (2011)], Proper generalized decomposition [Chinesta et al. (2011)], … Compressed sensing [Donoho (2006), Candès & Wakin (2008)], … Sparse grids [Bungartz & Griebel (2004)], HDMR [Sobol (2003)], ANOVA [Hoeffding (1948)], QMC [Niederreiter (1992)], … -
“Even more understanding is lost if we consider each thing
we can do to data only in terms of some set of very restrictive assumptions under which that thing is best possible--- assumptions we know we CANNOT check in practice.” -
The best way to fight the curse is to reduce
the dimension. But what is dimension reduction? • dimensional analysis [Barrenblatt (1996)] • correlation-based reduction [Jolliffe (2002)] • sensitivity analysis [Saltelli et al. (2008)] -
Design a jet nozzle under uncertainty (DARPA SEQUOIA project) 10-parameter
engine performance model (See animation at https://youtu.be/Fek2HstkFVc) -
f( x ) ⇡ g(UT x ) Ridge approximations UT
: Rm ! Rn g : Rn ! R where Constantine, Eftekhari, Hokanson, and Ward (2017) f(x1 , x2 ) x2 x1 -
Ridge approximations A subset of related literature Approximation theory: Mayer
et al. (2015), Pinkus (2015), Diaconis and Shahshahani (1984), Donoho and Johnstone (1989) Compressed sensing: Fornasier et al. (2012), Cohen et al. (2012), Tyagi and Cevher (2014) Statistical regression: Friedman and Stuetzle (1981), Ichimura (1993), Hristache et al. (2001), Xia et al. (2002) Uncertainty quantification & computational science: Tipireddy and Ghanem (2014); Lei et al. (2015); Stoyanov and Webster (2015); Tripathy, Bilionis, and Gonzalez (2016); Li, Lin, and Li (2016); … f( x ) ⇡ g(UT x ) -
Hypersonic scramjet models Constantine, Emory, Larsson, and Iaccarino (2015) Evidence
of 1d ridge structures across science and engineering models -
Integrated jet nozzle models Alonso, Eldred, Constantine, Duraisamy, Farhat, Iaccarino,
and Jakeman (2017) Evidence of 1d ridge structures across science and engineering models -
Integrated hydrologic models Jefferson, Gilbert, Constantine, and Maxwell (2015) Evidence
of 1d ridge structures across science and engineering models -
−2 −1 0 1 2 −0.1 0 0.1 0.2 0.3
0.4 0.5 0.6 0.7 0.8 0.9 Active Variable 1 Lift Lukaczyk, Constantine, Palacios, and Alonso (2014) −2 −1 0 1 2 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 Active Variable 1 Drag Aerospace vehicle geometries Evidence of 1d ridge structures across science and engineering models -
In-host HIV dynamical models T-cell count Loudon and Pankavich (2016)
Evidence of 1d ridge structures across science and engineering models -
Solar cell circuit models −2 −1 0 1 2 0
0.05 0.1 0.15 0.2 0.25 Active Variable 1 P max (watts) Constantine, Zaharatos, and Campanelli (2015) Evidence of 1d ridge structures across science and engineering models -
Atmospheric reentry vehicle model Cortesi, Constantine, Magin, and Congedo (hal,
2017) −1 0 1 ˆ wT q x 0.4 0.6 0.8 1.0 1.2 Stagnation heat flux qst ×107 −1 0 1 ˆ wT p x 20000 40000 60000 80000 100000 Stagnation pressure pst Evidence of 1d ridge structures across science and engineering models -
Magnetohydrodynamics generator model -1 0 1 wT 1 x 0
5 10 15 f(x) Average velocity Glaws, Constantine, Shadid, and Wildey (2017) -1 0 1 wT 1 x 0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 f(x) Induce magnetic field Evidence of 1d ridge structures across science and engineering models -
Lithium ion battery model 2 0 2 wT x 3.65
3.70 Voltage [V] Constantine and Doostan (2017) 2 0 2 wT x 2.0 2.2 Capacity [mAh·cm 2] Evidence of 1d ridge structures across science and engineering models -
Automobile geometries Othmer, Lukaczyk, Constantine, and Alonso (2016) Evidence of
1d ridge structures across science and engineering models -
-4 -2 0 2 4 Quantity of interest #10-3 0
1 2 3 4 5 -4 -2 0 2 4 Quantity of interest #10-4 2.4 2.6 2.8 3 3.2 3.4 3.6 3.8 Long length scale Short length scale Constantine, Dow, and Wang (2014) r · (aru) = 1, s 2 D u = 0, s 2 1 n · aru = 0, s 2 2 Input field Solution Short corr Long corr Evidence of 1d ridge structures across science and engineering models -
f( x ) ⇡ g(UT x ) What is U?
What is the approximation error? What is g? Constantine, Eftekhari, Hokanson, and Ward (2017) Ridge approximations -
µ(y) = Z f(Uy + V z) ⇡(z|y) dz f(
x ) ⇡ g(UT x ) Use the conditional average: subspace coordinates What is g? complement subspace and coordinates conditional density Constantine, Dow, and Wang (2014); Constantine, Eftekhari, Hokanson, and Ward (2017) Ridge approximations is the best approximation [Pinkus (2015)] µ(UT x ) <latexit sha1_base64="VuBd4ijE4p461ekOHG46beuCiXo=">AAAWJHicjZhNb9s2GMfV7q3z3toNOe2izSjQAkURBwM27NQkTdOkbpo2sRMn8gxKpiU2egtFOXYEf45dt8s+zW7DDrvss4yUZEcW/8liIAjF/+/h85AUyYeyY58lYnX1nzt3P/jwo48/ufdp47PPv/jyq/sPvu4mUcod2nEiP+LHNkmoz0LaEUz49DjmlAS2T4/ss02lH40pT1gUHoppTPsBcUM2Yg4RsqpvBekjK+j8cmiNJ48H95urT1fzn6kXWmWhaZS//cGDlTvWMHLSgIbC8UmSnLZWY9HPCBfM8emsYaUJjYlzRlx6KoshCWjSz/KoZ+ZDWTM0RxGXf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvRTP2NhnAoaOoWjUeqbIjLVEJhDxqkj/KksEIczGavpeIQTR8iBajSsmEdjNqROFAQkHGaW9DA7bfUzy478oYoo8rNmazZ72LA4DenFAhxTpwBVTPYohxpWjSA+bq3ReGhuFlwii0o10zim3HTk/OpR0Smd5Z6yHeVFC3pdqjRMUk5VNAW5PoPoBkA3MLoJ0E2MPgfoc4xuAXQLoy8A+gKj2wDdxuhLgL7E6A5AdzC6C9BdjL4C6CuMtgHaxuhrgL7G6B5A9zD6BqBvMLoP0H2MvgXoW4y+A+g7jB4A9ACjhwA9xGgHoB2MdgHaxegRQI8wegzQY4z2ANrD6AlAT655CeURMySAt0oFzwZzA2hUCNDmkvIImKwqWsejkCazfJ/NKGpuXHevSOx5bAPUxqgDUAejQ4AOMUoBSjE6AugIoy5AXYx6APUwygDKMPoeoO8xegbQM4z6APUxGgA0wGgI0BCj9bdUoRFGY4DGGD0H6DlGOUA5RhOAJhgVABUYTQGaYnQM0DFGLwB6gdEJQCcYnQJ0itFLgF5eM7FgGciEL7PifC3IvC6RGWcsljK7aoKYrBdJnSfNVLpWUzcq6oamblXULU3dqag7mrpbUXc1da+i7mnqQUU90NTjinqsqb2K2iuGyCMi+W4Z8/LE01NHhSzN6uL2QtzWxMVJ5VVPpxp06FGxYIoHzUln4aSji92F2NXFo4V4pIn+Ung+Dk9UwxMwvHyZ5LosaeJ0IU518XIhXmpir9R6mnJSKieakvQW/b2a2OrL70cX+OVX69fxWM7mFyCXU3q2DNnEjz01GBIor09WUVW4iAJqlhc+Z36dWmqAxbPTNXn/8ulIyAEPXZ+azdYT60lzzeLM9YTF88pat7YmceVyZ8sFlrdw2mwVVv0avxmNCz+RXOlERFzdfjNVO7eruNSNOYfWsvoW5l3Ci1iXrFXtzTHv88gu3Jad3J8bXOPIvrobU5eFmXrmbDKTDqjU5481q+FwUngZyUu33BvV9wLiy0mYXT1MBllzbVa3JFzmiZPCYxoO5X2diiy3W+ppiSFrFt7KmoWataxj/2uroCANdGMyuYWxhJBxos5gQSciS1L7PXWE+pRRh4QcSwpmvajPp/HRfN4f50tFfXqxyZQmjIQmC8vPRMutxpxFKq/gXjSoNRxzLdCcnl6LP9E2n9zg8noDbUPy2RmmlaC9Z06k8oxtIp8Heepddx/lQ4ucR4nWnFPgzu1Ypkh17td2R7fcHF1t38yTh3zfVNlCrT2vaLAC1AiXxjKrcwfyisNlkflRWO8tyxH5/wbIKSnlqgZqPSmaKzpzQ5Pe3PE89JvcexX/kNfO97Lhdl1p5+20bwqsfRVX+6aoJoKn6jI2lrtSsRDzCnXiDO43W/VPpHqhu/a0Jctvf2g++7n8fHrP+Nb43nhktIwfjWfGS2Pf6BiOcW78avxm/L7yx8qfK3+t/F2gd++UNt8YS7+Vf/8DXi/Ftg==</latexit> <latexit sha1_base64="VuBd4ijE4p461ekOHG46beuCiXo=">AAAWJHicjZhNb9s2GMfV7q3z3toNOe2izSjQAkURBwM27NQkTdOkbpo2sRMn8gxKpiU2egtFOXYEf45dt8s+zW7DDrvss4yUZEcW/8liIAjF/+/h85AUyYeyY58lYnX1nzt3P/jwo48/ufdp47PPv/jyq/sPvu4mUcod2nEiP+LHNkmoz0LaEUz49DjmlAS2T4/ss02lH40pT1gUHoppTPsBcUM2Yg4RsqpvBekjK+j8cmiNJ48H95urT1fzn6kXWmWhaZS//cGDlTvWMHLSgIbC8UmSnLZWY9HPCBfM8emsYaUJjYlzRlx6KoshCWjSz/KoZ+ZDWTM0RxGXf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvRTP2NhnAoaOoWjUeqbIjLVEJhDxqkj/KksEIczGavpeIQTR8iBajSsmEdjNqROFAQkHGaW9DA7bfUzy478oYoo8rNmazZ72LA4DenFAhxTpwBVTPYohxpWjSA+bq3ReGhuFlwii0o10zim3HTk/OpR0Smd5Z6yHeVFC3pdqjRMUk5VNAW5PoPoBkA3MLoJ0E2MPgfoc4xuAXQLoy8A+gKj2wDdxuhLgL7E6A5AdzC6C9BdjL4C6CuMtgHaxuhrgL7G6B5A9zD6BqBvMLoP0H2MvgXoW4y+A+g7jB4A9ACjhwA9xGgHoB2MdgHaxegRQI8wegzQY4z2ANrD6AlAT655CeURMySAt0oFzwZzA2hUCNDmkvIImKwqWsejkCazfJ/NKGpuXHevSOx5bAPUxqgDUAejQ4AOMUoBSjE6AugIoy5AXYx6APUwygDKMPoeoO8xegbQM4z6APUxGgA0wGgI0BCj9bdUoRFGY4DGGD0H6DlGOUA5RhOAJhgVABUYTQGaYnQM0DFGLwB6gdEJQCcYnQJ0itFLgF5eM7FgGciEL7PifC3IvC6RGWcsljK7aoKYrBdJnSfNVLpWUzcq6oamblXULU3dqag7mrpbUXc1da+i7mnqQUU90NTjinqsqb2K2iuGyCMi+W4Z8/LE01NHhSzN6uL2QtzWxMVJ5VVPpxp06FGxYIoHzUln4aSji92F2NXFo4V4pIn+Ung+Dk9UwxMwvHyZ5LosaeJ0IU518XIhXmpir9R6mnJSKieakvQW/b2a2OrL70cX+OVX69fxWM7mFyCXU3q2DNnEjz01GBIor09WUVW4iAJqlhc+Z36dWmqAxbPTNXn/8ulIyAEPXZ+azdYT60lzzeLM9YTF88pat7YmceVyZ8sFlrdw2mwVVv0avxmNCz+RXOlERFzdfjNVO7eruNSNOYfWsvoW5l3Ci1iXrFXtzTHv88gu3Jad3J8bXOPIvrobU5eFmXrmbDKTDqjU5481q+FwUngZyUu33BvV9wLiy0mYXT1MBllzbVa3JFzmiZPCYxoO5X2diiy3W+ppiSFrFt7KmoWataxj/2uroCANdGMyuYWxhJBxos5gQSciS1L7PXWE+pRRh4QcSwpmvajPp/HRfN4f50tFfXqxyZQmjIQmC8vPRMutxpxFKq/gXjSoNRxzLdCcnl6LP9E2n9zg8noDbUPy2RmmlaC9Z06k8oxtIp8Heepddx/lQ4ucR4nWnFPgzu1Ypkh17td2R7fcHF1t38yTh3zfVNlCrT2vaLAC1AiXxjKrcwfyisNlkflRWO8tyxH5/wbIKSnlqgZqPSmaKzpzQ5Pe3PE89JvcexX/kNfO97Lhdl1p5+20bwqsfRVX+6aoJoKn6jI2lrtSsRDzCnXiDO43W/VPpHqhu/a0Jctvf2g++7n8fHrP+Nb43nhktIwfjWfGS2Pf6BiOcW78avxm/L7yx8qfK3+t/F2gd++UNt8YS7+Vf/8DXi/Ftg==</latexit> <latexit sha1_base64="VuBd4ijE4p461ekOHG46beuCiXo=">AAAWJHicjZhNb9s2GMfV7q3z3toNOe2izSjQAkURBwM27NQkTdOkbpo2sRMn8gxKpiU2egtFOXYEf45dt8s+zW7DDrvss4yUZEcW/8liIAjF/+/h85AUyYeyY58lYnX1nzt3P/jwo48/ufdp47PPv/jyq/sPvu4mUcod2nEiP+LHNkmoz0LaEUz49DjmlAS2T4/ss02lH40pT1gUHoppTPsBcUM2Yg4RsqpvBekjK+j8cmiNJ48H95urT1fzn6kXWmWhaZS//cGDlTvWMHLSgIbC8UmSnLZWY9HPCBfM8emsYaUJjYlzRlx6KoshCWjSz/KoZ+ZDWTM0RxGXf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvRTP2NhnAoaOoWjUeqbIjLVEJhDxqkj/KksEIczGavpeIQTR8iBajSsmEdjNqROFAQkHGaW9DA7bfUzy478oYoo8rNmazZ72LA4DenFAhxTpwBVTPYohxpWjSA+bq3ReGhuFlwii0o10zim3HTk/OpR0Smd5Z6yHeVFC3pdqjRMUk5VNAW5PoPoBkA3MLoJ0E2MPgfoc4xuAXQLoy8A+gKj2wDdxuhLgL7E6A5AdzC6C9BdjL4C6CuMtgHaxuhrgL7G6B5A9zD6BqBvMLoP0H2MvgXoW4y+A+g7jB4A9ACjhwA9xGgHoB2MdgHaxegRQI8wegzQY4z2ANrD6AlAT655CeURMySAt0oFzwZzA2hUCNDmkvIImKwqWsejkCazfJ/NKGpuXHevSOx5bAPUxqgDUAejQ4AOMUoBSjE6AugIoy5AXYx6APUwygDKMPoeoO8xegbQM4z6APUxGgA0wGgI0BCj9bdUoRFGY4DGGD0H6DlGOUA5RhOAJhgVABUYTQGaYnQM0DFGLwB6gdEJQCcYnQJ0itFLgF5eM7FgGciEL7PifC3IvC6RGWcsljK7aoKYrBdJnSfNVLpWUzcq6oamblXULU3dqag7mrpbUXc1da+i7mnqQUU90NTjinqsqb2K2iuGyCMi+W4Z8/LE01NHhSzN6uL2QtzWxMVJ5VVPpxp06FGxYIoHzUln4aSji92F2NXFo4V4pIn+Ung+Dk9UwxMwvHyZ5LosaeJ0IU518XIhXmpir9R6mnJSKieakvQW/b2a2OrL70cX+OVX69fxWM7mFyCXU3q2DNnEjz01GBIor09WUVW4iAJqlhc+Z36dWmqAxbPTNXn/8ulIyAEPXZ+azdYT60lzzeLM9YTF88pat7YmceVyZ8sFlrdw2mwVVv0avxmNCz+RXOlERFzdfjNVO7eruNSNOYfWsvoW5l3Ci1iXrFXtzTHv88gu3Jad3J8bXOPIvrobU5eFmXrmbDKTDqjU5481q+FwUngZyUu33BvV9wLiy0mYXT1MBllzbVa3JFzmiZPCYxoO5X2diiy3W+ppiSFrFt7KmoWataxj/2uroCANdGMyuYWxhJBxos5gQSciS1L7PXWE+pRRh4QcSwpmvajPp/HRfN4f50tFfXqxyZQmjIQmC8vPRMutxpxFKq/gXjSoNRxzLdCcnl6LP9E2n9zg8noDbUPy2RmmlaC9Z06k8oxtIp8Heepddx/lQ4ucR4nWnFPgzu1Ypkh17td2R7fcHF1t38yTh3zfVNlCrT2vaLAC1AiXxjKrcwfyisNlkflRWO8tyxH5/wbIKSnlqgZqPSmaKzpzQ5Pe3PE89JvcexX/kNfO97Lhdl1p5+20bwqsfRVX+6aoJoKn6jI2lrtSsRDzCnXiDO43W/VPpHqhu/a0Jctvf2g++7n8fHrP+Nb43nhktIwfjWfGS2Pf6BiOcW78avxm/L7yx8qfK3+t/F2gd++UNt8YS7+Vf/8DXi/Ftg==</latexit> <latexit sha1_base64="VuBd4ijE4p461ekOHG46beuCiXo=">AAAWJHicjZhNb9s2GMfV7q3z3toNOe2izSjQAkURBwM27NQkTdOkbpo2sRMn8gxKpiU2egtFOXYEf45dt8s+zW7DDrvss4yUZEcW/8liIAjF/+/h85AUyYeyY58lYnX1nzt3P/jwo48/ufdp47PPv/jyq/sPvu4mUcod2nEiP+LHNkmoz0LaEUz49DjmlAS2T4/ss02lH40pT1gUHoppTPsBcUM2Yg4RsqpvBekjK+j8cmiNJ48H95urT1fzn6kXWmWhaZS//cGDlTvWMHLSgIbC8UmSnLZWY9HPCBfM8emsYaUJjYlzRlx6KoshCWjSz/KoZ+ZDWTM0RxGXf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvRTP2NhnAoaOoWjUeqbIjLVEJhDxqkj/KksEIczGavpeIQTR8iBajSsmEdjNqROFAQkHGaW9DA7bfUzy478oYoo8rNmazZ72LA4DenFAhxTpwBVTPYohxpWjSA+bq3ReGhuFlwii0o10zim3HTk/OpR0Smd5Z6yHeVFC3pdqjRMUk5VNAW5PoPoBkA3MLoJ0E2MPgfoc4xuAXQLoy8A+gKj2wDdxuhLgL7E6A5AdzC6C9BdjL4C6CuMtgHaxuhrgL7G6B5A9zD6BqBvMLoP0H2MvgXoW4y+A+g7jB4A9ACjhwA9xGgHoB2MdgHaxegRQI8wegzQY4z2ANrD6AlAT655CeURMySAt0oFzwZzA2hUCNDmkvIImKwqWsejkCazfJ/NKGpuXHevSOx5bAPUxqgDUAejQ4AOMUoBSjE6AugIoy5AXYx6APUwygDKMPoeoO8xegbQM4z6APUxGgA0wGgI0BCj9bdUoRFGY4DGGD0H6DlGOUA5RhOAJhgVABUYTQGaYnQM0DFGLwB6gdEJQCcYnQJ0itFLgF5eM7FgGciEL7PifC3IvC6RGWcsljK7aoKYrBdJnSfNVLpWUzcq6oamblXULU3dqag7mrpbUXc1da+i7mnqQUU90NTjinqsqb2K2iuGyCMi+W4Z8/LE01NHhSzN6uL2QtzWxMVJ5VVPpxp06FGxYIoHzUln4aSji92F2NXFo4V4pIn+Ung+Dk9UwxMwvHyZ5LosaeJ0IU518XIhXmpir9R6mnJSKieakvQW/b2a2OrL70cX+OVX69fxWM7mFyCXU3q2DNnEjz01GBIor09WUVW4iAJqlhc+Z36dWmqAxbPTNXn/8ulIyAEPXZ+azdYT60lzzeLM9YTF88pat7YmceVyZ8sFlrdw2mwVVv0avxmNCz+RXOlERFzdfjNVO7eruNSNOYfWsvoW5l3Ci1iXrFXtzTHv88gu3Jad3J8bXOPIvrobU5eFmXrmbDKTDqjU5481q+FwUngZyUu33BvV9wLiy0mYXT1MBllzbVa3JFzmiZPCYxoO5X2diiy3W+ppiSFrFt7KmoWataxj/2uroCANdGMyuYWxhJBxos5gQSciS1L7PXWE+pRRh4QcSwpmvajPp/HRfN4f50tFfXqxyZQmjIQmC8vPRMutxpxFKq/gXjSoNRxzLdCcnl6LP9E2n9zg8noDbUPy2RmmlaC9Z06k8oxtIp8Heepddx/lQ4ucR4nWnFPgzu1Ypkh17td2R7fcHF1t38yTh3zfVNlCrT2vaLAC1AiXxjKrcwfyisNlkflRWO8tyxH5/wbIKSnlqgZqPSmaKzpzQ5Pe3PE89JvcexX/kNfO97Lhdl1p5+20bwqsfRVX+6aoJoKn6jI2lrtSsRDzCnXiDO43W/VPpHqhu/a0Jctvf2g++7n8fHrP+Nb43nhktIwfjWfGS2Pf6BiOcW78avxm/L7yx8qfK3+t/F2gd++UNt8YS7+Vf/8DXi/Ftg==</latexit> L2 <latexit sha1_base64="XehVUlVFgbkXFG0+AuFWPovuimU=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwM27NQmTdOkbpo2sRMnCgxKpiU2eitFOXYEfYRdt8s+zW7Drrvs24yUZEcW/8liIAjF/+/h81AUyYe0Y58lYm3t3zt3P/jwo48/ufdp67PPv/jyq5X7X/eTKOUO7TmRH/FjmyTUZyHtCSZ8ehxzSgLbp0f2+abSjyaUJywKD8UspmcBcUM2Zg4RsuqgO1wfrrTXHq8VP1MvdKpC26h++8P7q3esUeSkAQ2F45MkOe2sxeIsI1wwx6d5y0oTGhPnnLj0VBZDEtDkLCtizc0HsmZkjiMu/0JhFrV1i4wESTILbEkGRHhJU1OVSDtNxfjns4yFcSpo6JSOxqlvishUHTdHjFNH+DNZIA5nMlbT8QgnjpCvp9WyYh5N2Ig6URCQcJRZ0kN+2jnLLDvyRyqiyM/anTx/0LI4DenFApxQpwRVTPa4gFpWgyA+bq3VemBullwii0o10zim3HTkqOpR0RnNC0/ZjvKiBf1UqjRMUk5VNCX5NIfoBkA3MLoJ0E2MPgPoM4xuAXQLo88B+hyj2wDdxugLgL7A6A5AdzC6C9BdjL4E6EuMdgHaxegrgL7C6B5A9zD6GqCvMboP0H2MvgHoG4y+BehbjB4A9ACjhwA9xGgPoD2M9gHax+gRQI8wegzQY4wOADrA6AlAT675COXGMiKAtyoFjwZzA2hUCtDmkvIImKwpWsejkCZ5sc5mFDU3abpXJPY8sQFqY9QBqIPREUBHGKUApRgdA3SMURegLkY9gHoYZQBlGH0H0HcYPQfoOUZ9gPoYDQAaYDQEaIjR5leq0AijMUBjjL4H6HuMcoByjCYATTAqACowmgI0xegEoBOMXgD0AqNTgE4xOgPoDKOXAL28ZmDBNJAJX2bFxVyQeV0iM85YLGV29QQxeVomdZ40U+laQ92oqRuaulVTtzR1p6buaOpuTd3V1L2auqepBzX1QFOPa+qxpg5q6qB8RR4RyXfLmFcknp7aKmQpb4rbC3FbExc7lVffnRrQoUfFgikfNCe9hZOeLvYXYl8XjxbikSb6S+H5ODxRD0/A8IppUuiypImzhTjTxcuFeKmJg0obaMpJpZxoSjJY9PdqYOsfvx9d4I9fzV/HYwVbHIBcTun5MmQTP/bUy5BAdXyyyqrSRRRQszrwOfPj1FIDLM5P1+X5y6djIV946PrUbHceWY/a6xZnricsXlQ2urU1jWuHO1tOsKKF03antDpr8JvRpPQTyZlORMTV6TdTtXO7mkvdmHNoLatvYd4nvIx1yVrV3hzzPo/s0m3Vyf25wTWO7KuzMXVZmKlnzqa5dEClPn9sWI1G09LLWB665dqo7guILwchv3qYDrP2et60JFzmidPSYxqO5HmdiqywW+pphSFrFt7KmoWataxj/2uroCANdGMyvYWxhJBxovZgQaciS1L7HXWEuspoQkK+SwpGvawvhvHhfNx/KKaKunqxyYwmjIQmC6vLoeVWY84ilVdwLxo2Go65FmhBz67FH2mLT2Fweb2BtiD57BzTStC+MydSecY2kc/DIvVuuo+KV4ucR4nWnFPizu1Ypki17zdWR7daHF1t3SySh2LdVNlCoz2vbLAGNAiXxjKrc4fyiMNlkflR2OwtKxD5/wbIqSjlqgFqPSmbKztzQ5Pe3PE89JvcezX/kNf296rhblPpFu10bwqsexVX96aopoKn6jA2katSORGLCrXjDFfaneYVqV7orz/uyPKbH9tPfqmuT+8Z3xrfGw+NjvGT8cR4YewbPcMxXONX4zfj99U/Vv9c/Wv17xK9e6ey+cZY+q3+8x+bAcGG</latexit> <latexit sha1_base64="XehVUlVFgbkXFG0+AuFWPovuimU=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwM27NQmTdOkbpo2sRMnCgxKpiU2eitFOXYEfYRdt8s+zW7Drrvs24yUZEcW/8liIAjF/+/h81AUyYe0Y58lYm3t3zt3P/jwo48/ufdp67PPv/jyq5X7X/eTKOUO7TmRH/FjmyTUZyHtCSZ8ehxzSgLbp0f2+abSjyaUJywKD8UspmcBcUM2Zg4RsuqgO1wfrrTXHq8VP1MvdKpC26h++8P7q3esUeSkAQ2F45MkOe2sxeIsI1wwx6d5y0oTGhPnnLj0VBZDEtDkLCtizc0HsmZkjiMu/0JhFrV1i4wESTILbEkGRHhJU1OVSDtNxfjns4yFcSpo6JSOxqlvishUHTdHjFNH+DNZIA5nMlbT8QgnjpCvp9WyYh5N2Ig6URCQcJRZ0kN+2jnLLDvyRyqiyM/anTx/0LI4DenFApxQpwRVTPa4gFpWgyA+bq3VemBullwii0o10zim3HTkqOpR0RnNC0/ZjvKiBf1UqjRMUk5VNCX5NIfoBkA3MLoJ0E2MPgPoM4xuAXQLo88B+hyj2wDdxugLgL7A6A5AdzC6C9BdjL4E6EuMdgHaxegrgL7C6B5A9zD6GqCvMboP0H2MvgHoG4y+BehbjB4A9ACjhwA9xGgPoD2M9gHax+gRQI8wegzQY4wOADrA6AlAT675COXGMiKAtyoFjwZzA2hUCtDmkvIImKwpWsejkCZ5sc5mFDU3abpXJPY8sQFqY9QBqIPREUBHGKUApRgdA3SMURegLkY9gHoYZQBlGH0H0HcYPQfoOUZ9gPoYDQAaYDQEaIjR5leq0AijMUBjjL4H6HuMcoByjCYATTAqACowmgI0xegEoBOMXgD0AqNTgE4xOgPoDKOXAL28ZmDBNJAJX2bFxVyQeV0iM85YLGV29QQxeVomdZ40U+laQ92oqRuaulVTtzR1p6buaOpuTd3V1L2auqepBzX1QFOPa+qxpg5q6qB8RR4RyXfLmFcknp7aKmQpb4rbC3FbExc7lVffnRrQoUfFgikfNCe9hZOeLvYXYl8XjxbikSb6S+H5ODxRD0/A8IppUuiypImzhTjTxcuFeKmJg0obaMpJpZxoSjJY9PdqYOsfvx9d4I9fzV/HYwVbHIBcTun5MmQTP/bUy5BAdXyyyqrSRRRQszrwOfPj1FIDLM5P1+X5y6djIV946PrUbHceWY/a6xZnricsXlQ2urU1jWuHO1tOsKKF03antDpr8JvRpPQTyZlORMTV6TdTtXO7mkvdmHNoLatvYd4nvIx1yVrV3hzzPo/s0m3Vyf25wTWO7KuzMXVZmKlnzqa5dEClPn9sWI1G09LLWB665dqo7guILwchv3qYDrP2et60JFzmidPSYxqO5HmdiqywW+pphSFrFt7KmoWataxj/2uroCANdGMyvYWxhJBxovZgQaciS1L7HXWEuspoQkK+SwpGvawvhvHhfNx/KKaKunqxyYwmjIQmC6vLoeVWY84ilVdwLxo2Go65FmhBz67FH2mLT2Fweb2BtiD57BzTStC+MydSecY2kc/DIvVuuo+KV4ucR4nWnFPizu1Ypki17zdWR7daHF1t3SySh2LdVNlCoz2vbLAGNAiXxjKrc4fyiMNlkflR2OwtKxD5/wbIqSjlqgFqPSmbKztzQ5Pe3PE89JvcezX/kNf296rhblPpFu10bwqsexVX96aopoKn6jA2katSORGLCrXjDFfaneYVqV7orz/uyPKbH9tPfqmuT+8Z3xrfGw+NjvGT8cR4YewbPcMxXONX4zfj99U/Vv9c/Wv17xK9e6ey+cZY+q3+8x+bAcGG</latexit> <latexit sha1_base64="XehVUlVFgbkXFG0+AuFWPovuimU=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwM27NQmTdOkbpo2sRMnCgxKpiU2eitFOXYEfYRdt8s+zW7Drrvs24yUZEcW/8liIAjF/+/h81AUyYe0Y58lYm3t3zt3P/jwo48/ufdp67PPv/jyq5X7X/eTKOUO7TmRH/FjmyTUZyHtCSZ8ehxzSgLbp0f2+abSjyaUJywKD8UspmcBcUM2Zg4RsuqgO1wfrrTXHq8VP1MvdKpC26h++8P7q3esUeSkAQ2F45MkOe2sxeIsI1wwx6d5y0oTGhPnnLj0VBZDEtDkLCtizc0HsmZkjiMu/0JhFrV1i4wESTILbEkGRHhJU1OVSDtNxfjns4yFcSpo6JSOxqlvishUHTdHjFNH+DNZIA5nMlbT8QgnjpCvp9WyYh5N2Ig6URCQcJRZ0kN+2jnLLDvyRyqiyM/anTx/0LI4DenFApxQpwRVTPa4gFpWgyA+bq3VemBullwii0o10zim3HTkqOpR0RnNC0/ZjvKiBf1UqjRMUk5VNCX5NIfoBkA3MLoJ0E2MPgPoM4xuAXQLo88B+hyj2wDdxugLgL7A6A5AdzC6C9BdjL4E6EuMdgHaxegrgL7C6B5A9zD6GqCvMboP0H2MvgHoG4y+BehbjB4A9ACjhwA9xGgPoD2M9gHax+gRQI8wegzQY4wOADrA6AlAT675COXGMiKAtyoFjwZzA2hUCtDmkvIImKwpWsejkCZ5sc5mFDU3abpXJPY8sQFqY9QBqIPREUBHGKUApRgdA3SMURegLkY9gHoYZQBlGH0H0HcYPQfoOUZ9gPoYDQAaYDQEaIjR5leq0AijMUBjjL4H6HuMcoByjCYATTAqACowmgI0xegEoBOMXgD0AqNTgE4xOgPoDKOXAL28ZmDBNJAJX2bFxVyQeV0iM85YLGV29QQxeVomdZ40U+laQ92oqRuaulVTtzR1p6buaOpuTd3V1L2auqepBzX1QFOPa+qxpg5q6qB8RR4RyXfLmFcknp7aKmQpb4rbC3FbExc7lVffnRrQoUfFgikfNCe9hZOeLvYXYl8XjxbikSb6S+H5ODxRD0/A8IppUuiypImzhTjTxcuFeKmJg0obaMpJpZxoSjJY9PdqYOsfvx9d4I9fzV/HYwVbHIBcTun5MmQTP/bUy5BAdXyyyqrSRRRQszrwOfPj1FIDLM5P1+X5y6djIV946PrUbHceWY/a6xZnricsXlQ2urU1jWuHO1tOsKKF03antDpr8JvRpPQTyZlORMTV6TdTtXO7mkvdmHNoLatvYd4nvIx1yVrV3hzzPo/s0m3Vyf25wTWO7KuzMXVZmKlnzqa5dEClPn9sWI1G09LLWB665dqo7guILwchv3qYDrP2et60JFzmidPSYxqO5HmdiqywW+pphSFrFt7KmoWataxj/2uroCANdGMyvYWxhJBxovZgQaciS1L7HXWEuspoQkK+SwpGvawvhvHhfNx/KKaKunqxyYwmjIQmC6vLoeVWY84ilVdwLxo2Go65FmhBz67FH2mLT2Fweb2BtiD57BzTStC+MydSecY2kc/DIvVuuo+KV4ucR4nWnFPizu1Ypki17zdWR7daHF1t3SySh2LdVNlCoz2vbLAGNAiXxjKrc4fyiMNlkflR2OwtKxD5/wbIqSjlqgFqPSmbKztzQ5Pe3PE89JvcezX/kNf296rhblPpFu10bwqsexVX96aopoKn6jA2katSORGLCrXjDFfaneYVqV7orz/uyPKbH9tPfqmuT+8Z3xrfGw+NjvGT8cR4YewbPcMxXONX4zfj99U/Vv9c/Wv17xK9e6ey+cZY+q3+8x+bAcGG</latexit> <latexit sha1_base64="XehVUlVFgbkXFG0+AuFWPovuimU=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwM27NQmTdOkbpo2sRMnCgxKpiU2eitFOXYEfYRdt8s+zW7Drrvs24yUZEcW/8liIAjF/+/h81AUyYe0Y58lYm3t3zt3P/jwo48/ufdp67PPv/jyq5X7X/eTKOUO7TmRH/FjmyTUZyHtCSZ8ehxzSgLbp0f2+abSjyaUJywKD8UspmcBcUM2Zg4RsuqgO1wfrrTXHq8VP1MvdKpC26h++8P7q3esUeSkAQ2F45MkOe2sxeIsI1wwx6d5y0oTGhPnnLj0VBZDEtDkLCtizc0HsmZkjiMu/0JhFrV1i4wESTILbEkGRHhJU1OVSDtNxfjns4yFcSpo6JSOxqlvishUHTdHjFNH+DNZIA5nMlbT8QgnjpCvp9WyYh5N2Ig6URCQcJRZ0kN+2jnLLDvyRyqiyM/anTx/0LI4DenFApxQpwRVTPa4gFpWgyA+bq3VemBullwii0o10zim3HTkqOpR0RnNC0/ZjvKiBf1UqjRMUk5VNCX5NIfoBkA3MLoJ0E2MPgPoM4xuAXQLo88B+hyj2wDdxugLgL7A6A5AdzC6C9BdjL4E6EuMdgHaxegrgL7C6B5A9zD6GqCvMboP0H2MvgHoG4y+BehbjB4A9ACjhwA9xGgPoD2M9gHax+gRQI8wegzQY4wOADrA6AlAT675COXGMiKAtyoFjwZzA2hUCtDmkvIImKwpWsejkCZ5sc5mFDU3abpXJPY8sQFqY9QBqIPREUBHGKUApRgdA3SMURegLkY9gHoYZQBlGH0H0HcYPQfoOUZ9gPoYDQAaYDQEaIjR5leq0AijMUBjjL4H6HuMcoByjCYATTAqACowmgI0xegEoBOMXgD0AqNTgE4xOgPoDKOXAL28ZmDBNJAJX2bFxVyQeV0iM85YLGV29QQxeVomdZ40U+laQ92oqRuaulVTtzR1p6buaOpuTd3V1L2auqepBzX1QFOPa+qxpg5q6qB8RR4RyXfLmFcknp7aKmQpb4rbC3FbExc7lVffnRrQoUfFgikfNCe9hZOeLvYXYl8XjxbikSb6S+H5ODxRD0/A8IppUuiypImzhTjTxcuFeKmJg0obaMpJpZxoSjJY9PdqYOsfvx9d4I9fzV/HYwVbHIBcTun5MmQTP/bUy5BAdXyyyqrSRRRQszrwOfPj1FIDLM5P1+X5y6djIV946PrUbHceWY/a6xZnricsXlQ2urU1jWuHO1tOsKKF03antDpr8JvRpPQTyZlORMTV6TdTtXO7mkvdmHNoLatvYd4nvIx1yVrV3hzzPo/s0m3Vyf25wTWO7KuzMXVZmKlnzqa5dEClPn9sWI1G09LLWB665dqo7guILwchv3qYDrP2et60JFzmidPSYxqO5HmdiqywW+pphSFrFt7KmoWataxj/2uroCANdGMyvYWxhJBxovZgQaciS1L7HXWEuspoQkK+SwpGvawvhvHhfNx/KKaKunqxyYwmjIQmC6vLoeVWY84ilVdwLxo2Go65FmhBz67FH2mLT2Fweb2BtiD57BzTStC+MydSecY2kc/DIvVuuo+KV4ucR4nWnFPizu1Ypki17zdWR7daHF1t3SySh2LdVNlCoz2vbLAGNAiXxjKrc4fyiMNlkflR2OwtKxD5/wbIqSjlqgFqPSmbKztzQ5Pe3PE89JvcezX/kNf296rhblPpFu10bwqsexVX96aopoKn6jA2katSORGLCrXjDFfaneYVqV7orz/uyPKbH9tPfqmuT+8Z3xrfGw+NjvGT8cR4YewbPcMxXONX4zfj99U/Vv9c/Wv17xK9e6ey+cZY+q3+8x+bAcGG</latexit> -
C = Z rf( x ) rf( x )T ⇢(
x ) d x = W ⇤W T Define the active subspace The average outer product of the gradient and its eigendecomposition, Partition the eigendecomposition, Rotate and separate the coordinates, ⇤ = ⇤1 ⇤2 , W = ⇥ W 1 W 2 ⇤ , W 1 2 Rm⇥n x = W W T x = W 1W T 1 x + W 2W T 2 x = W 1y + W 2z active variables inactive variables f = f( x ), x 2 Rm, rf( x ) 2 Rm, ⇢ : Rm ! R + Constantine, Dow, and Wang (2014) Some relevant literature Statistical regression: Samarov (1993), Hristache et al. (2001) Machine learning: Mukerjee, Wu, and Xiao (2010); Fukumizu and Leng (2014) Detection and estimation theory: van Trees (2001) The function, its gradient vector, and a given weight function: -
C = Z rf( x ) rf( x )T ⇢(
x ) d x = W ⇤W T Define the active subspace The function, its gradient vector, and a given weight function: The average outer product of the gradient and its eigendecomposition: f = f( x ), x 2 Rm, rf( x ) 2 Rm, ⇢ : Rm ! R + Constantine, Dow, and Wang (2014) i = Z w T i rf( x ) 2 ⇢( x ) d x , i = 1, . . . , m average, squared, directional derivative along eigenvector eigenvalue Eigenvalues measure ridge structure with eigenvectors: -
conditional average active subspace Poincaré constant eigenvalues associated with inactive
subspace f( x ) µ(W T 1 x ) L2(⇢) C ( n+1 + · · · + m)1 2 Constantine, Dow, and Wang (2014) Eigenvalues control the approximation error -
(1) Draw samples: (2) Compute: and fj = f( xj)
(3) Approximate with Monte Carlo, and compute eigendecomposition Equivalent to SVD of samples of the gradient Called an active subspace method in T. Russi’s 2010 Ph.D. thesis, Uncertainty Quantification with Experimental Data in Complex System Models C ⇡ 1 N N X j=1 rfj rfT j = ˆ W ˆ ⇤ ˆ W T 1 p N ⇥ rf1 · · · rfN ⇤ = ˆ W p ˆ ⇤ ˆ V T rfj = rf( xj) Constantine, Dow, and Wang (2014), Constantine and Gleich (2015, arXiv) xj ⇠ ⇢( x ) Estimate the active subspace with Monte Carlo -
1 p N ⇥ rf1 · · · rfN ⇤
⇡ ˆ W 1 q ˆ ⇤1 ˆ V T 1 Low-rank approximation of the collection of gradients: Low-dimensional linear approximation of the gradient: f( x ) ⇡ g ⇣ ˆ W T 1 x ⌘ Approximate a function of many variables by a function of a few linear combinations of the variables: ✔ ✖ ✖ Remember the problem to solve span ( ˆ W 1) ⇡ { rf( x ) : x 2 supp ⇢( x ) } -
N = ⌦ ✓ L2 1 2 k "2 log(
m ) ◆ = ) | k ˆk | k " How many gradient samples? number of samples eigenvalue error (w.h.p.) subspace error (w.h.p.) Constantine and Gleich (2015) via Gittens and Tropp (2011), Stewart (1973) N = ⌦ ✓ L2 1"2 log( m ) ◆ = ) dist( W 1, ˆ W 1) 4 1" n n+1 bound on gradient dimension number of samples bound on gradient dimension -
In practice, bootstrap Constantine and Gleich (2015, arXiv) Index 1
2 3 4 5 6 Eigenvalues 10-8 10-6 10-4 10-2 100 102 104 True Est BI Index 1 2 3 4 5 6 Eigenvalues 10-8 10-6 10-4 10-2 100 102 104 Subspace Dimension 1 2 3 4 5 6 Subspace Error 10-6 10-4 10-2 100 True Est BI Subspace Dimension 1 2 3 4 5 6 Subspace Error 10-6 10-4 10-2 100 Eigenvalue estimates and subspace error estimates with bootstrap intervals from quadratic function of 10 variables -
Subspace error Eigenvalues for active variables Eigenvalues for inactive variables
Recall the subspace error: Effect of estimated eigenvectors? Constantine, Dow, and Wang (2014) " = dist( W 1, ˆ W 1) / O (eigval. error) n n+1 f( x ) µ( ˆ W T 1 x ) L2(⇢) C ⇣ " ( 1 + · · · + n)1 2 + ( n+1 + · · · + m)1 2 ⌘ -
An example where it doesn’t work active subspace U =
[0; 1] inactive subspace U = [1; 0] f ( x1, x2) = 5 x1 + sin(10 ⇡x2) Constantine, Eftekhari, Hokanson, and Ward (2017) C = “ Z rf rfT ” = 25 0 0 526 <latexit sha1_base64="VTalW+3KthfPSuX7r/T/HHiOg+4=">AAAWgnicjZjvU9s2GMfdrtu67BfdbrzZG2+5/tiO6yVs3Xa77a6FUgqllBYSCJilsqPEAv+qLIeEnP/Gvd4fsrfbJNsJjvWFkTuIou/n0fPIsqRHsiOPxaLR+OvGzfduvf/Bh7c/qn38yaeffb5w54t2HCbcoS0n9EJ+YJOYeiygLcGERw8iTolve3TfPl1V+v6Q8piFwZ4YR/TYJ4OA9ZlDhKzqLjDLXzXv/W5ago7E5O3b1GKBMK2A2B4x+9bStPTHnixnzP37qWXVlIlNByyY2D4RnI3S2vIj857ZMC1L/rtnPlr+qWbRoDfTuwv1xsNG9jH1QrMo1I3is9O989UNqxc6iU8D4Xgkjo+ajUgcTwgXzPFoWrOSmEbEOSUDeiSLAfFpfDzJnklq3pU1PbMfcvkne5TVli0mxI/jsW9LUgboxlVNVSLtKBH9X44nLIgSQQMnd9RPPFOEpnrAZo9x6ghvLAvE4UzGajou4cQRchhqNSvi4ZD1qBP6PpGPx5Ie0qPm8cSyQ6+nIgq9Sb2ZpndrFqcBPZuBQ+rkoIrJ7mdQzaoQxMOt1Wp3zdWci2VRqWYSRZSbjnx79KjomKaZp8mG8qIF/USqNIgTTlU0OfkkhegKQFcwugrQVYw+BehTjK4BdA2jzwD6DKPrAF3H6HOAPsfoBkA3MLoJ0E2MvgDoC4xuAXQLoy8B+hKj2wDdxugrgL7C6A5AdzD6GqCvMfoGoG8wugvQXYzuAXQPoy2AtjDaBmgbo/sA3cfoAUAPMNoBaAejhwA9vOQllBtYjwDeKhQ8GmzgQ6NcgDbnlIfApKFoHQ8DGqfZOjuhqLlh1b0iseehDVAbow5AHYz2ANrDKAUoxWgfoH2MDgA6wKgLUBejDKAMoycAPcHoKUBPMeoB1MOoD1AfowFAA4xW31KFhhiNABph9B1A32GUA5RjNAZojFEBUIHRBKAJRocAHWL0DKBnGB0BdITRMUDHGD0H6PklAwumgUz4JlaUzQWZ18Uy44zEXGZXThDjJ3lS50ozla5V1JWSuqKpayV1TVM3SuqGpm6W1E1N3S6p25q6W1J3NfWgpB5oaqekdvJH5BIRfzOPuVni6aqtQpbSqrg+E9c1cbZTueXdqQLtuVTMmPyH5qQ1c9LSxfZMbOvi/kzc10RvLjwPhyfK4QkYXjZNMl2WNHE8E8e6eD4TzzWxU2gdTTkslENNiTuz/l4MbPnl98Iz/PKr+eu4LGOzA9CAU3o6D9nEi1z1MCRQHJ+svCp3EfrULA58zvQ4NdcAi9KjZXn+8mhfyAceDDxq1ptL1lJ92eJs4AqLZ5WVbq2NotLhzpYTLGvhqN7MrY4r/Go4zP2EcqYTEXJ1+p2o2qldyaVuzDm0ltXXMG8Tnsc6Z61qr455h4d27rbo5M7U4BJH9sXZeO6qQToo3yxUrHq9Ue6lLw/dcm1U9wXEk4OQXvwYdSf15bRqSbjME0e5xyToyfM6FZPMbq6nBYasWXAtaxZo1rKO/a+tgvzE143J6BrGEkLGsdqDs6udOLFPqCPUVUYVEvJZUjDqeX02jA+m4/5dNlXU1YtNxjRmJDBZUFxCzbcacRaqvIK7YbfScMS1QDN6fCm+pC0+mcH55QbaguSxU0wrQXvPnFDlGetE/u5mqXfVfZg9WuQ8jLXmnBx3rscyRap9v7I6DorFcaCtm1nykK2bKluotOfmDZaACjGgkczqBl15xOGyyLwwqPaWZYj8vgJyCkq5qoBaT/Lm8s5c0aQ7dTwN/Sr3bsk/5LX9vWh4q6psZe1sXRXY1kVcW1dFNRI8UYexoVyV8omYVagdp7tQb1avSPVCe/lhU5Zf/1h//GtxfXrb+Nr41nhgNI2fjcfGc2PHaBmO8afxt/GP8e/ircXvF5uLP+TozRuFzZfG3Gfxt/8AMi7iZg==</latexit> <latexit sha1_base64="VTalW+3KthfPSuX7r/T/HHiOg+4=">AAAWgnicjZjvU9s2GMfdrtu67BfdbrzZG2+5/tiO6yVs3Xa77a6FUgqllBYSCJilsqPEAv+qLIeEnP/Gvd4fsrfbJNsJjvWFkTuIou/n0fPIsqRHsiOPxaLR+OvGzfduvf/Bh7c/qn38yaeffb5w54t2HCbcoS0n9EJ+YJOYeiygLcGERw8iTolve3TfPl1V+v6Q8piFwZ4YR/TYJ4OA9ZlDhKzqLjDLXzXv/W5ago7E5O3b1GKBMK2A2B4x+9bStPTHnixnzP37qWXVlIlNByyY2D4RnI3S2vIj857ZMC1L/rtnPlr+qWbRoDfTuwv1xsNG9jH1QrMo1I3is9O989UNqxc6iU8D4Xgkjo+ajUgcTwgXzPFoWrOSmEbEOSUDeiSLAfFpfDzJnklq3pU1PbMfcvkne5TVli0mxI/jsW9LUgboxlVNVSLtKBH9X44nLIgSQQMnd9RPPFOEpnrAZo9x6ghvLAvE4UzGajou4cQRchhqNSvi4ZD1qBP6PpGPx5Ie0qPm8cSyQ6+nIgq9Sb2ZpndrFqcBPZuBQ+rkoIrJ7mdQzaoQxMOt1Wp3zdWci2VRqWYSRZSbjnx79KjomKaZp8mG8qIF/USqNIgTTlU0OfkkhegKQFcwugrQVYw+BehTjK4BdA2jzwD6DKPrAF3H6HOAPsfoBkA3MLoJ0E2MvgDoC4xuAXQLoy8B+hKj2wDdxugrgL7C6A5AdzD6GqCvMfoGoG8wugvQXYzuAXQPoy2AtjDaBmgbo/sA3cfoAUAPMNoBaAejhwA9vOQllBtYjwDeKhQ8GmzgQ6NcgDbnlIfApKFoHQ8DGqfZOjuhqLlh1b0iseehDVAbow5AHYz2ANrDKAUoxWgfoH2MDgA6wKgLUBejDKAMoycAPcHoKUBPMeoB1MOoD1AfowFAA4xW31KFhhiNABph9B1A32GUA5RjNAZojFEBUIHRBKAJRocAHWL0DKBnGB0BdITRMUDHGD0H6PklAwumgUz4JlaUzQWZ18Uy44zEXGZXThDjJ3lS50ozla5V1JWSuqKpayV1TVM3SuqGpm6W1E1N3S6p25q6W1J3NfWgpB5oaqekdvJH5BIRfzOPuVni6aqtQpbSqrg+E9c1cbZTueXdqQLtuVTMmPyH5qQ1c9LSxfZMbOvi/kzc10RvLjwPhyfK4QkYXjZNMl2WNHE8E8e6eD4TzzWxU2gdTTkslENNiTuz/l4MbPnl98Iz/PKr+eu4LGOzA9CAU3o6D9nEi1z1MCRQHJ+svCp3EfrULA58zvQ4NdcAi9KjZXn+8mhfyAceDDxq1ptL1lJ92eJs4AqLZ5WVbq2NotLhzpYTLGvhqN7MrY4r/Go4zP2EcqYTEXJ1+p2o2qldyaVuzDm0ltXXMG8Tnsc6Z61qr455h4d27rbo5M7U4BJH9sXZeO6qQToo3yxUrHq9Ue6lLw/dcm1U9wXEk4OQXvwYdSf15bRqSbjME0e5xyToyfM6FZPMbq6nBYasWXAtaxZo1rKO/a+tgvzE143J6BrGEkLGsdqDs6udOLFPqCPUVUYVEvJZUjDqeX02jA+m4/5dNlXU1YtNxjRmJDBZUFxCzbcacRaqvIK7YbfScMS1QDN6fCm+pC0+mcH55QbaguSxU0wrQXvPnFDlGetE/u5mqXfVfZg9WuQ8jLXmnBx3rscyRap9v7I6DorFcaCtm1nykK2bKluotOfmDZaACjGgkczqBl15xOGyyLwwqPaWZYj8vgJyCkq5qoBaT/Lm8s5c0aQ7dTwN/Sr3bsk/5LX9vWh4q6psZe1sXRXY1kVcW1dFNRI8UYexoVyV8omYVagdp7tQb1avSPVCe/lhU5Zf/1h//GtxfXrb+Nr41nhgNI2fjcfGc2PHaBmO8afxt/GP8e/ircXvF5uLP+TozRuFzZfG3Gfxt/8AMi7iZg==</latexit> <latexit sha1_base64="VTalW+3KthfPSuX7r/T/HHiOg+4=">AAAWgnicjZjvU9s2GMfdrtu67BfdbrzZG2+5/tiO6yVs3Xa77a6FUgqllBYSCJilsqPEAv+qLIeEnP/Gvd4fsrfbJNsJjvWFkTuIou/n0fPIsqRHsiOPxaLR+OvGzfduvf/Bh7c/qn38yaeffb5w54t2HCbcoS0n9EJ+YJOYeiygLcGERw8iTolve3TfPl1V+v6Q8piFwZ4YR/TYJ4OA9ZlDhKzqLjDLXzXv/W5ago7E5O3b1GKBMK2A2B4x+9bStPTHnixnzP37qWXVlIlNByyY2D4RnI3S2vIj857ZMC1L/rtnPlr+qWbRoDfTuwv1xsNG9jH1QrMo1I3is9O989UNqxc6iU8D4Xgkjo+ajUgcTwgXzPFoWrOSmEbEOSUDeiSLAfFpfDzJnklq3pU1PbMfcvkne5TVli0mxI/jsW9LUgboxlVNVSLtKBH9X44nLIgSQQMnd9RPPFOEpnrAZo9x6ghvLAvE4UzGajou4cQRchhqNSvi4ZD1qBP6PpGPx5Ie0qPm8cSyQ6+nIgq9Sb2ZpndrFqcBPZuBQ+rkoIrJ7mdQzaoQxMOt1Wp3zdWci2VRqWYSRZSbjnx79KjomKaZp8mG8qIF/USqNIgTTlU0OfkkhegKQFcwugrQVYw+BehTjK4BdA2jzwD6DKPrAF3H6HOAPsfoBkA3MLoJ0E2MvgDoC4xuAXQLoy8B+hKj2wDdxugrgL7C6A5AdzD6GqCvMfoGoG8wugvQXYzuAXQPoy2AtjDaBmgbo/sA3cfoAUAPMNoBaAejhwA9vOQllBtYjwDeKhQ8GmzgQ6NcgDbnlIfApKFoHQ8DGqfZOjuhqLlh1b0iseehDVAbow5AHYz2ANrDKAUoxWgfoH2MDgA6wKgLUBejDKAMoycAPcHoKUBPMeoB1MOoD1AfowFAA4xW31KFhhiNABph9B1A32GUA5RjNAZojFEBUIHRBKAJRocAHWL0DKBnGB0BdITRMUDHGD0H6PklAwumgUz4JlaUzQWZ18Uy44zEXGZXThDjJ3lS50ozla5V1JWSuqKpayV1TVM3SuqGpm6W1E1N3S6p25q6W1J3NfWgpB5oaqekdvJH5BIRfzOPuVni6aqtQpbSqrg+E9c1cbZTueXdqQLtuVTMmPyH5qQ1c9LSxfZMbOvi/kzc10RvLjwPhyfK4QkYXjZNMl2WNHE8E8e6eD4TzzWxU2gdTTkslENNiTuz/l4MbPnl98Iz/PKr+eu4LGOzA9CAU3o6D9nEi1z1MCRQHJ+svCp3EfrULA58zvQ4NdcAi9KjZXn+8mhfyAceDDxq1ptL1lJ92eJs4AqLZ5WVbq2NotLhzpYTLGvhqN7MrY4r/Go4zP2EcqYTEXJ1+p2o2qldyaVuzDm0ltXXMG8Tnsc6Z61qr455h4d27rbo5M7U4BJH9sXZeO6qQToo3yxUrHq9Ue6lLw/dcm1U9wXEk4OQXvwYdSf15bRqSbjME0e5xyToyfM6FZPMbq6nBYasWXAtaxZo1rKO/a+tgvzE143J6BrGEkLGsdqDs6udOLFPqCPUVUYVEvJZUjDqeX02jA+m4/5dNlXU1YtNxjRmJDBZUFxCzbcacRaqvIK7YbfScMS1QDN6fCm+pC0+mcH55QbaguSxU0wrQXvPnFDlGetE/u5mqXfVfZg9WuQ8jLXmnBx3rscyRap9v7I6DorFcaCtm1nykK2bKluotOfmDZaACjGgkczqBl15xOGyyLwwqPaWZYj8vgJyCkq5qoBaT/Lm8s5c0aQ7dTwN/Sr3bsk/5LX9vWh4q6psZe1sXRXY1kVcW1dFNRI8UYexoVyV8omYVagdp7tQb1avSPVCe/lhU5Zf/1h//GtxfXrb+Nr41nhgNI2fjcfGc2PHaBmO8afxt/GP8e/ircXvF5uLP+TozRuFzZfG3Gfxt/8AMi7iZg==</latexit> <latexit sha1_base64="VTalW+3KthfPSuX7r/T/HHiOg+4=">AAAWgnicjZjvU9s2GMfdrtu67BfdbrzZG2+5/tiO6yVs3Xa77a6FUgqllBYSCJilsqPEAv+qLIeEnP/Gvd4fsrfbJNsJjvWFkTuIou/n0fPIsqRHsiOPxaLR+OvGzfduvf/Bh7c/qn38yaeffb5w54t2HCbcoS0n9EJ+YJOYeiygLcGERw8iTolve3TfPl1V+v6Q8piFwZ4YR/TYJ4OA9ZlDhKzqLjDLXzXv/W5ago7E5O3b1GKBMK2A2B4x+9bStPTHnixnzP37qWXVlIlNByyY2D4RnI3S2vIj857ZMC1L/rtnPlr+qWbRoDfTuwv1xsNG9jH1QrMo1I3is9O989UNqxc6iU8D4Xgkjo+ajUgcTwgXzPFoWrOSmEbEOSUDeiSLAfFpfDzJnklq3pU1PbMfcvkne5TVli0mxI/jsW9LUgboxlVNVSLtKBH9X44nLIgSQQMnd9RPPFOEpnrAZo9x6ghvLAvE4UzGajou4cQRchhqNSvi4ZD1qBP6PpGPx5Ie0qPm8cSyQ6+nIgq9Sb2ZpndrFqcBPZuBQ+rkoIrJ7mdQzaoQxMOt1Wp3zdWci2VRqWYSRZSbjnx79KjomKaZp8mG8qIF/USqNIgTTlU0OfkkhegKQFcwugrQVYw+BehTjK4BdA2jzwD6DKPrAF3H6HOAPsfoBkA3MLoJ0E2MvgDoC4xuAXQLoy8B+hKj2wDdxugrgL7C6A5AdzD6GqCvMfoGoG8wugvQXYzuAXQPoy2AtjDaBmgbo/sA3cfoAUAPMNoBaAejhwA9vOQllBtYjwDeKhQ8GmzgQ6NcgDbnlIfApKFoHQ8DGqfZOjuhqLlh1b0iseehDVAbow5AHYz2ANrDKAUoxWgfoH2MDgA6wKgLUBejDKAMoycAPcHoKUBPMeoB1MOoD1AfowFAA4xW31KFhhiNABph9B1A32GUA5RjNAZojFEBUIHRBKAJRocAHWL0DKBnGB0BdITRMUDHGD0H6PklAwumgUz4JlaUzQWZ18Uy44zEXGZXThDjJ3lS50ozla5V1JWSuqKpayV1TVM3SuqGpm6W1E1N3S6p25q6W1J3NfWgpB5oaqekdvJH5BIRfzOPuVni6aqtQpbSqrg+E9c1cbZTueXdqQLtuVTMmPyH5qQ1c9LSxfZMbOvi/kzc10RvLjwPhyfK4QkYXjZNMl2WNHE8E8e6eD4TzzWxU2gdTTkslENNiTuz/l4MbPnl98Iz/PKr+eu4LGOzA9CAU3o6D9nEi1z1MCRQHJ+svCp3EfrULA58zvQ4NdcAi9KjZXn+8mhfyAceDDxq1ptL1lJ92eJs4AqLZ5WVbq2NotLhzpYTLGvhqN7MrY4r/Go4zP2EcqYTEXJ1+p2o2qldyaVuzDm0ltXXMG8Tnsc6Z61qr455h4d27rbo5M7U4BJH9sXZeO6qQToo3yxUrHq9Ue6lLw/dcm1U9wXEk4OQXvwYdSf15bRqSbjME0e5xyToyfM6FZPMbq6nBYasWXAtaxZo1rKO/a+tgvzE143J6BrGEkLGsdqDs6udOLFPqCPUVUYVEvJZUjDqeX02jA+m4/5dNlXU1YtNxjRmJDBZUFxCzbcacRaqvIK7YbfScMS1QDN6fCm+pC0+mcH55QbaguSxU0wrQXvPnFDlGetE/u5mqXfVfZg9WuQ8jLXmnBx3rscyRap9v7I6DorFcaCtm1nykK2bKluotOfmDZaACjGgkczqBl15xOGyyLwwqPaWZYj8vgJyCkq5qoBaT/Lm8s5c0aQ7dTwN/Sr3bsk/5LX9vWh4q6psZe1sXRXY1kVcW1dFNRI8UYexoVyV8omYVagdp7tQb1avSPVCe/lhU5Zf/1h//GtxfXrb+Nr41nhgNI2fjcfGc2PHaBmO8afxt/GP8e/ircXvF5uLP+TozRuFzZfG3Gfxt/8AMi7iZg==</latexit> -
f( x ) ⇡ g(UT x ) What is U?
Define the error function: R(U) = 1 2 Z (f( x ) µ(UT x ))2 ⇢( x ) d x Minimize the error: minimize U R ( U ) subject to U 2 G ( n, m ) Grassmann manifold Constantine, Eftekhari, Hokanson, and Ward (2017) Ridge approximations best approximation -
k ¯ rR(W 1)kF L ⇣ 2m1 2 +
(m n)1 2 ⌘ ( n+1 + · · · + m)1 2 The active subspace is nearly stationary Assume (1) Lipschitz continuous function (2) Gaussian density function gradient on the Grassmann manifold active subspace Frobenius norm dimensions Lipschitz constant eigenvalues associated with inactive subspace Constantine, Eftekhari, Hokanson, and Ward (2017) -
(1) Choose points: (2) Compute: fj = f( xj) (3)
Minimize the misfit Minimize over polynomials and subspaces xj ⇠ ⇢( x ) Estimate the optimal subspace with discrete least squares minimize g2P p(Rn) U2G(n,m) N X j=1 ⇣ fj g(UT xj) ⌘2 Constantine, Eftekhari, Hokanson, and Ward (2017), Hokanson and Constantine (2018) -
Alternating minimization Constantine, Eftekhari, Hokanson, and Ward (2017), Hokanson and
Constantine (2018) Variable projection Given subspace, fit polynomial Given polynomial coefficients, minimize over subspace Repeat Use pseudoinverse of Vandermonde matrix to express optimal polynomial coefficients Compute the derivative of the pseudoinverse of the Vandermonde matrix [Golub & Pereyra (1973)] on the Grassmann manifold [Edelman et al. (1998)] Run Newton on loss function Two contenders for the least squares problem minimize g2P p(Rn) U2G(n,m) N X j=1 ⇣ fj g(UT xj) ⌘2 -
r · (aru) = 1, s 2 D u =
0, s 2 1 n · aru = 0, s 2 2 Input field Solution Hokanson and Constantine (2018) -
Constantine, Eftekhari, Hokanson, and Ward (2017), Hokanson and Constantine (2018)
Details under the hood How do you choose points? How do you choose the subspace dimension? What is your polynomial basis for the ridge approximation? Grassmann gradient of pseudo-inverse is complicated but has some nice simplifications Open questions Can you use other bases (frames, RBFs, …) ? Is the continuous optimization problem well-posed? How does the discrete optimization relate to the continuous optimization? -
(1) Choose points and compute For lower triangular and ,
consider NEW STUFF :: The Lipschitz matrix Hokanson and Constantine (in prep.) F(L, ⌦) = n f : Rm ! R |f( x ) f( y )| kLT ( x y )k2 o <latexit sha1_base64="WWLO/rffiyV7W7GAej/cwBiAEoI=">AAAWonicjZh9T9tGHMdD99RlD6Wbyj+TNm9ZJZBoRdCkTZ0mFSil0JRCeQbT6Oxc4it+6vkSEoxfwF7iXsXewu7OJji+LwwjlPN9P7+H8/me7MQ+S8TCwj9T9z759LPPv7j/Zf2rr7/59sH0w+/2k6jPXbrnRn7EDx2SUJ+FdE8w4dPDmFMSOD49cM5WlH4woDxhUbgrRjE9DUgvZF3mEiGr2tN/2wERnkv89GU2awetefttQHtkzvrLsn3aFXZqz1vdZ5pynPRd9j6wOet5gnAenV9XW/af8s9hvUtVsC67s/ZgOPdE/YzmLpWvj5Z9KQO831XKE1VtX7YX7fncnZ21pxsLTxf0ZZmFZlFo1Iprq/3w0ZTdidx+QEPh+iRJTpoLsThNCRfM9WlWt/sJjYl7Rnr0RBZDEtDkNNXPLLMey5qO1Y24/A+FpWvLFikJkmQUOJJUjUyqmqpE2klfdP84TVkY9wUN3TxQt+9bIrJUB1gdxqkr/JEsEJczmavleoQTV8huqtftmEcD1qFuFAQk7KTqEWcnzdPUdiK/ozKK/LTRzLLHdZvTkJ6PwQF1c1B3SldDdbtCEB97q9cfWys5l8iiUq1+HFNuufLtMrOiI5rpSOm6imIkvSRVGiZ9TlU2ObmUQXQZoMsYXQHoCkZfAPQFRlcBuorRlwB9idE1gK5h9BVAX2F0HaDrGN0A6AZGXwP0NUZbAG1h9A1A32B0E6CbGH0L0LcY3QLoFka3AbqN0XcAfYfRHYDuYHQXoLsY3QPoHkb3AbqP0QOAHmD0EKCHGD0C6BFGjwF6fMNLKBe4DgG8XSi4N1gvgEa5AG0uKI+AyYKiTTwKaZLpeTalyN2gGl6ROPLAAaiDURegLkY7AO1glAKUYrQL0C5GewDtYdQDqIdRBlCG0Q8A/YDRM4CeYdQHqI/RAKABRkOAhhitvqUKjTAaAzTG6EeAfsQoByjHaALQBKMCoAKjfYD2MToA6ACj5wA9x+gQoEOMjgA6wugFQC9u6FgwDOSGL7VjPRbkvi6RO85YTOzsyhvEZCnf1OkDwVJ1+5gsl9RlQ10tqauGul5S1w11o6RuGOpmSd001J2SumOohyX10FCPSupR/og8IpKfJzFPbzw9tVTIUlYV18bimiGOVyqvvDpVoF2PijGT3xhB9sZB9kxxfyzum+LBWDwwRH8iPR+nJ8rpCZieHiZalyVDHI3FkSlejMULQzwqtCNDOS6UY0NJjsbtve7Y8svvR+f45Vfj1/WYZvUBqMcpPZuEHOLHnnoYEiiOT3ZelYeIAmoVBz736jg14YDF2cmiPH/pw7VPwp5PrUZz3p5vLBYnYa4rK81aHcalw50jB5j2cNJo5lanFX4lGuRxIjnSiYi4Ov2mqvbKrhTSNOYcWsvqO5jvE57nOmGtam/PeYtHTh62aOTWlcENgZzrszHtsTBV95wNMxmASv3qtmLV6QzzKF156JZzo/peQHzZCdn1zbCdNhazqiXhcp84zCP2w448r1ORaruJlhYYsmbhnaxZaFjLOva/tgoK+oFpTIZ3MJYQMk7UGizoUKRJ3/lAXaE+ZVQhIZ8lBb2e1+tunL3q9zk9VNSnF4eMaMJIaLGw+Eg16TXmLFL7Cu5F7YrjmBuJanp0Iz5vTD7a4OJmA2NC8tkZppVgvGdupPYZa0Tet/XWuxo+0o8WBY8Sw52b4+7dWKZIte5XZsdeMTn2jHlTbx70vKl2CxV/Xu6wBFSIHo3lrq7XlkccLovMj8Jqa5lG5O8tkFtQKlQFNFqSu8sbc4tL7yrwVeq3hfdK8SFvrO+F41ZVaWk/rdsSa13n1botq6HgfXUYG8hZKR+IukKtOO3pRrP6idQs7C8+bcry9m+N58+Kz6f3az/UfqnN1pq132vPa69qW7W9mlv7d+rR1I9TP838OrMxsz2zk6P3pgqb72sT14z9Hx6R70Y=</latexit> <latexit sha1_base64="WWLO/rffiyV7W7GAej/cwBiAEoI=">AAAWonicjZh9T9tGHMdD99RlD6Wbyj+TNm9ZJZBoRdCkTZ0mFSil0JRCeQbT6Oxc4it+6vkSEoxfwF7iXsXewu7OJji+LwwjlPN9P7+H8/me7MQ+S8TCwj9T9z759LPPv7j/Zf2rr7/59sH0w+/2k6jPXbrnRn7EDx2SUJ+FdE8w4dPDmFMSOD49cM5WlH4woDxhUbgrRjE9DUgvZF3mEiGr2tN/2wERnkv89GU2awetefttQHtkzvrLsn3aFXZqz1vdZ5pynPRd9j6wOet5gnAenV9XW/af8s9hvUtVsC67s/ZgOPdE/YzmLpWvj5Z9KQO831XKE1VtX7YX7fncnZ21pxsLTxf0ZZmFZlFo1Iprq/3w0ZTdidx+QEPh+iRJTpoLsThNCRfM9WlWt/sJjYl7Rnr0RBZDEtDkNNXPLLMey5qO1Y24/A+FpWvLFikJkmQUOJJUjUyqmqpE2klfdP84TVkY9wUN3TxQt+9bIrJUB1gdxqkr/JEsEJczmavleoQTV8huqtftmEcD1qFuFAQk7KTqEWcnzdPUdiK/ozKK/LTRzLLHdZvTkJ6PwQF1c1B3SldDdbtCEB97q9cfWys5l8iiUq1+HFNuufLtMrOiI5rpSOm6imIkvSRVGiZ9TlU2ObmUQXQZoMsYXQHoCkZfAPQFRlcBuorRlwB9idE1gK5h9BVAX2F0HaDrGN0A6AZGXwP0NUZbAG1h9A1A32B0E6CbGH0L0LcY3QLoFka3AbqN0XcAfYfRHYDuYHQXoLsY3QPoHkb3AbqP0QOAHmD0EKCHGD0C6BFGjwF6fMNLKBe4DgG8XSi4N1gvgEa5AG0uKI+AyYKiTTwKaZLpeTalyN2gGl6ROPLAAaiDURegLkY7AO1glAKUYrQL0C5GewDtYdQDqIdRBlCG0Q8A/YDRM4CeYdQHqI/RAKABRkOAhhitvqUKjTAaAzTG6EeAfsQoByjHaALQBKMCoAKjfYD2MToA6ACj5wA9x+gQoEOMjgA6wugFQC9u6FgwDOSGL7VjPRbkvi6RO85YTOzsyhvEZCnf1OkDwVJ1+5gsl9RlQ10tqauGul5S1w11o6RuGOpmSd001J2SumOohyX10FCPSupR/og8IpKfJzFPbzw9tVTIUlYV18bimiGOVyqvvDpVoF2PijGT3xhB9sZB9kxxfyzum+LBWDwwRH8iPR+nJ8rpCZieHiZalyVDHI3FkSlejMULQzwqtCNDOS6UY0NJjsbtve7Y8svvR+f45Vfj1/WYZvUBqMcpPZuEHOLHnnoYEiiOT3ZelYeIAmoVBz736jg14YDF2cmiPH/pw7VPwp5PrUZz3p5vLBYnYa4rK81aHcalw50jB5j2cNJo5lanFX4lGuRxIjnSiYi4Ov2mqvbKrhTSNOYcWsvqO5jvE57nOmGtam/PeYtHTh62aOTWlcENgZzrszHtsTBV95wNMxmASv3qtmLV6QzzKF156JZzo/peQHzZCdn1zbCdNhazqiXhcp84zCP2w448r1ORaruJlhYYsmbhnaxZaFjLOva/tgoK+oFpTIZ3MJYQMk7UGizoUKRJ3/lAXaE+ZVQhIZ8lBb2e1+tunL3q9zk9VNSnF4eMaMJIaLGw+Eg16TXmLFL7Cu5F7YrjmBuJanp0Iz5vTD7a4OJmA2NC8tkZppVgvGdupPYZa0Tet/XWuxo+0o8WBY8Sw52b4+7dWKZIte5XZsdeMTn2jHlTbx70vKl2CxV/Xu6wBFSIHo3lrq7XlkccLovMj8Jqa5lG5O8tkFtQKlQFNFqSu8sbc4tL7yrwVeq3hfdK8SFvrO+F41ZVaWk/rdsSa13n1botq6HgfXUYG8hZKR+IukKtOO3pRrP6idQs7C8+bcry9m+N58+Kz6f3az/UfqnN1pq132vPa69qW7W9mlv7d+rR1I9TP838OrMxsz2zk6P3pgqb72sT14z9Hx6R70Y=</latexit> <latexit sha1_base64="WWLO/rffiyV7W7GAej/cwBiAEoI=">AAAWonicjZh9T9tGHMdD99RlD6Wbyj+TNm9ZJZBoRdCkTZ0mFSil0JRCeQbT6Oxc4it+6vkSEoxfwF7iXsXewu7OJji+LwwjlPN9P7+H8/me7MQ+S8TCwj9T9z759LPPv7j/Zf2rr7/59sH0w+/2k6jPXbrnRn7EDx2SUJ+FdE8w4dPDmFMSOD49cM5WlH4woDxhUbgrRjE9DUgvZF3mEiGr2tN/2wERnkv89GU2awetefttQHtkzvrLsn3aFXZqz1vdZ5pynPRd9j6wOet5gnAenV9XW/af8s9hvUtVsC67s/ZgOPdE/YzmLpWvj5Z9KQO831XKE1VtX7YX7fncnZ21pxsLTxf0ZZmFZlFo1Iprq/3w0ZTdidx+QEPh+iRJTpoLsThNCRfM9WlWt/sJjYl7Rnr0RBZDEtDkNNXPLLMey5qO1Y24/A+FpWvLFikJkmQUOJJUjUyqmqpE2klfdP84TVkY9wUN3TxQt+9bIrJUB1gdxqkr/JEsEJczmavleoQTV8huqtftmEcD1qFuFAQk7KTqEWcnzdPUdiK/ozKK/LTRzLLHdZvTkJ6PwQF1c1B3SldDdbtCEB97q9cfWys5l8iiUq1+HFNuufLtMrOiI5rpSOm6imIkvSRVGiZ9TlU2ObmUQXQZoMsYXQHoCkZfAPQFRlcBuorRlwB9idE1gK5h9BVAX2F0HaDrGN0A6AZGXwP0NUZbAG1h9A1A32B0E6CbGH0L0LcY3QLoFka3AbqN0XcAfYfRHYDuYHQXoLsY3QPoHkb3AbqP0QOAHmD0EKCHGD0C6BFGjwF6fMNLKBe4DgG8XSi4N1gvgEa5AG0uKI+AyYKiTTwKaZLpeTalyN2gGl6ROPLAAaiDURegLkY7AO1glAKUYrQL0C5GewDtYdQDqIdRBlCG0Q8A/YDRM4CeYdQHqI/RAKABRkOAhhitvqUKjTAaAzTG6EeAfsQoByjHaALQBKMCoAKjfYD2MToA6ACj5wA9x+gQoEOMjgA6wugFQC9u6FgwDOSGL7VjPRbkvi6RO85YTOzsyhvEZCnf1OkDwVJ1+5gsl9RlQ10tqauGul5S1w11o6RuGOpmSd001J2SumOohyX10FCPSupR/og8IpKfJzFPbzw9tVTIUlYV18bimiGOVyqvvDpVoF2PijGT3xhB9sZB9kxxfyzum+LBWDwwRH8iPR+nJ8rpCZieHiZalyVDHI3FkSlejMULQzwqtCNDOS6UY0NJjsbtve7Y8svvR+f45Vfj1/WYZvUBqMcpPZuEHOLHnnoYEiiOT3ZelYeIAmoVBz736jg14YDF2cmiPH/pw7VPwp5PrUZz3p5vLBYnYa4rK81aHcalw50jB5j2cNJo5lanFX4lGuRxIjnSiYi4Ov2mqvbKrhTSNOYcWsvqO5jvE57nOmGtam/PeYtHTh62aOTWlcENgZzrszHtsTBV95wNMxmASv3qtmLV6QzzKF156JZzo/peQHzZCdn1zbCdNhazqiXhcp84zCP2w448r1ORaruJlhYYsmbhnaxZaFjLOva/tgoK+oFpTIZ3MJYQMk7UGizoUKRJ3/lAXaE+ZVQhIZ8lBb2e1+tunL3q9zk9VNSnF4eMaMJIaLGw+Eg16TXmLFL7Cu5F7YrjmBuJanp0Iz5vTD7a4OJmA2NC8tkZppVgvGdupPYZa0Tet/XWuxo+0o8WBY8Sw52b4+7dWKZIte5XZsdeMTn2jHlTbx70vKl2CxV/Xu6wBFSIHo3lrq7XlkccLovMj8Jqa5lG5O8tkFtQKlQFNFqSu8sbc4tL7yrwVeq3hfdK8SFvrO+F41ZVaWk/rdsSa13n1botq6HgfXUYG8hZKR+IukKtOO3pRrP6idQs7C8+bcry9m+N58+Kz6f3az/UfqnN1pq132vPa69qW7W9mlv7d+rR1I9TP838OrMxsz2zk6P3pgqb72sT14z9Hx6R70Y=</latexit> <latexit sha1_base64="WWLO/rffiyV7W7GAej/cwBiAEoI=">AAAWonicjZh9T9tGHMdD99RlD6Wbyj+TNm9ZJZBoRdCkTZ0mFSil0JRCeQbT6Oxc4it+6vkSEoxfwF7iXsXewu7OJji+LwwjlPN9P7+H8/me7MQ+S8TCwj9T9z759LPPv7j/Zf2rr7/59sH0w+/2k6jPXbrnRn7EDx2SUJ+FdE8w4dPDmFMSOD49cM5WlH4woDxhUbgrRjE9DUgvZF3mEiGr2tN/2wERnkv89GU2awetefttQHtkzvrLsn3aFXZqz1vdZ5pynPRd9j6wOet5gnAenV9XW/af8s9hvUtVsC67s/ZgOPdE/YzmLpWvj5Z9KQO831XKE1VtX7YX7fncnZ21pxsLTxf0ZZmFZlFo1Iprq/3w0ZTdidx+QEPh+iRJTpoLsThNCRfM9WlWt/sJjYl7Rnr0RBZDEtDkNNXPLLMey5qO1Y24/A+FpWvLFikJkmQUOJJUjUyqmqpE2klfdP84TVkY9wUN3TxQt+9bIrJUB1gdxqkr/JEsEJczmavleoQTV8huqtftmEcD1qFuFAQk7KTqEWcnzdPUdiK/ozKK/LTRzLLHdZvTkJ6PwQF1c1B3SldDdbtCEB97q9cfWys5l8iiUq1+HFNuufLtMrOiI5rpSOm6imIkvSRVGiZ9TlU2ObmUQXQZoMsYXQHoCkZfAPQFRlcBuorRlwB9idE1gK5h9BVAX2F0HaDrGN0A6AZGXwP0NUZbAG1h9A1A32B0E6CbGH0L0LcY3QLoFka3AbqN0XcAfYfRHYDuYHQXoLsY3QPoHkb3AbqP0QOAHmD0EKCHGD0C6BFGjwF6fMNLKBe4DgG8XSi4N1gvgEa5AG0uKI+AyYKiTTwKaZLpeTalyN2gGl6ROPLAAaiDURegLkY7AO1glAKUYrQL0C5GewDtYdQDqIdRBlCG0Q8A/YDRM4CeYdQHqI/RAKABRkOAhhitvqUKjTAaAzTG6EeAfsQoByjHaALQBKMCoAKjfYD2MToA6ACj5wA9x+gQoEOMjgA6wugFQC9u6FgwDOSGL7VjPRbkvi6RO85YTOzsyhvEZCnf1OkDwVJ1+5gsl9RlQ10tqauGul5S1w11o6RuGOpmSd001J2SumOohyX10FCPSupR/og8IpKfJzFPbzw9tVTIUlYV18bimiGOVyqvvDpVoF2PijGT3xhB9sZB9kxxfyzum+LBWDwwRH8iPR+nJ8rpCZieHiZalyVDHI3FkSlejMULQzwqtCNDOS6UY0NJjsbtve7Y8svvR+f45Vfj1/WYZvUBqMcpPZuEHOLHnnoYEiiOT3ZelYeIAmoVBz736jg14YDF2cmiPH/pw7VPwp5PrUZz3p5vLBYnYa4rK81aHcalw50jB5j2cNJo5lanFX4lGuRxIjnSiYi4Ov2mqvbKrhTSNOYcWsvqO5jvE57nOmGtam/PeYtHTh62aOTWlcENgZzrszHtsTBV95wNMxmASv3qtmLV6QzzKF156JZzo/peQHzZCdn1zbCdNhazqiXhcp84zCP2w448r1ORaruJlhYYsmbhnaxZaFjLOva/tgoK+oFpTIZ3MJYQMk7UGizoUKRJ3/lAXaE+ZVQhIZ8lBb2e1+tunL3q9zk9VNSnF4eMaMJIaLGw+Eg16TXmLFL7Cu5F7YrjmBuJanp0Iz5vTD7a4OJmA2NC8tkZppVgvGdupPYZa0Tet/XWuxo+0o8WBY8Sw52b4+7dWKZIte5XZsdeMTn2jHlTbx70vKl2CxV/Xu6wBFSIHo3lrq7XlkccLovMj8Jqa5lG5O8tkFtQKlQFNFqSu8sbc4tL7yrwVeq3hfdK8SFvrO+F41ZVaWk/rdsSa13n1botq6HgfXUYG8hZKR+IukKtOO3pRrP6idQs7C8+bcry9m+N58+Kz6f3az/UfqnN1pq132vPa69qW7W9mlv7d+rR1I9TP838OrMxsz2zk6P3pgqb72sT14z9Hx6R70Y=</latexit> L 2 Rm⇥m <latexit sha1_base64="OrLnvfWsq0a12iczfWkizLYK6dk=">AAAWNXicjZhNb9s2GMfV7q3zXppuyGk7aDMKdEBRxEGB7dgmTdOkbpo3O3GizJBk2mKjt1KUY0fQZZ9m1+2yz7LDbsOu+wojKdmRxX+yGAhC8f97+DwkRfKhnNinCV9Z+fPO3Q8+/OjjT+592vjs8y++vL/04KtuEqXMJR038iN27NgJ8WlIOpxynxzHjNiB45Mj53xd6kdjwhIahYd8GpOzwB6FdEhdm4uq/tK3VtC2aGgFNvccJ9vPf84Ci9OAJGaQ95eaK09W1M/UC62y0DTK327/wfIdaxC5aUBC7vp2kpy2VmJ+ltmMU9cnecNKExLb7rk9IqeiGNrC0VmmupGbD0XNwBxGTPyF3FS1VYvMDpJkGjiClOEmdU1WIu005cOfzjIaxiknoVs4Gqa+ySNTjok5oIy43J+Kgu0yKmI1Xc9mtsvFyDUaVsyiMR0QNwoCOxxkcrDy09ZZZjmRP5ARRX7WbOX5w4bFSEgu5uCYuAWohneooIZVI2wft9ZoPDTXCy4RRamaaRwTZrpiwvWoyJTkylO2Jb1oQT8XKgmTlBEZTUE+zyG6BtA1jK4DdB2jLwD6AqMbAN3A6EuAvsToJkA3MfoKoK8wugXQLYxuA3Qbo68B+hqjbYC2MfoGoG8wugPQHYy+BehbjO4CdBejewDdw+g+QPcxegDQA4weAvQQox2AdjDaBWgXo0cAPcLoMUCPMdoDaA+jJwA9ueYlFGfOwAa8VSp4NugogEaFAG0uCYuAyYqkdTwKSZKrfTYjqLlx3b0kseexA1AHoy5AXYwOADrAKAEowegQoEOMjgA6wqgHUA+jFKAUo+8A+g6j5wA9x6gPUB+jAUADjIYADTFaf0slGmE0BmiM0fcAfY9RBlCG0QSgCUY5QDlGU4CmGB0DdIzRC4BeYHQC0AlGpwCdYvQSoJfXTCxYBiLhy6xYrQWR1yUi44z5QmZXTRCT50VS5wkzma7V1LWKuqapGxV1Q1O3KuqWpm5X1G1N3amoO5p6UFEPNPW4oh5raq+i9ooh8myefLeIeSrx9ORRIUp5Xdyci5uaOD+pvOrpVIMOPcLnTPGgOenMnXR0sTsXu7p4NBePNNFfCM/H4fFqeByGp5aJ0kVJE6dzcaqLl3PxUhN7pdbTlJNSOdGUpDfv79XEVl9+P7rAL79cv65HFasuQCNGyPki5Nh+7MnBEEB5fbKKqsJFFBCzvPC5s+vUQgM0zk9Xxf3LJ0MuBjwc+cRsth5bj5urFqMjj1tMVda6tTGJK5c7Ryww1cJps1VYndX49Whc+InESrd5xOTtN5O1M7uKS92YMWgtqm9h3rVZEeuCtay9OeZdFjmF27KTuzODaxw5V3djMqJhJp8ZneTCARH67LFmNRhMCi9DcekWe6P8XmD7YhLyq4dJP2uu5nVLm4k8cVJ4TMOBuK8Tnim7hZ6WGLKm4a2saahZizr6v7YSCtJAN7YntzAWEDJO5BnMyYRnSeq8Iy6XnzLqEBdjScCsF/VqGh/N5v0HtVTkpxfHnpKE2qFJw/K70WKrMaORzCuYF/VrDcdMC1TR02vxx9rmowwurzfQNiSfnmNaCtp75kYyz9i0xXNfpd5195EaWuQ8SrTm3AJ3b8dSScpzv7Y7jsrNcaTtmyp5UPumzBZq7XlFgxWgRoxILLK6UV9ccZgoUj8K672lChH/b4DckpKuaqDWk6K5ojM3NOnNHM9Cv8m9V/EPee18Lxtu15W2aqd9U2Dtq7jaN0U14SyVl7Gx2JWKhagq5InTX2q26p9I9UJ39UlLlPeeNp89LT+f3jO+Mb43Hhkt40fjmfHK2DU6hmv8Yvxq/Gb8vvzH8l/Lfy//U6B375Q2XxsLv+V//wNLX8z4</latexit> <latexit sha1_base64="OrLnvfWsq0a12iczfWkizLYK6dk=">AAAWNXicjZhNb9s2GMfV7q3zXppuyGk7aDMKdEBRxEGB7dgmTdOkbpo3O3GizJBk2mKjt1KUY0fQZZ9m1+2yz7LDbsOu+wojKdmRxX+yGAhC8f97+DwkRfKhnNinCV9Z+fPO3Q8+/OjjT+592vjs8y++vL/04KtuEqXMJR038iN27NgJ8WlIOpxynxzHjNiB45Mj53xd6kdjwhIahYd8GpOzwB6FdEhdm4uq/tK3VtC2aGgFNvccJ9vPf84Ci9OAJGaQ95eaK09W1M/UC62y0DTK327/wfIdaxC5aUBC7vp2kpy2VmJ+ltmMU9cnecNKExLb7rk9IqeiGNrC0VmmupGbD0XNwBxGTPyF3FS1VYvMDpJkGjiClOEmdU1WIu005cOfzjIaxiknoVs4Gqa+ySNTjok5oIy43J+Kgu0yKmI1Xc9mtsvFyDUaVsyiMR0QNwoCOxxkcrDy09ZZZjmRP5ARRX7WbOX5w4bFSEgu5uCYuAWohneooIZVI2wft9ZoPDTXCy4RRamaaRwTZrpiwvWoyJTkylO2Jb1oQT8XKgmTlBEZTUE+zyG6BtA1jK4DdB2jLwD6AqMbAN3A6EuAvsToJkA3MfoKoK8wugXQLYxuA3Qbo68B+hqjbYC2MfoGoG8wugPQHYy+BehbjO4CdBejewDdw+g+QPcxegDQA4weAvQQox2AdjDaBWgXo0cAPcLoMUCPMdoDaA+jJwA9ueYlFGfOwAa8VSp4NugogEaFAG0uCYuAyYqkdTwKSZKrfTYjqLlx3b0kseexA1AHoy5AXYwOADrAKAEowegQoEOMjgA6wqgHUA+jFKAUo+8A+g6j5wA9x6gPUB+jAUADjIYADTFaf0slGmE0BmiM0fcAfY9RBlCG0QSgCUY5QDlGU4CmGB0DdIzRC4BeYHQC0AlGpwCdYvQSoJfXTCxYBiLhy6xYrQWR1yUi44z5QmZXTRCT50VS5wkzma7V1LWKuqapGxV1Q1O3KuqWpm5X1G1N3amoO5p6UFEPNPW4oh5raq+i9ooh8myefLeIeSrx9ORRIUp5Xdyci5uaOD+pvOrpVIMOPcLnTPGgOenMnXR0sTsXu7p4NBePNNFfCM/H4fFqeByGp5aJ0kVJE6dzcaqLl3PxUhN7pdbTlJNSOdGUpDfv79XEVl9+P7rAL79cv65HFasuQCNGyPki5Nh+7MnBEEB5fbKKqsJFFBCzvPC5s+vUQgM0zk9Xxf3LJ0MuBjwc+cRsth5bj5urFqMjj1tMVda6tTGJK5c7Ryww1cJps1VYndX49Whc+InESrd5xOTtN5O1M7uKS92YMWgtqm9h3rVZEeuCtay9OeZdFjmF27KTuzODaxw5V3djMqJhJp8ZneTCARH67LFmNRhMCi9DcekWe6P8XmD7YhLyq4dJP2uu5nVLm4k8cVJ4TMOBuK8Tnim7hZ6WGLKm4a2saahZizr6v7YSCtJAN7YntzAWEDJO5BnMyYRnSeq8Iy6XnzLqEBdjScCsF/VqGh/N5v0HtVTkpxfHnpKE2qFJw/K70WKrMaORzCuYF/VrDcdMC1TR02vxx9rmowwurzfQNiSfnmNaCtp75kYyz9i0xXNfpd5195EaWuQ8SrTm3AJ3b8dSScpzv7Y7jsrNcaTtmyp5UPumzBZq7XlFgxWgRoxILLK6UV9ccZgoUj8K672lChH/b4DckpKuaqDWk6K5ojM3NOnNHM9Cv8m9V/EPee18Lxtu15W2aqd9U2Dtq7jaN0U14SyVl7Gx2JWKhagq5InTX2q26p9I9UJ39UlLlPeeNp89LT+f3jO+Mb43Hhkt40fjmfHK2DU6hmv8Yvxq/Gb8vvzH8l/Lfy//U6B375Q2XxsLv+V//wNLX8z4</latexit> <latexit sha1_base64="OrLnvfWsq0a12iczfWkizLYK6dk=">AAAWNXicjZhNb9s2GMfV7q3zXppuyGk7aDMKdEBRxEGB7dgmTdOkbpo3O3GizJBk2mKjt1KUY0fQZZ9m1+2yz7LDbsOu+wojKdmRxX+yGAhC8f97+DwkRfKhnNinCV9Z+fPO3Q8+/OjjT+592vjs8y++vL/04KtuEqXMJR038iN27NgJ8WlIOpxynxzHjNiB45Mj53xd6kdjwhIahYd8GpOzwB6FdEhdm4uq/tK3VtC2aGgFNvccJ9vPf84Ci9OAJGaQ95eaK09W1M/UC62y0DTK327/wfIdaxC5aUBC7vp2kpy2VmJ+ltmMU9cnecNKExLb7rk9IqeiGNrC0VmmupGbD0XNwBxGTPyF3FS1VYvMDpJkGjiClOEmdU1WIu005cOfzjIaxiknoVs4Gqa+ySNTjok5oIy43J+Kgu0yKmI1Xc9mtsvFyDUaVsyiMR0QNwoCOxxkcrDy09ZZZjmRP5ARRX7WbOX5w4bFSEgu5uCYuAWohneooIZVI2wft9ZoPDTXCy4RRamaaRwTZrpiwvWoyJTkylO2Jb1oQT8XKgmTlBEZTUE+zyG6BtA1jK4DdB2jLwD6AqMbAN3A6EuAvsToJkA3MfoKoK8wugXQLYxuA3Qbo68B+hqjbYC2MfoGoG8wugPQHYy+BehbjO4CdBejewDdw+g+QPcxegDQA4weAvQQox2AdjDaBWgXo0cAPcLoMUCPMdoDaA+jJwA9ueYlFGfOwAa8VSp4NugogEaFAG0uCYuAyYqkdTwKSZKrfTYjqLlx3b0kseexA1AHoy5AXYwOADrAKAEowegQoEOMjgA6wqgHUA+jFKAUo+8A+g6j5wA9x6gPUB+jAUADjIYADTFaf0slGmE0BmiM0fcAfY9RBlCG0QSgCUY5QDlGU4CmGB0DdIzRC4BeYHQC0AlGpwCdYvQSoJfXTCxYBiLhy6xYrQWR1yUi44z5QmZXTRCT50VS5wkzma7V1LWKuqapGxV1Q1O3KuqWpm5X1G1N3amoO5p6UFEPNPW4oh5raq+i9ooh8myefLeIeSrx9ORRIUp5Xdyci5uaOD+pvOrpVIMOPcLnTPGgOenMnXR0sTsXu7p4NBePNNFfCM/H4fFqeByGp5aJ0kVJE6dzcaqLl3PxUhN7pdbTlJNSOdGUpDfv79XEVl9+P7rAL79cv65HFasuQCNGyPki5Nh+7MnBEEB5fbKKqsJFFBCzvPC5s+vUQgM0zk9Xxf3LJ0MuBjwc+cRsth5bj5urFqMjj1tMVda6tTGJK5c7Ryww1cJps1VYndX49Whc+InESrd5xOTtN5O1M7uKS92YMWgtqm9h3rVZEeuCtay9OeZdFjmF27KTuzODaxw5V3djMqJhJp8ZneTCARH67LFmNRhMCi9DcekWe6P8XmD7YhLyq4dJP2uu5nVLm4k8cVJ4TMOBuK8Tnim7hZ6WGLKm4a2saahZizr6v7YSCtJAN7YntzAWEDJO5BnMyYRnSeq8Iy6XnzLqEBdjScCsF/VqGh/N5v0HtVTkpxfHnpKE2qFJw/K70WKrMaORzCuYF/VrDcdMC1TR02vxx9rmowwurzfQNiSfnmNaCtp75kYyz9i0xXNfpd5195EaWuQ8SrTm3AJ3b8dSScpzv7Y7jsrNcaTtmyp5UPumzBZq7XlFgxWgRoxILLK6UV9ccZgoUj8K672lChH/b4DckpKuaqDWk6K5ojM3NOnNHM9Cv8m9V/EPee18Lxtu15W2aqd9U2Dtq7jaN0U14SyVl7Gx2JWKhagq5InTX2q26p9I9UJ39UlLlPeeNp89LT+f3jO+Mb43Hhkt40fjmfHK2DU6hmv8Yvxq/Gb8vvzH8l/Lfy//U6B375Q2XxsLv+V//wNLX8z4</latexit> <latexit sha1_base64="OrLnvfWsq0a12iczfWkizLYK6dk=">AAAWNXicjZhNb9s2GMfV7q3zXppuyGk7aDMKdEBRxEGB7dgmTdOkbpo3O3GizJBk2mKjt1KUY0fQZZ9m1+2yz7LDbsOu+wojKdmRxX+yGAhC8f97+DwkRfKhnNinCV9Z+fPO3Q8+/OjjT+592vjs8y++vL/04KtuEqXMJR038iN27NgJ8WlIOpxynxzHjNiB45Mj53xd6kdjwhIahYd8GpOzwB6FdEhdm4uq/tK3VtC2aGgFNvccJ9vPf84Ci9OAJGaQ95eaK09W1M/UC62y0DTK327/wfIdaxC5aUBC7vp2kpy2VmJ+ltmMU9cnecNKExLb7rk9IqeiGNrC0VmmupGbD0XNwBxGTPyF3FS1VYvMDpJkGjiClOEmdU1WIu005cOfzjIaxiknoVs4Gqa+ySNTjok5oIy43J+Kgu0yKmI1Xc9mtsvFyDUaVsyiMR0QNwoCOxxkcrDy09ZZZjmRP5ARRX7WbOX5w4bFSEgu5uCYuAWohneooIZVI2wft9ZoPDTXCy4RRamaaRwTZrpiwvWoyJTkylO2Jb1oQT8XKgmTlBEZTUE+zyG6BtA1jK4DdB2jLwD6AqMbAN3A6EuAvsToJkA3MfoKoK8wugXQLYxuA3Qbo68B+hqjbYC2MfoGoG8wugPQHYy+BehbjO4CdBejewDdw+g+QPcxegDQA4weAvQQox2AdjDaBWgXo0cAPcLoMUCPMdoDaA+jJwA9ueYlFGfOwAa8VSp4NugogEaFAG0uCYuAyYqkdTwKSZKrfTYjqLlx3b0kseexA1AHoy5AXYwOADrAKAEowegQoEOMjgA6wqgHUA+jFKAUo+8A+g6j5wA9x6gPUB+jAUADjIYADTFaf0slGmE0BmiM0fcAfY9RBlCG0QSgCUY5QDlGU4CmGB0DdIzRC4BeYHQC0AlGpwCdYvQSoJfXTCxYBiLhy6xYrQWR1yUi44z5QmZXTRCT50VS5wkzma7V1LWKuqapGxV1Q1O3KuqWpm5X1G1N3amoO5p6UFEPNPW4oh5raq+i9ooh8myefLeIeSrx9ORRIUp5Xdyci5uaOD+pvOrpVIMOPcLnTPGgOenMnXR0sTsXu7p4NBePNNFfCM/H4fFqeByGp5aJ0kVJE6dzcaqLl3PxUhN7pdbTlJNSOdGUpDfv79XEVl9+P7rAL79cv65HFasuQCNGyPki5Nh+7MnBEEB5fbKKqsJFFBCzvPC5s+vUQgM0zk9Xxf3LJ0MuBjwc+cRsth5bj5urFqMjj1tMVda6tTGJK5c7Ryww1cJps1VYndX49Whc+InESrd5xOTtN5O1M7uKS92YMWgtqm9h3rVZEeuCtay9OeZdFjmF27KTuzODaxw5V3djMqJhJp8ZneTCARH67LFmNRhMCi9DcekWe6P8XmD7YhLyq4dJP2uu5nVLm4k8cVJ4TMOBuK8Tnim7hZ6WGLKm4a2saahZizr6v7YSCtJAN7YntzAWEDJO5BnMyYRnSeq8Iy6XnzLqEBdjScCsF/VqGh/N5v0HtVTkpxfHnpKE2qFJw/K70WKrMaORzCuYF/VrDcdMC1TR02vxx9rmowwurzfQNiSfnmNaCtp75kYyz9i0xXNfpd5195EaWuQ8SrTm3AJ3b8dSScpzv7Y7jsrNcaTtmyp5UPumzBZq7XlFgxWgRoxILLK6UV9ccZgoUj8K672lChH/b4DckpKuaqDWk6K5ojM3NOnNHM9Cv8m9V/EPee18Lxtu15W2aqd9U2Dtq7jaN0U14SyVl7Gx2JWKhagq5InTX2q26p9I9UJ39UlLlPeeNp89LT+f3jO+Mb43Hhkt40fjmfHK2DU6hmv8Yvxq/Gb8vvzH8l/Lfy//U6B375Q2XxsLv+V//wNLX8z4</latexit> ⌦ ⇢ Rm <latexit sha1_base64="n4BhS8P/97RMdwhrvNJgehrutOo=">AAAWMnicjZhdb9s2FIbV7qvzPppuyMWwG21GgQ4oijgosF22SdM0qZumTZzEiTKDkmmJjb5KUY4dQdiv2e12sz+z3Q273Y8YKcmOLL7JYiAIxfc5PIekSB7Kjn2WiJWVP2/d/uDDjz7+5M6nrc8+/+LLu0v3vjpIopQ7tOdEfsSPbJJQn4W0J5jw6VHMKQlsnx7aZ+tKPxxTnrAo3BfTmJ4GxA3ZiDlEyKrB0jfW64C6xEpSO6HCCojwbDt7m/8cDJbaK49Wip+pFzpVoW1Uv93BveVb1jBy0oCGwvFJkpx0VmJxmhEumOPTvGWlCY2Jc0ZceiKLIQlocpoVfcjN+7JmaI4iLv9CYRa1dYuMBEkyDWxJqiCTpqYqkXaSitFPpxkL41TQ0CkdjVLfFJGpBsQcMk4d4U9lgTicyVhNxyOcOEIOW6tlxTwasyF1oiAg4TBTQ5SfdE4zy478oYoo8rN2J8/vtyxOQ3o+B8fUKcFiUEcF1LIaBPFxa63WfXO95BJZVKqZxjHlpiNnW4+KTmleeMq2lBct6KdSpWGScqqiKcmnOUTXALqG0XWArmP0GUCfYXQDoBsYfQ7Q5xjdBOgmRl8A9AVGtwC6hdFtgG5j9CVAX2K0C9AuRl8B9BVGdwC6g9HXAH2N0V2A7mL0DUDfYPQtQN9idA+gexjdB+g+RnsA7WH0AKAHGD0E6CFGjwB6hNE+QPsYPQbo8RUvoTxwhgTwVqXg2WBuAI1KAdpcUB4BkxVF63gU0iQv9tmMoubGTfeKxJ7HNkBtjDoAdTA6BOgQoxSgFKMjgI4w6gLUxagHUA+jDKAMo+8A+g6jZwA9w6gPUB+jAUADjIYADTHafEsVGmE0BmiM0fcAfY9RDlCO0QSgCUYFQAVGU4CmGB0DdIzRc4CeY3QC0AlGpwCdYvQCoBdXTCxYBjLhy6y4WAsyr0tkxhmLhcyuniAmT8ukzpNmKl1rqGs1dU1TN2rqhqZu1dQtTd2uqduaulNTdzR1r6buaepRTT3S1H5N7ZdD5BGRfLeIeUXi6amjQpbyprg5Fzc1cX5SefXTqQHte1TMmfJBc9KbO+np4sFcPNDFw7l4qIn+Qng+Dk/UwxMwvGKZFLosaeJ0Lk518WIuXmhiv9L6mnJcKceakvTn/b2c2PrL70fn+OVX69fxWMEWFyCXU3q2CNnEjz01GBKork9WWVW6iAJqVhc+Z3adWmiAxfnJqrx/+XQk5ICHrk/Ndueh9bC9anHmesLiRWWjWxuTuHa5s+UCK1o4aXdKq9MGvx6NSz+RXOlERFzdfjNVO7OrudSNOYfWsvoG5geEl7EuWKva62Pe5ZFduq06uTszuMKRfXk3pi4LM/XM2SSXDqjUZ48Nq+FwUnoZyUu33BvV9wLiy0nILx8mg6y9mjctCZd54qT0mIZDeV+nIivsFnpaYciahTeyZqFmLevY/9oqKEgD3ZhMbmAsIWScqDNY0InIktR+Rx2hPmU0ISHHkoJZL+uLaXwwm/cfiqWiPr3YZEoTRkKThdVHo8VWY84ilVdwLxo0Go65FmhBT6/EH2qbT2FwcbWBtiH57AzTStDeMydSecYmkc+DIvVuuo+KoUXOo0Rrzilx52YsU6Q69xu7o1ttjq62bxbJQ7Fvqmyh0Z5XNlgDGoRLY5nVuQN5xeGyyPwobPaWFYj8fw3kVJRy1QC1npTNlZ25pklv5ngW+nXuvZp/yGvne9Vwt6l0i3a61wXWvYyre11UE8FTdRkby12pXIhFhTpxBkvtTvMTqV44WH3UkeU3j9tPHlefT+8Y3xrfGw+MjvGj8cR4YewaPcMxfjF+NX4zfl/+Y/mv5b+X/ynR27cqm6+Nhd/yv/8BGVLLxg==</latexit> <latexit sha1_base64="n4BhS8P/97RMdwhrvNJgehrutOo=">AAAWMnicjZhdb9s2FIbV7qvzPppuyMWwG21GgQ4oijgosF22SdM0qZumTZzEiTKDkmmJjb5KUY4dQdiv2e12sz+z3Q273Y8YKcmOLL7JYiAIxfc5PIekSB7Kjn2WiJWVP2/d/uDDjz7+5M6nrc8+/+LLu0v3vjpIopQ7tOdEfsSPbJJQn4W0J5jw6VHMKQlsnx7aZ+tKPxxTnrAo3BfTmJ4GxA3ZiDlEyKrB0jfW64C6xEpSO6HCCojwbDt7m/8cDJbaK49Wip+pFzpVoW1Uv93BveVb1jBy0oCGwvFJkpx0VmJxmhEumOPTvGWlCY2Jc0ZceiKLIQlocpoVfcjN+7JmaI4iLv9CYRa1dYuMBEkyDWxJqiCTpqYqkXaSitFPpxkL41TQ0CkdjVLfFJGpBsQcMk4d4U9lgTicyVhNxyOcOEIOW6tlxTwasyF1oiAg4TBTQ5SfdE4zy478oYoo8rN2J8/vtyxOQ3o+B8fUKcFiUEcF1LIaBPFxa63WfXO95BJZVKqZxjHlpiNnW4+KTmleeMq2lBct6KdSpWGScqqiKcmnOUTXALqG0XWArmP0GUCfYXQDoBsYfQ7Q5xjdBOgmRl8A9AVGtwC6hdFtgG5j9CVAX2K0C9AuRl8B9BVGdwC6g9HXAH2N0V2A7mL0DUDfYPQtQN9idA+gexjdB+g+RnsA7WH0AKAHGD0E6CFGjwB6hNE+QPsYPQbo8RUvoTxwhgTwVqXg2WBuAI1KAdpcUB4BkxVF63gU0iQv9tmMoubGTfeKxJ7HNkBtjDoAdTA6BOgQoxSgFKMjgI4w6gLUxagHUA+jDKAMo+8A+g6jZwA9w6gPUB+jAUADjIYADTHafEsVGmE0BmiM0fcAfY9RDlCO0QSgCUYFQAVGU4CmGB0DdIzRc4CeY3QC0AlGpwCdYvQCoBdXTCxYBjLhy6y4WAsyr0tkxhmLhcyuniAmT8ukzpNmKl1rqGs1dU1TN2rqhqZu1dQtTd2uqduaulNTdzR1r6buaepRTT3S1H5N7ZdD5BGRfLeIeUXi6amjQpbyprg5Fzc1cX5SefXTqQHte1TMmfJBc9KbO+np4sFcPNDFw7l4qIn+Qng+Dk/UwxMwvGKZFLosaeJ0Lk518WIuXmhiv9L6mnJcKceakvTn/b2c2PrL70fn+OVX69fxWMEWFyCXU3q2CNnEjz01GBKork9WWVW6iAJqVhc+Z3adWmiAxfnJqrx/+XQk5ICHrk/Ndueh9bC9anHmesLiRWWjWxuTuHa5s+UCK1o4aXdKq9MGvx6NSz+RXOlERFzdfjNVO7OrudSNOYfWsvoG5geEl7EuWKva62Pe5ZFduq06uTszuMKRfXk3pi4LM/XM2SSXDqjUZ48Nq+FwUnoZyUu33BvV9wLiy0nILx8mg6y9mjctCZd54qT0mIZDeV+nIivsFnpaYciahTeyZqFmLevY/9oqKEgD3ZhMbmAsIWScqDNY0InIktR+Rx2hPmU0ISHHkoJZL+uLaXwwm/cfiqWiPr3YZEoTRkKThdVHo8VWY84ilVdwLxo0Go65FmhBT6/EH2qbT2FwcbWBtiH57AzTStDeMydSecYmkc+DIvVuuo+KoUXOo0Rrzilx52YsU6Q69xu7o1ttjq62bxbJQ7Fvqmyh0Z5XNlgDGoRLY5nVuQN5xeGyyPwobPaWFYj8fw3kVJRy1QC1npTNlZ25pklv5ngW+nXuvZp/yGvne9Vwt6l0i3a61wXWvYyre11UE8FTdRkby12pXIhFhTpxBkvtTvMTqV44WH3UkeU3j9tPHlefT+8Y3xrfGw+MjvGj8cR4YewaPcMxfjF+NX4zfl/+Y/mv5b+X/ynR27cqm6+Nhd/yv/8BGVLLxg==</latexit> <latexit sha1_base64="n4BhS8P/97RMdwhrvNJgehrutOo=">AAAWMnicjZhdb9s2FIbV7qvzPppuyMWwG21GgQ4oijgosF22SdM0qZumTZzEiTKDkmmJjb5KUY4dQdiv2e12sz+z3Q273Y8YKcmOLL7JYiAIxfc5PIekSB7Kjn2WiJWVP2/d/uDDjz7+5M6nrc8+/+LLu0v3vjpIopQ7tOdEfsSPbJJQn4W0J5jw6VHMKQlsnx7aZ+tKPxxTnrAo3BfTmJ4GxA3ZiDlEyKrB0jfW64C6xEpSO6HCCojwbDt7m/8cDJbaK49Wip+pFzpVoW1Uv93BveVb1jBy0oCGwvFJkpx0VmJxmhEumOPTvGWlCY2Jc0ZceiKLIQlocpoVfcjN+7JmaI4iLv9CYRa1dYuMBEkyDWxJqiCTpqYqkXaSitFPpxkL41TQ0CkdjVLfFJGpBsQcMk4d4U9lgTicyVhNxyOcOEIOW6tlxTwasyF1oiAg4TBTQ5SfdE4zy478oYoo8rN2J8/vtyxOQ3o+B8fUKcFiUEcF1LIaBPFxa63WfXO95BJZVKqZxjHlpiNnW4+KTmleeMq2lBct6KdSpWGScqqiKcmnOUTXALqG0XWArmP0GUCfYXQDoBsYfQ7Q5xjdBOgmRl8A9AVGtwC6hdFtgG5j9CVAX2K0C9AuRl8B9BVGdwC6g9HXAH2N0V2A7mL0DUDfYPQtQN9idA+gexjdB+g+RnsA7WH0AKAHGD0E6CFGjwB6hNE+QPsYPQbo8RUvoTxwhgTwVqXg2WBuAI1KAdpcUB4BkxVF63gU0iQv9tmMoubGTfeKxJ7HNkBtjDoAdTA6BOgQoxSgFKMjgI4w6gLUxagHUA+jDKAMo+8A+g6jZwA9w6gPUB+jAUADjIYADTHafEsVGmE0BmiM0fcAfY9RDlCO0QSgCUYFQAVGU4CmGB0DdIzRc4CeY3QC0AlGpwCdYvQCoBdXTCxYBjLhy6y4WAsyr0tkxhmLhcyuniAmT8ukzpNmKl1rqGs1dU1TN2rqhqZu1dQtTd2uqduaulNTdzR1r6buaepRTT3S1H5N7ZdD5BGRfLeIeUXi6amjQpbyprg5Fzc1cX5SefXTqQHte1TMmfJBc9KbO+np4sFcPNDFw7l4qIn+Qng+Dk/UwxMwvGKZFLosaeJ0Lk518WIuXmhiv9L6mnJcKceakvTn/b2c2PrL70fn+OVX69fxWMEWFyCXU3q2CNnEjz01GBKork9WWVW6iAJqVhc+Z3adWmiAxfnJqrx/+XQk5ICHrk/Ndueh9bC9anHmesLiRWWjWxuTuHa5s+UCK1o4aXdKq9MGvx6NSz+RXOlERFzdfjNVO7OrudSNOYfWsvoG5geEl7EuWKva62Pe5ZFduq06uTszuMKRfXk3pi4LM/XM2SSXDqjUZ48Nq+FwUnoZyUu33BvV9wLiy0nILx8mg6y9mjctCZd54qT0mIZDeV+nIivsFnpaYciahTeyZqFmLevY/9oqKEgD3ZhMbmAsIWScqDNY0InIktR+Rx2hPmU0ISHHkoJZL+uLaXwwm/cfiqWiPr3YZEoTRkKThdVHo8VWY84ilVdwLxo0Go65FmhBT6/EH2qbT2FwcbWBtiH57AzTStDeMydSecYmkc+DIvVuuo+KoUXOo0Rrzilx52YsU6Q69xu7o1ttjq62bxbJQ7Fvqmyh0Z5XNlgDGoRLY5nVuQN5xeGyyPwobPaWFYj8fw3kVJRy1QC1npTNlZ25pklv5ngW+nXuvZp/yGvne9Vwt6l0i3a61wXWvYyre11UE8FTdRkby12pXIhFhTpxBkvtTvMTqV44WH3UkeU3j9tPHlefT+8Y3xrfGw+MjvGj8cR4YewaPcMxfjF+NX4zfl/+Y/mv5b+X/ynR27cqm6+Nhd/yv/8BGVLLxg==</latexit> <latexit sha1_base64="n4BhS8P/97RMdwhrvNJgehrutOo=">AAAWMnicjZhdb9s2FIbV7qvzPppuyMWwG21GgQ4oijgosF22SdM0qZumTZzEiTKDkmmJjb5KUY4dQdiv2e12sz+z3Q273Y8YKcmOLL7JYiAIxfc5PIekSB7Kjn2WiJWVP2/d/uDDjz7+5M6nrc8+/+LLu0v3vjpIopQ7tOdEfsSPbJJQn4W0J5jw6VHMKQlsnx7aZ+tKPxxTnrAo3BfTmJ4GxA3ZiDlEyKrB0jfW64C6xEpSO6HCCojwbDt7m/8cDJbaK49Wip+pFzpVoW1Uv93BveVb1jBy0oCGwvFJkpx0VmJxmhEumOPTvGWlCY2Jc0ZceiKLIQlocpoVfcjN+7JmaI4iLv9CYRa1dYuMBEkyDWxJqiCTpqYqkXaSitFPpxkL41TQ0CkdjVLfFJGpBsQcMk4d4U9lgTicyVhNxyOcOEIOW6tlxTwasyF1oiAg4TBTQ5SfdE4zy478oYoo8rN2J8/vtyxOQ3o+B8fUKcFiUEcF1LIaBPFxa63WfXO95BJZVKqZxjHlpiNnW4+KTmleeMq2lBct6KdSpWGScqqiKcmnOUTXALqG0XWArmP0GUCfYXQDoBsYfQ7Q5xjdBOgmRl8A9AVGtwC6hdFtgG5j9CVAX2K0C9AuRl8B9BVGdwC6g9HXAH2N0V2A7mL0DUDfYPQtQN9idA+gexjdB+g+RnsA7WH0AKAHGD0E6CFGjwB6hNE+QPsYPQbo8RUvoTxwhgTwVqXg2WBuAI1KAdpcUB4BkxVF63gU0iQv9tmMoubGTfeKxJ7HNkBtjDoAdTA6BOgQoxSgFKMjgI4w6gLUxagHUA+jDKAMo+8A+g6jZwA9w6gPUB+jAUADjIYADTHafEsVGmE0BmiM0fcAfY9RDlCO0QSgCUYFQAVGU4CmGB0DdIzRc4CeY3QC0AlGpwCdYvQCoBdXTCxYBjLhy6y4WAsyr0tkxhmLhcyuniAmT8ukzpNmKl1rqGs1dU1TN2rqhqZu1dQtTd2uqduaulNTdzR1r6buaepRTT3S1H5N7ZdD5BGRfLeIeUXi6amjQpbyprg5Fzc1cX5SefXTqQHte1TMmfJBc9KbO+np4sFcPNDFw7l4qIn+Qng+Dk/UwxMwvGKZFLosaeJ0Lk518WIuXmhiv9L6mnJcKceakvTn/b2c2PrL70fn+OVX69fxWMEWFyCXU3q2CNnEjz01GBKork9WWVW6iAJqVhc+Z3adWmiAxfnJqrx/+XQk5ICHrk/Ndueh9bC9anHmesLiRWWjWxuTuHa5s+UCK1o4aXdKq9MGvx6NSz+RXOlERFzdfjNVO7OrudSNOYfWsvoG5geEl7EuWKva62Pe5ZFduq06uTszuMKRfXk3pi4LM/XM2SSXDqjUZ48Nq+FwUnoZyUu33BvV9wLiy0nILx8mg6y9mjctCZd54qT0mIZDeV+nIivsFnpaYciahTeyZqFmLevY/9oqKEgD3ZhMbmAsIWScqDNY0InIktR+Rx2hPmU0ISHHkoJZL+uLaXwwm/cfiqWiPr3YZEoTRkKThdVHo8VWY84ilVdwLxo0Go65FmhBT6/EH2qbT2FwcbWBtiH57AzTStDeMydSecYmkc+DIvVuuo+KoUXOo0Rrzilx52YsU6Q69xu7o1ttjq62bxbJQ7Fvqmyh0Z5XNlgDGoRLY5nVuQN5xeGyyPwobPaWFYj8fw3kVJRy1QC1npTNlZ25pklv5ngW+nXuvZp/yGvne9Vwt6l0i3a61wXWvYyre11UE8FTdRkby12pXIhFhTpxBkvtTvMTqV44WH3UkeU3j9tPHlefT+8Y3xrfGw+MjvGj8cR4YewaPcMxfjF+NX4zfl/+Y/mv5b+X/ynR27cqm6+Nhd/yv/8BGVLLxg==</latexit> Problem: Given , find f <latexit sha1_base64="j/8YNKd3L0KJ6tDGu4+KKpWj58k=">AAAWGHicjZhNb9s2GMfV7q3z3toNOe2izSjQAUURBwW2Y5s0TZO6adLETpwoMCiZltjorRTl2BH0CXbdLvs0uw277rZvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaI1dV/79z96ONPPv3s3uetL7786utv7j/4tp9EKXdoz4n8iB/bJKE+C2lPMOHT45hTEtg+PbLPN5R+NKE8YVF4KGYxPQuIG7Ixc4iQVfvj4f326pPV4mfqhU5VaBvVb2/4YOWONYqcNKChcHySJKed1VicZYQL5vg0b1lpQmPinBOXnspiSAKanGVFpLn5UNaMzHHE5V8ozKK2bpGRIElmgS3JgAgvaWqqEmmnqRj/cpaxME4FDZ3S0Tj1TRGZqtvmiHHqCH8mC8ThTMZqOh7hxBHy5bRaVsyjCRtRJwoCEo4yS3rITztnmWVH/khFFPlZu5PnD1sWpyG9WIAT6pSgiskeF1DLahDEx621Wg/NjZJLZFGpZhrHlJuOHFM9KjqjeeEp21ZetKCfS5WGScqpiqYkn+cQXQfoOkY3ALqB0RcAfYHRTYBuYvQlQF9idAugWxh9BdBXGN0G6DZGdwC6g9HXAH2N0S5Auxh9A9A3GN0F6C5G3wL0LUb3ALqH0X2A7mP0HUDfYfQAoAcYPQToIUZ7AO1htA/QPkaPAHqE0WOAHmN0ANABRk8AenLNRyi3lREBvFUpeDSYG0CjUoA2l5RHwGRV0ToehTTJi3U2o6i5SdO9IrHniQ1QG6MOQB2MjgA6wigFKMXoGKBjjLoAdTHqAdTDKAMow+h7gL7H6DlAzzHqA9THaADQAKMhQEOMNr9ShUYYjQEaY/QDQD9glAOUYzQBaIJRAVCB0RSgKUYnAJ1g9AKgFxidAnSK0RlAZxi9BOjlNQMLpoFM+DIrLuaCzOsSmXHGYimzqyeIyfMyqfOkmUrXGup6TV3X1M2auqmp2zV1W1N3auqOpu7W1F1NPaipB5p6XFOPNXVQUwflK/KISH5Yxrwi8fTUViFLeVPcWohbmrjYqbz67tSADj0qFkz5oDnpLZz0dLG/EPu6eLQQjzTRXwrPx+GJengChldMk0KXJU2cLcSZLl4uxEtNHFTaQFNOKuVEU5LBor9XA1v/+P3oAn/8av46HivY4gDkckrPlyGb+LGnXoYEquOTVVaVLqKAmtWBz5kfp5YaYHF+uibPXz4dC/nCQ9enZrvz2HrcXrM4cz1h8aKy0a3NaVw73NlyghUtnLY7pdVZg9+IJqWfSM50IiKuTr+Zqp3b1VzqxpxDa1l9C/M+4WWsS9aq9uaY93hkl26rTu7NDa5xZF+djanLwkw9czbNpQMq9fljw2o0mpZexvLQLddGdV9AfDkI+dXDdJi11/KmJeEyT5yWHtNwJM/rVGSF3VJPKwxZs/BW1izUrGUd+19bBQVpoBuT6S2MJYSME7UHCzoVWZLa76kj1FVGExLyXVIw6mV9MYyP5uP+UzFV1NWLTWY0YSQ0WVhdDS23GnMWqbyCe9Gw0XDMtUALenYt/lhbfAqDy+sNtAXJZ+eYVoL2nTmRyjO2iHweFql3031UvFrkPEq05pwSd27HMkWqfb+xOrrV4uhq62aRPBTrpsoWGu15ZYM1oEG4NJZZnTuURxwui8yPwmZvWYHI/zdATkUpVw1Q60nZXNmZG5r05o7nod/k3qv5h7y2v1cNd5tKt2ine1Ng3au4ujdFNRU8VYexiVyVyolYVKgdZ3i/3WlekeqF/tqTjizvP20/e1pdn94zvjd+NB4ZHeNn45nxytgzeoZjUONX4zfj95U/Vv5c+Wvl7xK9e6ey+c5Y+q388x8O0MD1</latexit> <latexit sha1_base64="j/8YNKd3L0KJ6tDGu4+KKpWj58k=">AAAWGHicjZhNb9s2GMfV7q3z3toNOe2izSjQAUURBwW2Y5s0TZO6adLETpwoMCiZltjorRTl2BH0CXbdLvs0uw277rZvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaI1dV/79z96ONPPv3s3uetL7786utv7j/4tp9EKXdoz4n8iB/bJKE+C2lPMOHT45hTEtg+PbLPN5R+NKE8YVF4KGYxPQuIG7Ixc4iQVfvj4f326pPV4mfqhU5VaBvVb2/4YOWONYqcNKChcHySJKed1VicZYQL5vg0b1lpQmPinBOXnspiSAKanGVFpLn5UNaMzHHE5V8ozKK2bpGRIElmgS3JgAgvaWqqEmmnqRj/cpaxME4FDZ3S0Tj1TRGZqtvmiHHqCH8mC8ThTMZqOh7hxBHy5bRaVsyjCRtRJwoCEo4yS3rITztnmWVH/khFFPlZu5PnD1sWpyG9WIAT6pSgiskeF1DLahDEx621Wg/NjZJLZFGpZhrHlJuOHFM9KjqjeeEp21ZetKCfS5WGScqpiqYkn+cQXQfoOkY3ALqB0RcAfYHRTYBuYvQlQF9idAugWxh9BdBXGN0G6DZGdwC6g9HXAH2N0S5Auxh9A9A3GN0F6C5G3wL0LUb3ALqH0X2A7mP0HUDfYfQAoAcYPQToIUZ7AO1htA/QPkaPAHqE0WOAHmN0ANABRk8AenLNRyi3lREBvFUpeDSYG0CjUoA2l5RHwGRV0ToehTTJi3U2o6i5SdO9IrHniQ1QG6MOQB2MjgA6wigFKMXoGKBjjLoAdTHqAdTDKAMow+h7gL7H6DlAzzHqA9THaADQAKMhQEOMNr9ShUYYjQEaY/QDQD9glAOUYzQBaIJRAVCB0RSgKUYnAJ1g9AKgFxidAnSK0RlAZxi9BOjlNQMLpoFM+DIrLuaCzOsSmXHGYimzqyeIyfMyqfOkmUrXGup6TV3X1M2auqmp2zV1W1N3auqOpu7W1F1NPaipB5p6XFOPNXVQUwflK/KISH5Yxrwi8fTUViFLeVPcWohbmrjYqbz67tSADj0qFkz5oDnpLZz0dLG/EPu6eLQQjzTRXwrPx+GJengChldMk0KXJU2cLcSZLl4uxEtNHFTaQFNOKuVEU5LBor9XA1v/+P3oAn/8av46HivY4gDkckrPlyGb+LGnXoYEquOTVVaVLqKAmtWBz5kfp5YaYHF+uibPXz4dC/nCQ9enZrvz2HrcXrM4cz1h8aKy0a3NaVw73NlyghUtnLY7pdVZg9+IJqWfSM50IiKuTr+Zqp3b1VzqxpxDa1l9C/M+4WWsS9aq9uaY93hkl26rTu7NDa5xZF+djanLwkw9czbNpQMq9fljw2o0mpZexvLQLddGdV9AfDkI+dXDdJi11/KmJeEyT5yWHtNwJM/rVGSF3VJPKwxZs/BW1izUrGUd+19bBQVpoBuT6S2MJYSME7UHCzoVWZLa76kj1FVGExLyXVIw6mV9MYyP5uP+UzFV1NWLTWY0YSQ0WVhdDS23GnMWqbyCe9Gw0XDMtUALenYt/lhbfAqDy+sNtAXJZ+eYVoL2nTmRyjO2iHweFql3031UvFrkPEq05pwSd27HMkWqfb+xOrrV4uhq62aRPBTrpsoWGu15ZYM1oEG4NJZZnTuURxwui8yPwmZvWYHI/zdATkUpVw1Q60nZXNmZG5r05o7nod/k3qv5h7y2v1cNd5tKt2ine1Ng3au4ujdFNRU8VYexiVyVyolYVKgdZ3i/3WlekeqF/tqTjizvP20/e1pdn94zvjd+NB4ZHeNn45nxytgzeoZjUONX4zfj95U/Vv5c+Wvl7xK9e6ey+c5Y+q388x8O0MD1</latexit> <latexit sha1_base64="j/8YNKd3L0KJ6tDGu4+KKpWj58k=">AAAWGHicjZhNb9s2GMfV7q3z3toNOe2izSjQAUURBwW2Y5s0TZO6adLETpwoMCiZltjorRTl2BH0CXbdLvs0uw277rZvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaI1dV/79z96ONPPv3s3uetL7786utv7j/4tp9EKXdoz4n8iB/bJKE+C2lPMOHT45hTEtg+PbLPN5R+NKE8YVF4KGYxPQuIG7Ixc4iQVfvj4f326pPV4mfqhU5VaBvVb2/4YOWONYqcNKChcHySJKed1VicZYQL5vg0b1lpQmPinBOXnspiSAKanGVFpLn5UNaMzHHE5V8ozKK2bpGRIElmgS3JgAgvaWqqEmmnqRj/cpaxME4FDZ3S0Tj1TRGZqtvmiHHqCH8mC8ThTMZqOh7hxBHy5bRaVsyjCRtRJwoCEo4yS3rITztnmWVH/khFFPlZu5PnD1sWpyG9WIAT6pSgiskeF1DLahDEx621Wg/NjZJLZFGpZhrHlJuOHFM9KjqjeeEp21ZetKCfS5WGScqpiqYkn+cQXQfoOkY3ALqB0RcAfYHRTYBuYvQlQF9idAugWxh9BdBXGN0G6DZGdwC6g9HXAH2N0S5Auxh9A9A3GN0F6C5G3wL0LUb3ALqH0X2A7mP0HUDfYfQAoAcYPQToIUZ7AO1htA/QPkaPAHqE0WOAHmN0ANABRk8AenLNRyi3lREBvFUpeDSYG0CjUoA2l5RHwGRV0ToehTTJi3U2o6i5SdO9IrHniQ1QG6MOQB2MjgA6wigFKMXoGKBjjLoAdTHqAdTDKAMow+h7gL7H6DlAzzHqA9THaADQAKMhQEOMNr9ShUYYjQEaY/QDQD9glAOUYzQBaIJRAVCB0RSgKUYnAJ1g9AKgFxidAnSK0RlAZxi9BOjlNQMLpoFM+DIrLuaCzOsSmXHGYimzqyeIyfMyqfOkmUrXGup6TV3X1M2auqmp2zV1W1N3auqOpu7W1F1NPaipB5p6XFOPNXVQUwflK/KISH5Yxrwi8fTUViFLeVPcWohbmrjYqbz67tSADj0qFkz5oDnpLZz0dLG/EPu6eLQQjzTRXwrPx+GJengChldMk0KXJU2cLcSZLl4uxEtNHFTaQFNOKuVEU5LBor9XA1v/+P3oAn/8av46HivY4gDkckrPlyGb+LGnXoYEquOTVVaVLqKAmtWBz5kfp5YaYHF+uibPXz4dC/nCQ9enZrvz2HrcXrM4cz1h8aKy0a3NaVw73NlyghUtnLY7pdVZg9+IJqWfSM50IiKuTr+Zqp3b1VzqxpxDa1l9C/M+4WWsS9aq9uaY93hkl26rTu7NDa5xZF+djanLwkw9czbNpQMq9fljw2o0mpZexvLQLddGdV9AfDkI+dXDdJi11/KmJeEyT5yWHtNwJM/rVGSF3VJPKwxZs/BW1izUrGUd+19bBQVpoBuT6S2MJYSME7UHCzoVWZLa76kj1FVGExLyXVIw6mV9MYyP5uP+UzFV1NWLTWY0YSQ0WVhdDS23GnMWqbyCe9Gw0XDMtUALenYt/lhbfAqDy+sNtAXJZ+eYVoL2nTmRyjO2iHweFql3031UvFrkPEq05pwSd27HMkWqfb+xOrrV4uhq62aRPBTrpsoWGu15ZYM1oEG4NJZZnTuURxwui8yPwmZvWYHI/zdATkUpVw1Q60nZXNmZG5r05o7nod/k3qv5h7y2v1cNd5tKt2ine1Ng3au4ujdFNRU8VYexiVyVyolYVKgdZ3i/3WlekeqF/tqTjizvP20/e1pdn94zvjd+NB4ZHeNn45nxytgzeoZjUONX4zfj95U/Vv5c+Wvl7xK9e6ey+c5Y+q388x8O0MD1</latexit> <latexit sha1_base64="j/8YNKd3L0KJ6tDGu4+KKpWj58k=">AAAWGHicjZhNb9s2GMfV7q3z3toNOe2izSjQAUURBwW2Y5s0TZO6adLETpwoMCiZltjorRTl2BH0CXbdLvs0uw277rZvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaI1dV/79z96ONPPv3s3uetL7786utv7j/4tp9EKXdoz4n8iB/bJKE+C2lPMOHT45hTEtg+PbLPN5R+NKE8YVF4KGYxPQuIG7Ixc4iQVfvj4f326pPV4mfqhU5VaBvVb2/4YOWONYqcNKChcHySJKed1VicZYQL5vg0b1lpQmPinBOXnspiSAKanGVFpLn5UNaMzHHE5V8ozKK2bpGRIElmgS3JgAgvaWqqEmmnqRj/cpaxME4FDZ3S0Tj1TRGZqtvmiHHqCH8mC8ThTMZqOh7hxBHy5bRaVsyjCRtRJwoCEo4yS3rITztnmWVH/khFFPlZu5PnD1sWpyG9WIAT6pSgiskeF1DLahDEx621Wg/NjZJLZFGpZhrHlJuOHFM9KjqjeeEp21ZetKCfS5WGScqpiqYkn+cQXQfoOkY3ALqB0RcAfYHRTYBuYvQlQF9idAugWxh9BdBXGN0G6DZGdwC6g9HXAH2N0S5Auxh9A9A3GN0F6C5G3wL0LUb3ALqH0X2A7mP0HUDfYfQAoAcYPQToIUZ7AO1htA/QPkaPAHqE0WOAHmN0ANABRk8AenLNRyi3lREBvFUpeDSYG0CjUoA2l5RHwGRV0ToehTTJi3U2o6i5SdO9IrHniQ1QG6MOQB2MjgA6wigFKMXoGKBjjLoAdTHqAdTDKAMow+h7gL7H6DlAzzHqA9THaADQAKMhQEOMNr9ShUYYjQEaY/QDQD9glAOUYzQBaIJRAVCB0RSgKUYnAJ1g9AKgFxidAnSK0RlAZxi9BOjlNQMLpoFM+DIrLuaCzOsSmXHGYimzqyeIyfMyqfOkmUrXGup6TV3X1M2auqmp2zV1W1N3auqOpu7W1F1NPaipB5p6XFOPNXVQUwflK/KISH5Yxrwi8fTUViFLeVPcWohbmrjYqbz67tSADj0qFkz5oDnpLZz0dLG/EPu6eLQQjzTRXwrPx+GJengChldMk0KXJU2cLcSZLl4uxEtNHFTaQFNOKuVEU5LBor9XA1v/+P3oAn/8av46HivY4gDkckrPlyGb+LGnXoYEquOTVVaVLqKAmtWBz5kfp5YaYHF+uibPXz4dC/nCQ9enZrvz2HrcXrM4cz1h8aKy0a3NaVw73NlyghUtnLY7pdVZg9+IJqWfSM50IiKuTr+Zqp3b1VzqxpxDa1l9C/M+4WWsS9aq9uaY93hkl26rTu7NDa5xZF+djanLwkw9czbNpQMq9fljw2o0mpZexvLQLddGdV9AfDkI+dXDdJi11/KmJeEyT5yWHtNwJM/rVGSF3VJPKwxZs/BW1izUrGUd+19bBQVpoBuT6S2MJYSME7UHCzoVWZLa76kj1FVGExLyXVIw6mV9MYyP5uP+UzFV1NWLTWY0YSQ0WVhdDS23GnMWqbyCe9Gw0XDMtUALenYt/lhbfAqDy+sNtAXJZ+eYVoL2nTmRyjO2iHweFql3031UvFrkPEq05pwSd27HMkWqfb+xOrrV4uhq62aRPBTrpsoWGu15ZYM1oEG4NJZZnTuURxwui8yPwmZvWYHI/zdATkUpVw1Q60nZXNmZG5r05o7nod/k3qv5h7y2v1cNd5tKt2ine1Ng3au4ujdFNRU8VYexiVyVyolYVKgdZ3i/3WlekeqF/tqTjizvP20/e1pdn94zvjd+NB4ZHeNn45nxytgzeoZjUONX4zfj95U/Vv5c+Wvl7xK9e6ey+c5Y+q388x8O0MD1</latexit> L <latexit sha1_base64="MaioS+8Javv7fFuSH4wxGzJbSBs=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwW2Y5s0TZO6adrETpwoMCiZltjorRTl2BH0EXbdLvs0uw277rJvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaItbV/79z96ONPPv3s3uetL7786utvVu5/20+ilDu050R+xI9tklCfhbQnmPDpccwpCWyfHtnnm0o/mlCesCg8FLOYngXEDdmYOUTIqgMr6A5X2muP14qfqRc6VaFtVL/94f3VO9YoctKAhsLxSZKcdtZicZYRLpjj07xlpQmNiXNOXHoqiyEJaHKWFbHm5gNZMzLHEZd/oTCL2rpFRoIkmQW2JAMivKSpqUqknaZi/MtZxsI4FTR0Skfj1DdFZKqOmyPGqSP8mSwQhzMZq+l4hBNHyNfTalkxjyZsRJ0oCEg4yizpIT/tnGWWHfkjFVHkZ+1Onj9oWZyG9GIBTqhTgiome1xALatBEB+31mo9MDdLLpFFpZppHFNuOnJU9ajojOaFp2xHedGCfiZVGiYppyqaknyWQ3QDoBsY3QToJkafA/Q5RrcAuoXRFwB9gdFtgG5j9CVAX2J0B6A7GN0F6C5GXwH0FUa7AO1i9DVAX2N0D6B7GH0D0DcY3QfoPkbfAvQtRt8B9B1GDwB6gNFDgB5itAfQHkb7AO1j9AigRxg9BugxRgcAHWD0BKAn13yEcmMZEcBblYJHg7kBNCoFaHNJeQRM1hSt41FIk7xYZzOKmps03SsSe57YALUx6gDUwegIoCOMUoBSjI4BOsaoC1AXox5APYwygDKMvgfoe4yeA/Qcoz5AfYwGAA0wGgI0xGjzK1VohNEYoDFGPwD0A0Y5QDlGE4AmGBUAFRhNAZpidALQCUYvAHqB0SlApxidAXSG0UuAXl4zsGAayIQvs+JiLsi8LpEZZyyWMrt6gpg8K5M6T5qpdK2hbtTUDU3dqqlbmrpTU3c0dbem7mrqXk3d09SDmnqgqcc19VhTBzV1UL4ij4jkh2XMKxJPT20VspQ3xe2FuK2Ji53Kq+9ODejQo2LBlA+ak97CSU8X+wuxr4tHC/FIE/2l8HwcnqiHJ2B4xTQpdFnSxNlCnOni5UK81MRBpQ005aRSTjQlGSz6ezWw9Y/fjy7wx6/mr+Oxgi0OQC6n9HwZsokfe+plSKA6PlllVekiCqhZHfic+XFqqQEW56fr8vzl07GQLzx0fWq2O4+sR+11izPXExYvKhvd2prGtcOdLSdY0cJpu1NanTX4zWhS+onkTCci4ur0m6nauV3NpW7MObSW1bcw7xNexrpkrWpvjnmfR3bpturk/tzgGkf21dmYuizM1DNn01w6oFKfPzasRqNp6WUsD91ybVT3BcSXg5BfPUyHWXs9b1oSLvPEaekxDUfyvE5FVtgt9bTCkDULb2XNQs1a1rH/tVVQkAa6MZnewlhCyDhRe7CgU5Elqf2eOkJdZTQhId8lBaNe1hfD+HA+7j8VU0VdvdhkRhNGQpOF1eXQcqsxZ5HKK7gXDRsNx1wLtKBn1+KPtMWnMLi83kBbkHx2jmklaN+ZE6k8Y5vI52GRejfdR8WrRc6jRGvOKXHndixTpNr3G6ujWy2OrrZuFslDsW6qbKHRnlc2WAMahEtjmdW5Q3nE4bLI/Chs9pYViPx/A+RUlHLVALWelM2VnbmhSW/ueB76Te69mn/Ia/t71XC3qXSLdro3Bda9iqt7U1RTwVN1GJvIVamciEWF2nGGK+1O84pUL/TXH3dk+e2T9tMn1fXpPeN740fjodExfjaeGi+NfaNnOIZr/Gr8Zvy++sfqn6t/rf5donfvVDbfGUu/1X/+A1kMwbg=</latexit> <latexit sha1_base64="MaioS+8Javv7fFuSH4wxGzJbSBs=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwW2Y5s0TZO6adrETpwoMCiZltjorRTl2BH0EXbdLvs0uw277rJvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaItbV/79z96ONPPv3s3uetL7786utvVu5/20+ilDu050R+xI9tklCfhbQnmPDpccwpCWyfHtnnm0o/mlCesCg8FLOYngXEDdmYOUTIqgMr6A5X2muP14qfqRc6VaFtVL/94f3VO9YoctKAhsLxSZKcdtZicZYRLpjj07xlpQmNiXNOXHoqiyEJaHKWFbHm5gNZMzLHEZd/oTCL2rpFRoIkmQW2JAMivKSpqUqknaZi/MtZxsI4FTR0Skfj1DdFZKqOmyPGqSP8mSwQhzMZq+l4hBNHyNfTalkxjyZsRJ0oCEg4yizpIT/tnGWWHfkjFVHkZ+1Onj9oWZyG9GIBTqhTgiome1xALatBEB+31mo9MDdLLpFFpZppHFNuOnJU9ajojOaFp2xHedGCfiZVGiYppyqaknyWQ3QDoBsY3QToJkafA/Q5RrcAuoXRFwB9gdFtgG5j9CVAX2J0B6A7GN0F6C5GXwH0FUa7AO1i9DVAX2N0D6B7GH0D0DcY3QfoPkbfAvQtRt8B9B1GDwB6gNFDgB5itAfQHkb7AO1j9AigRxg9BugxRgcAHWD0BKAn13yEcmMZEcBblYJHg7kBNCoFaHNJeQRM1hSt41FIk7xYZzOKmps03SsSe57YALUx6gDUwegIoCOMUoBSjI4BOsaoC1AXox5APYwygDKMvgfoe4yeA/Qcoz5AfYwGAA0wGgI0xGjzK1VohNEYoDFGPwD0A0Y5QDlGE4AmGBUAFRhNAZpidALQCUYvAHqB0SlApxidAXSG0UuAXl4zsGAayIQvs+JiLsi8LpEZZyyWMrt6gpg8K5M6T5qpdK2hbtTUDU3dqqlbmrpTU3c0dbem7mrqXk3d09SDmnqgqcc19VhTBzV1UL4ij4jkh2XMKxJPT20VspQ3xe2FuK2Ji53Kq+9ODejQo2LBlA+ak97CSU8X+wuxr4tHC/FIE/2l8HwcnqiHJ2B4xTQpdFnSxNlCnOni5UK81MRBpQ005aRSTjQlGSz6ezWw9Y/fjy7wx6/mr+Oxgi0OQC6n9HwZsokfe+plSKA6PlllVekiCqhZHfic+XFqqQEW56fr8vzl07GQLzx0fWq2O4+sR+11izPXExYvKhvd2prGtcOdLSdY0cJpu1NanTX4zWhS+onkTCci4ur0m6nauV3NpW7MObSW1bcw7xNexrpkrWpvjnmfR3bpturk/tzgGkf21dmYuizM1DNn01w6oFKfPzasRqNp6WUsD91ybVT3BcSXg5BfPUyHWXs9b1oSLvPEaekxDUfyvE5FVtgt9bTCkDULb2XNQs1a1rH/tVVQkAa6MZnewlhCyDhRe7CgU5Elqf2eOkJdZTQhId8lBaNe1hfD+HA+7j8VU0VdvdhkRhNGQpOF1eXQcqsxZ5HKK7gXDRsNx1wLtKBn1+KPtMWnMLi83kBbkHx2jmklaN+ZE6k8Y5vI52GRejfdR8WrRc6jRGvOKXHndixTpNr3G6ujWy2OrrZuFslDsW6qbKHRnlc2WAMahEtjmdW5Q3nE4bLI/Chs9pYViPx/A+RUlHLVALWelM2VnbmhSW/ueB76Te69mn/Ia/t71XC3qXSLdro3Bda9iqt7U1RTwVN1GJvIVamciEWF2nGGK+1O84pUL/TXH3dk+e2T9tMn1fXpPeN740fjodExfjaeGi+NfaNnOIZr/Gr8Zvy++sfqn6t/rf5donfvVDbfGUu/1X/+A1kMwbg=</latexit> <latexit sha1_base64="MaioS+8Javv7fFuSH4wxGzJbSBs=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwW2Y5s0TZO6adrETpwoMCiZltjorRTl2BH0EXbdLvs0uw277rJvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaItbV/79z96ONPPv3s3uetL7786utvVu5/20+ilDu050R+xI9tklCfhbQnmPDpccwpCWyfHtnnm0o/mlCesCg8FLOYngXEDdmYOUTIqgMr6A5X2muP14qfqRc6VaFtVL/94f3VO9YoctKAhsLxSZKcdtZicZYRLpjj07xlpQmNiXNOXHoqiyEJaHKWFbHm5gNZMzLHEZd/oTCL2rpFRoIkmQW2JAMivKSpqUqknaZi/MtZxsI4FTR0Skfj1DdFZKqOmyPGqSP8mSwQhzMZq+l4hBNHyNfTalkxjyZsRJ0oCEg4yizpIT/tnGWWHfkjFVHkZ+1Onj9oWZyG9GIBTqhTgiome1xALatBEB+31mo9MDdLLpFFpZppHFNuOnJU9ajojOaFp2xHedGCfiZVGiYppyqaknyWQ3QDoBsY3QToJkafA/Q5RrcAuoXRFwB9gdFtgG5j9CVAX2J0B6A7GN0F6C5GXwH0FUa7AO1i9DVAX2N0D6B7GH0D0DcY3QfoPkbfAvQtRt8B9B1GDwB6gNFDgB5itAfQHkb7AO1j9AigRxg9BugxRgcAHWD0BKAn13yEcmMZEcBblYJHg7kBNCoFaHNJeQRM1hSt41FIk7xYZzOKmps03SsSe57YALUx6gDUwegIoCOMUoBSjI4BOsaoC1AXox5APYwygDKMvgfoe4yeA/Qcoz5AfYwGAA0wGgI0xGjzK1VohNEYoDFGPwD0A0Y5QDlGE4AmGBUAFRhNAZpidALQCUYvAHqB0SlApxidAXSG0UuAXl4zsGAayIQvs+JiLsi8LpEZZyyWMrt6gpg8K5M6T5qpdK2hbtTUDU3dqqlbmrpTU3c0dbem7mrqXk3d09SDmnqgqcc19VhTBzV1UL4ij4jkh2XMKxJPT20VspQ3xe2FuK2Ji53Kq+9ODejQo2LBlA+ak97CSU8X+wuxr4tHC/FIE/2l8HwcnqiHJ2B4xTQpdFnSxNlCnOni5UK81MRBpQ005aRSTjQlGSz6ezWw9Y/fjy7wx6/mr+Oxgi0OQC6n9HwZsokfe+plSKA6PlllVekiCqhZHfic+XFqqQEW56fr8vzl07GQLzx0fWq2O4+sR+11izPXExYvKhvd2prGtcOdLSdY0cJpu1NanTX4zWhS+onkTCci4ur0m6nauV3NpW7MObSW1bcw7xNexrpkrWpvjnmfR3bpturk/tzgGkf21dmYuizM1DNn01w6oFKfPzasRqNp6WUsD91ybVT3BcSXg5BfPUyHWXs9b1oSLvPEaekxDUfyvE5FVtgt9bTCkDULb2XNQs1a1rH/tVVQkAa6MZnewlhCyDhRe7CgU5Elqf2eOkJdZTQhId8lBaNe1hfD+HA+7j8VU0VdvdhkRhNGQpOF1eXQcqsxZ5HKK7gXDRsNx1wLtKBn1+KPtMWnMLi83kBbkHx2jmklaN+ZE6k8Y5vI52GRejfdR8WrRc6jRGvOKXHndixTpNr3G6ujWy2OrrZuFslDsW6qbKHRnlc2WAMahEtjmdW5Q3nE4bLI/Chs9pYViPx/A+RUlHLVALWelM2VnbmhSW/ueB76Te69mn/Ia/t71XC3qXSLdro3Bda9iqt7U1RTwVN1GJvIVamciEWF2nGGK+1O84pUL/TXH3dk+e2T9tMn1fXpPeN740fjodExfjaeGi+NfaNnOIZr/Gr8Zvy++sfqn6t/rf5donfvVDbfGUu/1X/+A1kMwbg=</latexit> <latexit sha1_base64="MaioS+8Javv7fFuSH4wxGzJbSBs=">AAAWGnicjZhNb9s2GMfV7q3z3tINOe2izSjQAUURBwW2Y5s0TZO6adrETpwoMCiZltjorRTl2BH0EXbdLvs0uw277rJvM1KSHVn8J4uBIBT/v4fPQ1EkH9KOfZaItbV/79z96ONPPv3s3uetL7786utvVu5/20+ilDu050R+xI9tklCfhbQnmPDpccwpCWyfHtnnm0o/mlCesCg8FLOYngXEDdmYOUTIqgMr6A5X2muP14qfqRc6VaFtVL/94f3VO9YoctKAhsLxSZKcdtZicZYRLpjj07xlpQmNiXNOXHoqiyEJaHKWFbHm5gNZMzLHEZd/oTCL2rpFRoIkmQW2JAMivKSpqUqknaZi/MtZxsI4FTR0Skfj1DdFZKqOmyPGqSP8mSwQhzMZq+l4hBNHyNfTalkxjyZsRJ0oCEg4yizpIT/tnGWWHfkjFVHkZ+1Onj9oWZyG9GIBTqhTgiome1xALatBEB+31mo9MDdLLpFFpZppHFNuOnJU9ajojOaFp2xHedGCfiZVGiYppyqaknyWQ3QDoBsY3QToJkafA/Q5RrcAuoXRFwB9gdFtgG5j9CVAX2J0B6A7GN0F6C5GXwH0FUa7AO1i9DVAX2N0D6B7GH0D0DcY3QfoPkbfAvQtRt8B9B1GDwB6gNFDgB5itAfQHkb7AO1j9AigRxg9BugxRgcAHWD0BKAn13yEcmMZEcBblYJHg7kBNCoFaHNJeQRM1hSt41FIk7xYZzOKmps03SsSe57YALUx6gDUwegIoCOMUoBSjI4BOsaoC1AXox5APYwygDKMvgfoe4yeA/Qcoz5AfYwGAA0wGgI0xGjzK1VohNEYoDFGPwD0A0Y5QDlGE4AmGBUAFRhNAZpidALQCUYvAHqB0SlApxidAXSG0UuAXl4zsGAayIQvs+JiLsi8LpEZZyyWMrt6gpg8K5M6T5qpdK2hbtTUDU3dqqlbmrpTU3c0dbem7mrqXk3d09SDmnqgqcc19VhTBzV1UL4ij4jkh2XMKxJPT20VspQ3xe2FuK2Ji53Kq+9ODejQo2LBlA+ak97CSU8X+wuxr4tHC/FIE/2l8HwcnqiHJ2B4xTQpdFnSxNlCnOni5UK81MRBpQ005aRSTjQlGSz6ezWw9Y/fjy7wx6/mr+Oxgi0OQC6n9HwZsokfe+plSKA6PlllVekiCqhZHfic+XFqqQEW56fr8vzl07GQLzx0fWq2O4+sR+11izPXExYvKhvd2prGtcOdLSdY0cJpu1NanTX4zWhS+onkTCci4ur0m6nauV3NpW7MObSW1bcw7xNexrpkrWpvjnmfR3bpturk/tzgGkf21dmYuizM1DNn01w6oFKfPzasRqNp6WUsD91ybVT3BcSXg5BfPUyHWXs9b1oSLvPEaekxDUfyvE5FVtgt9bTCkDULb2XNQs1a1rH/tVVQkAa6MZnewlhCyDhRe7CgU5Elqf2eOkJdZTQhId8lBaNe1hfD+HA+7j8VU0VdvdhkRhNGQpOF1eXQcqsxZ5HKK7gXDRsNx1wLtKBn1+KPtMWnMLi83kBbkHx2jmklaN+ZE6k8Y5vI52GRejfdR8WrRc6jRGvOKXHndixTpNr3G6ujWy2OrrZuFslDsW6qbKHRnlc2WAMahEtjmdW5Q3nE4bLI/Chs9pYViPx/A+RUlHLVALWelM2VnbmhSW/ueB76Te69mn/Ia/t71XC3qXSLdro3Bda9iqt7U1RTwVN1GJvIVamciEWF2nGGK+1O84pUL/TXH3dk+e2T9tMn1fXpPeN740fjodExfjaeGi+NfaNnOIZr/Gr8Zvy++sfqn6t/rf5donfvVDbfGUu/1X/+A1kMwbg=</latexit> Algorithm: xj ⇠ ⇢( x ) fj = f( xj) (2) Solve minimize M trace ( M ) subject to ( fi fj) 2 (xi xj) T M (xi xj) <latexit sha1_base64="RNnf99FVV03GSmJNPOi2WPshTSU=">AAAWtXicjZhrb9s2FIbt7tZ5t3TD8mVftBkdUiAr7GBA97FJmqZJ3TRtYidO5BmUTFtMdCtFO7YF/ZP9sf2bkZLsyOKbLAbaUHyfw3NIihR5rNBlkWg0/q0++uzzL7786vHXtW++/e77H9ae/NiJgjG3adsO3ICfWySiLvNpWzDh0vOQU+JZLj2zrneVfjahPGKBfypmIe15ZOSzIbOJkFX9tX9Mi46YHxPOySyJXTepmWN/IC2oiE3vXRKbgk5F7DGfeWxOk8T43ahldYITmybm5obknhmmmVdHY+uK2sIQgWI3hn32x7B/9ezvLcN06Sdjw5xMZZX6X1aeStuVmppJ/UEeTn+t3njeSH+GXmjmhXol/x33n/xcNQeBPfaoL2yXRNFlsxGKnmxOMNulqm8RDYl9TUb0UhZ94tGoF6fDmBhPZc3AGAZc/vOFkdYWLWLiRdHMsyTpEeFEZU1VIu1yLIZ/9WLmh2NBfTtzNBy7coQMNSfGgHE5YO5MFojNmYzVsB0iR1fIeajVzJAHEzagduB5RA6OKT0kl81ebFqBO1ARBW5cbybJ05rJqU9vluCE2hmoYrKGKVQzSwRxcWu12lNjN+MiWVSqMQ5Dyg1bvnB6VHRGk9RTfKC8aEFvS5X60ZhTFU1GbicQ3QHoDkZ3AbqL0VcAfYXRPYDuYfQ1QF9jdB+g+xh9A9A3GD0A6AFGDwF6iNG3AH2L0RZAWxh9B9B3GD0C6BFG3wP0PUaPAXqM0Q8A/YDRjwD9iNETgJ5g9BSgpxhtA7SN0Q5AOxg9A+gZRs8Beo7RLkC7GL0A6MUdL6H85g0I4M1cwbPBRh40ygRoM6c8ACYNRet44NMoSffZmKLmJmX3isSeJxZALYzaALUxOgDoAKMUoBSjQ4AOMToC6AijDkAdjDKAMoxeAfQKo9cAvcaoC1AXox5APYz6APUxWn5LFRpgNARoiNFPAP2EUQ5QjtEIoBFGBUAFRscAHWN0AtAJRm8AeoPRKUCnGJ0BdIbROUDnd0wsWAbywBebYboW5LkukifOUKyc7IoHxGg7O9Q50kwd10rqTkHd0dS9grqnqQcF9UBTDwvqoaYeFdQjTT0pqCeael5QzzW1W1C72RA5RES/rmJOevB01KdClpKyuL8U9zVx+aVyil+nEnTqULFksgfNSXvppK2LnaXY0cWzpXimie5KeC4OTxTDEzC8dJmkuixp4mwpznRxvhTnmtjNta6mXOTKhaZE3WV/bye2+PK7wQ1++dX6tR2WsukFaMQpvV6FLOKGjhoMCeTXJzOrylwEHjXyC5+9uE6tNMDC5HJL3r9cOhRywP2RS416c9PcrG+ZnI0cYfK0stStvWlYuNxZcoGlLVzWm5lVr8TvBpPMTyBXOhEBV7ffWNUu7AoudWPOobWsfoB5h/As1hVrVXt/zMc8sDK3eSePFwZ3OLJu78ZpXkM9czZNpAOVV1g8lqwGg2nmZSgv3XJvVPkC4spJSG4fpv24vpWULQmX58Rp5nGZN0ntVnqaY8ia+Q+yZr5mrXIy/2ubJm7Gnm5Mpg8wlhAyjsQiL3Sb7DHKUJYe0mc9TxupadxYzPuzdKmo1ItFZjRixDeYn+etVlsNOQvUuYI7Qb/UcMi1QFN6die+qW0+qcH8bgNtQ3LZNaaVoL1ndqDOGftEPvfTo3fZfZAOLXIeRFpzdobbD2OZItV3v7Q7jvLNcaTtm+nhId031Wmh1J6TNVgASsSIhvJUN+rLKw6XReYGfrm3LEXk33sgO6eUqxKo9SRrLuvMPU06C8eL0O9z7xT8Q177vucNt8pKK22ndV9grdu4WvdFNRV8rC5jE7krLZKx4/QmVuuv1ZvlFKle6Gw9b8ryh0b95Z95+vRx5ZfKb5WNSrPyovKy8qZyXGlX7Oqj6ka1Wd1af7HeWx+sDzP0UTW3+amy8lsP/gMhlfdS</latexit> <latexit sha1_base64="RNnf99FVV03GSmJNPOi2WPshTSU=">AAAWtXicjZhrb9s2FIbt7tZ5t3TD8mVftBkdUiAr7GBA97FJmqZJ3TRtYidO5BmUTFtMdCtFO7YF/ZP9sf2bkZLsyOKbLAbaUHyfw3NIihR5rNBlkWg0/q0++uzzL7786vHXtW++/e77H9ae/NiJgjG3adsO3ICfWySiLvNpWzDh0vOQU+JZLj2zrneVfjahPGKBfypmIe15ZOSzIbOJkFX9tX9Mi46YHxPOySyJXTepmWN/IC2oiE3vXRKbgk5F7DGfeWxOk8T43ahldYITmybm5obknhmmmVdHY+uK2sIQgWI3hn32x7B/9ezvLcN06Sdjw5xMZZX6X1aeStuVmppJ/UEeTn+t3njeSH+GXmjmhXol/x33n/xcNQeBPfaoL2yXRNFlsxGKnmxOMNulqm8RDYl9TUb0UhZ94tGoF6fDmBhPZc3AGAZc/vOFkdYWLWLiRdHMsyTpEeFEZU1VIu1yLIZ/9WLmh2NBfTtzNBy7coQMNSfGgHE5YO5MFojNmYzVsB0iR1fIeajVzJAHEzagduB5RA6OKT0kl81ebFqBO1ARBW5cbybJ05rJqU9vluCE2hmoYrKGKVQzSwRxcWu12lNjN+MiWVSqMQ5Dyg1bvnB6VHRGk9RTfKC8aEFvS5X60ZhTFU1GbicQ3QHoDkZ3AbqL0VcAfYXRPYDuYfQ1QF9jdB+g+xh9A9A3GD0A6AFGDwF6iNG3AH2L0RZAWxh9B9B3GD0C6BFG3wP0PUaPAXqM0Q8A/YDRjwD9iNETgJ5g9BSgpxhtA7SN0Q5AOxg9A+gZRs8Beo7RLkC7GL0A6MUdL6H85g0I4M1cwbPBRh40ygRoM6c8ACYNRet44NMoSffZmKLmJmX3isSeJxZALYzaALUxOgDoAKMUoBSjQ4AOMToC6AijDkAdjDKAMoxeAfQKo9cAvcaoC1AXox5APYz6APUxWn5LFRpgNARoiNFPAP2EUQ5QjtEIoBFGBUAFRscAHWN0AtAJRm8AeoPRKUCnGJ0BdIbROUDnd0wsWAbywBebYboW5LkukifOUKyc7IoHxGg7O9Q50kwd10rqTkHd0dS9grqnqQcF9UBTDwvqoaYeFdQjTT0pqCeael5QzzW1W1C72RA5RES/rmJOevB01KdClpKyuL8U9zVx+aVyil+nEnTqULFksgfNSXvppK2LnaXY0cWzpXimie5KeC4OTxTDEzC8dJmkuixp4mwpznRxvhTnmtjNta6mXOTKhaZE3WV/bye2+PK7wQ1++dX6tR2WsukFaMQpvV6FLOKGjhoMCeTXJzOrylwEHjXyC5+9uE6tNMDC5HJL3r9cOhRywP2RS416c9PcrG+ZnI0cYfK0stStvWlYuNxZcoGlLVzWm5lVr8TvBpPMTyBXOhEBV7ffWNUu7AoudWPOobWsfoB5h/As1hVrVXt/zMc8sDK3eSePFwZ3OLJu78ZpXkM9czZNpAOVV1g8lqwGg2nmZSgv3XJvVPkC4spJSG4fpv24vpWULQmX58Rp5nGZN0ntVnqaY8ia+Q+yZr5mrXIy/2ubJm7Gnm5Mpg8wlhAyjsQiL3Sb7DHKUJYe0mc9TxupadxYzPuzdKmo1ItFZjRixDeYn+etVlsNOQvUuYI7Qb/UcMi1QFN6die+qW0+qcH8bgNtQ3LZNaaVoL1ndqDOGftEPvfTo3fZfZAOLXIeRFpzdobbD2OZItV3v7Q7jvLNcaTtm+nhId031Wmh1J6TNVgASsSIhvJUN+rLKw6XReYGfrm3LEXk33sgO6eUqxKo9SRrLuvMPU06C8eL0O9z7xT8Q177vucNt8pKK22ndV9grdu4WvdFNRV8rC5jE7krLZKx4/QmVuuv1ZvlFKle6Gw9b8ryh0b95Z95+vRx5ZfKb5WNSrPyovKy8qZyXGlX7Oqj6ka1Wd1af7HeWx+sDzP0UTW3+amy8lsP/gMhlfdS</latexit> <latexit sha1_base64="RNnf99FVV03GSmJNPOi2WPshTSU=">AAAWtXicjZhrb9s2FIbt7tZ5t3TD8mVftBkdUiAr7GBA97FJmqZJ3TRtYidO5BmUTFtMdCtFO7YF/ZP9sf2bkZLsyOKbLAbaUHyfw3NIihR5rNBlkWg0/q0++uzzL7786vHXtW++/e77H9ae/NiJgjG3adsO3ICfWySiLvNpWzDh0vOQU+JZLj2zrneVfjahPGKBfypmIe15ZOSzIbOJkFX9tX9Mi46YHxPOySyJXTepmWN/IC2oiE3vXRKbgk5F7DGfeWxOk8T43ahldYITmybm5obknhmmmVdHY+uK2sIQgWI3hn32x7B/9ezvLcN06Sdjw5xMZZX6X1aeStuVmppJ/UEeTn+t3njeSH+GXmjmhXol/x33n/xcNQeBPfaoL2yXRNFlsxGKnmxOMNulqm8RDYl9TUb0UhZ94tGoF6fDmBhPZc3AGAZc/vOFkdYWLWLiRdHMsyTpEeFEZU1VIu1yLIZ/9WLmh2NBfTtzNBy7coQMNSfGgHE5YO5MFojNmYzVsB0iR1fIeajVzJAHEzagduB5RA6OKT0kl81ebFqBO1ARBW5cbybJ05rJqU9vluCE2hmoYrKGKVQzSwRxcWu12lNjN+MiWVSqMQ5Dyg1bvnB6VHRGk9RTfKC8aEFvS5X60ZhTFU1GbicQ3QHoDkZ3AbqL0VcAfYXRPYDuYfQ1QF9jdB+g+xh9A9A3GD0A6AFGDwF6iNG3AH2L0RZAWxh9B9B3GD0C6BFG3wP0PUaPAXqM0Q8A/YDRjwD9iNETgJ5g9BSgpxhtA7SN0Q5AOxg9A+gZRs8Beo7RLkC7GL0A6MUdL6H85g0I4M1cwbPBRh40ygRoM6c8ACYNRet44NMoSffZmKLmJmX3isSeJxZALYzaALUxOgDoAKMUoBSjQ4AOMToC6AijDkAdjDKAMoxeAfQKo9cAvcaoC1AXox5APYz6APUxWn5LFRpgNARoiNFPAP2EUQ5QjtEIoBFGBUAFRscAHWN0AtAJRm8AeoPRKUCnGJ0BdIbROUDnd0wsWAbywBebYboW5LkukifOUKyc7IoHxGg7O9Q50kwd10rqTkHd0dS9grqnqQcF9UBTDwvqoaYeFdQjTT0pqCeael5QzzW1W1C72RA5RES/rmJOevB01KdClpKyuL8U9zVx+aVyil+nEnTqULFksgfNSXvppK2LnaXY0cWzpXimie5KeC4OTxTDEzC8dJmkuixp4mwpznRxvhTnmtjNta6mXOTKhaZE3WV/bye2+PK7wQ1++dX6tR2WsukFaMQpvV6FLOKGjhoMCeTXJzOrylwEHjXyC5+9uE6tNMDC5HJL3r9cOhRywP2RS416c9PcrG+ZnI0cYfK0stStvWlYuNxZcoGlLVzWm5lVr8TvBpPMTyBXOhEBV7ffWNUu7AoudWPOobWsfoB5h/As1hVrVXt/zMc8sDK3eSePFwZ3OLJu78ZpXkM9czZNpAOVV1g8lqwGg2nmZSgv3XJvVPkC4spJSG4fpv24vpWULQmX58Rp5nGZN0ntVnqaY8ia+Q+yZr5mrXIy/2ubJm7Gnm5Mpg8wlhAyjsQiL3Sb7DHKUJYe0mc9TxupadxYzPuzdKmo1ItFZjRixDeYn+etVlsNOQvUuYI7Qb/UcMi1QFN6die+qW0+qcH8bgNtQ3LZNaaVoL1ndqDOGftEPvfTo3fZfZAOLXIeRFpzdobbD2OZItV3v7Q7jvLNcaTtm+nhId031Wmh1J6TNVgASsSIhvJUN+rLKw6XReYGfrm3LEXk33sgO6eUqxKo9SRrLuvMPU06C8eL0O9z7xT8Q177vucNt8pKK22ndV9grdu4WvdFNRV8rC5jE7krLZKx4/QmVuuv1ZvlFKle6Gw9b8ryh0b95Z95+vRx5ZfKb5WNSrPyovKy8qZyXGlX7Oqj6ka1Wd1af7HeWx+sDzP0UTW3+amy8lsP/gMhlfdS</latexit> <latexit sha1_base64="RNnf99FVV03GSmJNPOi2WPshTSU=">AAAWtXicjZhrb9s2FIbt7tZ5t3TD8mVftBkdUiAr7GBA97FJmqZJ3TRtYidO5BmUTFtMdCtFO7YF/ZP9sf2bkZLsyOKbLAbaUHyfw3NIihR5rNBlkWg0/q0++uzzL7786vHXtW++/e77H9ae/NiJgjG3adsO3ICfWySiLvNpWzDh0vOQU+JZLj2zrneVfjahPGKBfypmIe15ZOSzIbOJkFX9tX9Mi46YHxPOySyJXTepmWN/IC2oiE3vXRKbgk5F7DGfeWxOk8T43ahldYITmybm5obknhmmmVdHY+uK2sIQgWI3hn32x7B/9ezvLcN06Sdjw5xMZZX6X1aeStuVmppJ/UEeTn+t3njeSH+GXmjmhXol/x33n/xcNQeBPfaoL2yXRNFlsxGKnmxOMNulqm8RDYl9TUb0UhZ94tGoF6fDmBhPZc3AGAZc/vOFkdYWLWLiRdHMsyTpEeFEZU1VIu1yLIZ/9WLmh2NBfTtzNBy7coQMNSfGgHE5YO5MFojNmYzVsB0iR1fIeajVzJAHEzagduB5RA6OKT0kl81ebFqBO1ARBW5cbybJ05rJqU9vluCE2hmoYrKGKVQzSwRxcWu12lNjN+MiWVSqMQ5Dyg1bvnB6VHRGk9RTfKC8aEFvS5X60ZhTFU1GbicQ3QHoDkZ3AbqL0VcAfYXRPYDuYfQ1QF9jdB+g+xh9A9A3GD0A6AFGDwF6iNG3AH2L0RZAWxh9B9B3GD0C6BFG3wP0PUaPAXqM0Q8A/YDRjwD9iNETgJ5g9BSgpxhtA7SN0Q5AOxg9A+gZRs8Beo7RLkC7GL0A6MUdL6H85g0I4M1cwbPBRh40ygRoM6c8ACYNRet44NMoSffZmKLmJmX3isSeJxZALYzaALUxOgDoAKMUoBSjQ4AOMToC6AijDkAdjDKAMoxeAfQKo9cAvcaoC1AXox5APYz6APUxWn5LFRpgNARoiNFPAP2EUQ5QjtEIoBFGBUAFRscAHWN0AtAJRm8AeoPRKUCnGJ0BdIbROUDnd0wsWAbywBebYboW5LkukifOUKyc7IoHxGg7O9Q50kwd10rqTkHd0dS9grqnqQcF9UBTDwvqoaYeFdQjTT0pqCeael5QzzW1W1C72RA5RES/rmJOevB01KdClpKyuL8U9zVx+aVyil+nEnTqULFksgfNSXvppK2LnaXY0cWzpXimie5KeC4OTxTDEzC8dJmkuixp4mwpznRxvhTnmtjNta6mXOTKhaZE3WV/bye2+PK7wQ1++dX6tR2WsukFaMQpvV6FLOKGjhoMCeTXJzOrylwEHjXyC5+9uE6tNMDC5HJL3r9cOhRywP2RS416c9PcrG+ZnI0cYfK0stStvWlYuNxZcoGlLVzWm5lVr8TvBpPMTyBXOhEBV7ffWNUu7AoudWPOobWsfoB5h/As1hVrVXt/zMc8sDK3eSePFwZ3OLJu78ZpXkM9czZNpAOVV1g8lqwGg2nmZSgv3XJvVPkC4spJSG4fpv24vpWULQmX58Rp5nGZN0ntVnqaY8ia+Q+yZr5mrXIy/2ubJm7Gnm5Mpg8wlhAyjsQiL3Sb7DHKUJYe0mc9TxupadxYzPuzdKmo1ItFZjRixDeYn+etVlsNOQvUuYI7Qb/UcMi1QFN6die+qW0+qcH8bgNtQ3LZNaaVoL1ndqDOGftEPvfTo3fZfZAOLXIeRFpzdobbD2OZItV3v7Q7jvLNcaTtm+nhId031Wmh1J6TNVgASsSIhvJUN+rLKw6XReYGfrm3LEXk33sgO6eUqxKo9SRrLuvMPU06C8eL0O9z7xT8Q177vucNt8pKK22ndV9grdu4WvdFNRV8rC5jE7krLZKx4/QmVuuv1ZvlFKle6Gw9b8ryh0b95Z95+vRx5ZfKb5WNSrPyovKy8qZyXGlX7Oqj6ka1Wd1af7HeWx+sDzP0UTW3+amy8lsP/gMhlfdS</latexit> (3) Square root factorization M = L LT <latexit sha1_base64="QWvsrxAQ4xUvcB2cTuonVjy46mw=">AAAWKXicjZhdb9s2FIbV7qvzPppuyNVutBkFOiAo7GDAdjOgTZqmSd00bWInTpQZlExLbPRVinLsCP4nu91u9mt2t+12f2SkJDuy+CaLgTYU3+fwHJIieSg79lkiWq2/79z94MOPPv7k3qeNzz7/4sv7Kw++6iVRyh3adSI/4sc2SajPQtoVTPj0OOaUBLZPj+zzTaUfjSlPWBQeimlMzwLihmzEHCJk1WBlxQpemT+bVtCx1uR/vxwOVpqtx638Z+qFdlloGuVvf/Bg9Y41jJw0oKFwfJIkp+1WLM4ywgVzfDprWGlCY+KcE5eeymJIApqcZXnoM/OhrBmao4jLf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvTTWcbCOBU0dApHo9Q3RWSqcTCHjFNH+FNZIA5nMlbT8QgnjpCj1WhYMY/GbEidKAhIOMws6WF22j7LLDvyhyqiyM+a7dnsYcPiNKQXC3BMnQJUMdmjHGpYNYL4uLVG46G5WXCJLCrVTOOYctORk6xHRad0lnvKdpQXLeinUqVhknKqoinIpzOIbgB0A6ObAN3E6DOAPsPoFkC3MPocoM8xug3QbYy+AOgLjO4AdAejuwDdxehLgL7EaAegHYy+AugrjO4BdA+jrwH6GqP7AN3H6BuAvsHoW4C+xegBQA8wegjQQ4x2AdrFaA+gPYweAfQIo8cAPcZoH6B9jJ4A9OSal1CeM0MCeKtU8GwwN4BGhQBtLimPgElL0ToehTSZ5ftsRlFz47p7RWLPYxugNkYdgDoYHQJ0iFEKUIrREUBHGHUB6mLUA6iHUQZQhtF3AH2H0XOAnmPUB6iP0QCgAUZDgIYYrb+lCo0wGgM0xuh7gL7HKAcox2gC0ASjAqACoylAU4yOATrG6AVALzA6AegEo1OATjF6CdDLayYWLAOZ8GVWnK8FmdclMuOMxVJmV00Qk6dFUudJM5Wu1dSNirqhqVsVdUtTdyrqjqbuVtRdTd2rqHuaelBRDzT1uKIea2q/ovaLIfKISL5dxrw88fTUUSFLs7q4vRC3NXFxUnnV06kGHXpULJjiQXPSXTjp6mJvIfZ08WghHmmivxSej8MT1fAEDC9fJrkuS5o4XYhTXbxciJea2C+1vqaclMqJpiT9RX+vJrb68vvRBX751fp1PJaz+QXI5ZSeL0M28WNPDYYEyuuTVVQVLqKAmuWFz5lfp5YaYPHsdF3ev3w6EnLAQ9enZrO9Zq011y3OXE9YPK+sdWtrElcud7ZcYHkLp812YXVW4zejceEnkiudiIir22+maud2FZe6MefQWlbfwrxHeBHrkrWqvTnmfR7Zhduyk/tzg2sc2Vd3Y+qyMFPPnE1m0gGV+vyxZjUcTgovI3nplnuj+l5AfDkJs6uHySBrrs/qloTLPHFSeEzDobyvU5Hldks9LTFkzcJbWbNQs5Z17H9tFRSkgW5MJrcwlhAyTtQZLOhEZElqv6OOUJ8y6pCQY0nBrBf1+TQ+ms/79/lSUZ9ebDKlCSOhycLyW9FyqzFnkcoruBcNag3HXAs0p6fX4mva5pMbXF5voG1IPjvHtBK098yJVJ6xTeTzIE+96+6jfGiR8yjRmnMK3LkdyxSpzv3a7uiWm6Or7Zt58pDvmypbqLXnFQ1WgBrh0lhmde5AXnG4LDI/Cuu9ZTki/94AOSWlXNVArSdFc0VnbmjSmzueh36Te6/iH/La+V423Kkrnbydzk2Bda7i6twU1UTwVF3GxnJXKhZiXqFOnMFKs13/RKoXeuuP27L8ptV88kP5+fSe8Y3xnfHIaBs/Gk+MF8a+0TUcY2z8avxm/L76x+qfq3+t/lOgd++UNl8bS7/Vf/8DlVjGSQ==</latexit> <latexit sha1_base64="QWvsrxAQ4xUvcB2cTuonVjy46mw=">AAAWKXicjZhdb9s2FIbV7qvzPppuyNVutBkFOiAo7GDAdjOgTZqmSd00bWInTpQZlExLbPRVinLsCP4nu91u9mt2t+12f2SkJDuy+CaLgTYU3+fwHJIieSg79lkiWq2/79z94MOPPv7k3qeNzz7/4sv7Kw++6iVRyh3adSI/4sc2SajPQtoVTPj0OOaUBLZPj+zzTaUfjSlPWBQeimlMzwLihmzEHCJk1WBlxQpemT+bVtCx1uR/vxwOVpqtx638Z+qFdlloGuVvf/Bg9Y41jJw0oKFwfJIkp+1WLM4ywgVzfDprWGlCY+KcE5eeymJIApqcZXnoM/OhrBmao4jLf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvTTWcbCOBU0dApHo9Q3RWSqcTCHjFNH+FNZIA5nMlbT8QgnjpCj1WhYMY/GbEidKAhIOMws6WF22j7LLDvyhyqiyM+a7dnsYcPiNKQXC3BMnQJUMdmjHGpYNYL4uLVG46G5WXCJLCrVTOOYctORk6xHRad0lnvKdpQXLeinUqVhknKqoinIpzOIbgB0A6ObAN3E6DOAPsPoFkC3MPocoM8xug3QbYy+AOgLjO4AdAejuwDdxehLgL7EaAegHYy+AugrjO4BdA+jrwH6GqP7AN3H6BuAvsHoW4C+xegBQA8wegjQQ4x2AdrFaA+gPYweAfQIo8cAPcZoH6B9jJ4A9OSal1CeM0MCeKtU8GwwN4BGhQBtLimPgElL0ToehTSZ5ftsRlFz47p7RWLPYxugNkYdgDoYHQJ0iFEKUIrREUBHGHUB6mLUA6iHUQZQhtF3AH2H0XOAnmPUB6iP0QCgAUZDgIYYrb+lCo0wGgM0xuh7gL7HKAcox2gC0ASjAqACoylAU4yOATrG6AVALzA6AegEo1OATjF6CdDLayYWLAOZ8GVWnK8FmdclMuOMxVJmV00Qk6dFUudJM5Wu1dSNirqhqVsVdUtTdyrqjqbuVtRdTd2rqHuaelBRDzT1uKIea2q/ovaLIfKISL5dxrw88fTUUSFLs7q4vRC3NXFxUnnV06kGHXpULJjiQXPSXTjp6mJvIfZ08WghHmmivxSej8MT1fAEDC9fJrkuS5o4XYhTXbxciJea2C+1vqaclMqJpiT9RX+vJrb68vvRBX751fp1PJaz+QXI5ZSeL0M28WNPDYYEyuuTVVQVLqKAmuWFz5lfp5YaYPHsdF3ev3w6EnLAQ9enZrO9Zq011y3OXE9YPK+sdWtrElcud7ZcYHkLp812YXVW4zejceEnkiudiIir22+maud2FZe6MefQWlbfwrxHeBHrkrWqvTnmfR7Zhduyk/tzg2sc2Vd3Y+qyMFPPnE1m0gGV+vyxZjUcTgovI3nplnuj+l5AfDkJs6uHySBrrs/qloTLPHFSeEzDobyvU5Hldks9LTFkzcJbWbNQs5Z17H9tFRSkgW5MJrcwlhAyTtQZLOhEZElqv6OOUJ8y6pCQY0nBrBf1+TQ+ms/79/lSUZ9ebDKlCSOhycLyW9FyqzFnkcoruBcNag3HXAs0p6fX4mva5pMbXF5voG1IPjvHtBK098yJVJ6xTeTzIE+96+6jfGiR8yjRmnMK3LkdyxSpzv3a7uiWm6Or7Zt58pDvmypbqLXnFQ1WgBrh0lhmde5AXnG4LDI/Cuu9ZTki/94AOSWlXNVArSdFc0VnbmjSmzueh36Te6/iH/La+V423Kkrnbydzk2Bda7i6twU1UTwVF3GxnJXKhZiXqFOnMFKs13/RKoXeuuP27L8ptV88kP5+fSe8Y3xnfHIaBs/Gk+MF8a+0TUcY2z8avxm/L76x+qfq3+t/lOgd++UNl8bS7/Vf/8DlVjGSQ==</latexit> <latexit sha1_base64="QWvsrxAQ4xUvcB2cTuonVjy46mw=">AAAWKXicjZhdb9s2FIbV7qvzPppuyNVutBkFOiAo7GDAdjOgTZqmSd00bWInTpQZlExLbPRVinLsCP4nu91u9mt2t+12f2SkJDuy+CaLgTYU3+fwHJIieSg79lkiWq2/79z94MOPPv7k3qeNzz7/4sv7Kw++6iVRyh3adSI/4sc2SajPQtoVTPj0OOaUBLZPj+zzTaUfjSlPWBQeimlMzwLihmzEHCJk1WBlxQpemT+bVtCx1uR/vxwOVpqtx638Z+qFdlloGuVvf/Bg9Y41jJw0oKFwfJIkp+1WLM4ywgVzfDprWGlCY+KcE5eeymJIApqcZXnoM/OhrBmao4jLf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvTTWcbCOBU0dApHo9Q3RWSqcTCHjFNH+FNZIA5nMlbT8QgnjpCj1WhYMY/GbEidKAhIOMws6WF22j7LLDvyhyqiyM+a7dnsYcPiNKQXC3BMnQJUMdmjHGpYNYL4uLVG46G5WXCJLCrVTOOYctORk6xHRad0lnvKdpQXLeinUqVhknKqoinIpzOIbgB0A6ObAN3E6DOAPsPoFkC3MPocoM8xug3QbYy+AOgLjO4AdAejuwDdxehLgL7EaAegHYy+AugrjO4BdA+jrwH6GqP7AN3H6BuAvsHoW4C+xegBQA8wegjQQ4x2AdrFaA+gPYweAfQIo8cAPcZoH6B9jJ4A9OSal1CeM0MCeKtU8GwwN4BGhQBtLimPgElL0ToehTSZ5ftsRlFz47p7RWLPYxugNkYdgDoYHQJ0iFEKUIrREUBHGHUB6mLUA6iHUQZQhtF3AH2H0XOAnmPUB6iP0QCgAUZDgIYYrb+lCo0wGgM0xuh7gL7HKAcox2gC0ASjAqACoylAU4yOATrG6AVALzA6AegEo1OATjF6CdDLayYWLAOZ8GVWnK8FmdclMuOMxVJmV00Qk6dFUudJM5Wu1dSNirqhqVsVdUtTdyrqjqbuVtRdTd2rqHuaelBRDzT1uKIea2q/ovaLIfKISL5dxrw88fTUUSFLs7q4vRC3NXFxUnnV06kGHXpULJjiQXPSXTjp6mJvIfZ08WghHmmivxSej8MT1fAEDC9fJrkuS5o4XYhTXbxciJea2C+1vqaclMqJpiT9RX+vJrb68vvRBX751fp1PJaz+QXI5ZSeL0M28WNPDYYEyuuTVVQVLqKAmuWFz5lfp5YaYPHsdF3ev3w6EnLAQ9enZrO9Zq011y3OXE9YPK+sdWtrElcud7ZcYHkLp812YXVW4zejceEnkiudiIir22+maud2FZe6MefQWlbfwrxHeBHrkrWqvTnmfR7Zhduyk/tzg2sc2Vd3Y+qyMFPPnE1m0gGV+vyxZjUcTgovI3nplnuj+l5AfDkJs6uHySBrrs/qloTLPHFSeEzDobyvU5Hldks9LTFkzcJbWbNQs5Z17H9tFRSkgW5MJrcwlhAyTtQZLOhEZElqv6OOUJ8y6pCQY0nBrBf1+TQ+ms/79/lSUZ9ebDKlCSOhycLyW9FyqzFnkcoruBcNag3HXAs0p6fX4mva5pMbXF5voG1IPjvHtBK098yJVJ6xTeTzIE+96+6jfGiR8yjRmnMK3LkdyxSpzv3a7uiWm6Or7Zt58pDvmypbqLXnFQ1WgBrh0lhmde5AXnG4LDI/Cuu9ZTki/94AOSWlXNVArSdFc0VnbmjSmzueh36Te6/iH/La+V423Kkrnbydzk2Bda7i6twU1UTwVF3GxnJXKhZiXqFOnMFKs13/RKoXeuuP27L8ptV88kP5+fSe8Y3xnfHIaBs/Gk+MF8a+0TUcY2z8avxm/L76x+qfq3+t/lOgd++UNl8bS7/Vf/8DlVjGSQ==</latexit> <latexit sha1_base64="QWvsrxAQ4xUvcB2cTuonVjy46mw=">AAAWKXicjZhdb9s2FIbV7qvzPppuyNVutBkFOiAo7GDAdjOgTZqmSd00bWInTpQZlExLbPRVinLsCP4nu91u9mt2t+12f2SkJDuy+CaLgTYU3+fwHJIieSg79lkiWq2/79z94MOPPv7k3qeNzz7/4sv7Kw++6iVRyh3adSI/4sc2SajPQtoVTPj0OOaUBLZPj+zzTaUfjSlPWBQeimlMzwLihmzEHCJk1WBlxQpemT+bVtCx1uR/vxwOVpqtx638Z+qFdlloGuVvf/Bg9Y41jJw0oKFwfJIkp+1WLM4ywgVzfDprWGlCY+KcE5eeymJIApqcZXnoM/OhrBmao4jLf6Ew89qqRUaCJJkGtiQDIrykrqlKpJ2mYvTTWcbCOBU0dApHo9Q3RWSqcTCHjFNH+FNZIA5nMlbT8QgnjpCj1WhYMY/GbEidKAhIOMws6WF22j7LLDvyhyqiyM+a7dnsYcPiNKQXC3BMnQJUMdmjHGpYNYL4uLVG46G5WXCJLCrVTOOYctORk6xHRad0lnvKdpQXLeinUqVhknKqoinIpzOIbgB0A6ObAN3E6DOAPsPoFkC3MPocoM8xug3QbYy+AOgLjO4AdAejuwDdxehLgL7EaAegHYy+AugrjO4BdA+jrwH6GqP7AN3H6BuAvsHoW4C+xegBQA8wegjQQ4x2AdrFaA+gPYweAfQIo8cAPcZoH6B9jJ4A9OSal1CeM0MCeKtU8GwwN4BGhQBtLimPgElL0ToehTSZ5ftsRlFz47p7RWLPYxugNkYdgDoYHQJ0iFEKUIrREUBHGHUB6mLUA6iHUQZQhtF3AH2H0XOAnmPUB6iP0QCgAUZDgIYYrb+lCo0wGgM0xuh7gL7HKAcox2gC0ASjAqACoylAU4yOATrG6AVALzA6AegEo1OATjF6CdDLayYWLAOZ8GVWnK8FmdclMuOMxVJmV00Qk6dFUudJM5Wu1dSNirqhqVsVdUtTdyrqjqbuVtRdTd2rqHuaelBRDzT1uKIea2q/ovaLIfKISL5dxrw88fTUUSFLs7q4vRC3NXFxUnnV06kGHXpULJjiQXPSXTjp6mJvIfZ08WghHmmivxSej8MT1fAEDC9fJrkuS5o4XYhTXbxciJea2C+1vqaclMqJpiT9RX+vJrb68vvRBX751fp1PJaz+QXI5ZSeL0M28WNPDYYEyuuTVVQVLqKAmuWFz5lfp5YaYPHsdF3ev3w6EnLAQ9enZrO9Zq011y3OXE9YPK+sdWtrElcud7ZcYHkLp812YXVW4zejceEnkiudiIir22+maud2FZe6MefQWlbfwrxHeBHrkrWqvTnmfR7Zhduyk/tzg2sc2Vd3Y+qyMFPPnE1m0gGV+vyxZjUcTgovI3nplnuj+l5AfDkJs6uHySBrrs/qloTLPHFSeEzDobyvU5Hldks9LTFkzcJbWbNQs5Z17H9tFRSkgW5MJrcwlhAyTtQZLOhEZElqv6OOUJ8y6pCQY0nBrBf1+TQ+ms/79/lSUZ9ebDKlCSOhycLyW9FyqzFnkcoruBcNag3HXAs0p6fX4mva5pMbXF5voG1IPjvHtBK098yJVJ6xTeTzIE+96+6jfGiR8yjRmnMK3LkdyxSpzv3a7uiWm6Or7Zt58pDvmypbqLXnFQ1WgBrh0lhmde5AXnG4LDI/Cuu9ZTki/94AOSWlXNVArSdFc0VnbmjSmzueh36Te6/iH/La+V423Kkrnbydzk2Bda7i6twU1UTwVF3GxnJXKhZiXqFOnMFKs13/RKoXeuuP27L8ptV88kP5+fSe8Y3xnfHIaBs/Gk+MF8a+0TUcY2z8avxm/L76x+qfq3+t/lOgd++UNl8bS7/Vf/8DlVjGSQ==</latexit> symmetric -
(1) Exploitable + for dimension reduction, not just cheap surrogate
(2) Insights + which variables are important (3) Discoverable / checkable + eigenvalues + non-residual metrics: + plots in 1 and 2d E[ Var[ f | UT x ] ] SUMMARY :: Why I like ridge structure -
The best way to fight the curse of dimensionality is
to reduce the dimension! There are many notions of important subspaces; they arise in several applications. Important subspaces are discoverable and exploitable for answering science questions. TAKE HOMES -
Are there other options for important directions? What is the
trade-off between discovering the low- dimensional structure vs. solving the original problem? Why are these structures so pervasive? What if my model doesn’t fit your setup? (no gradients, multiple outputs, correlated inputs, …) PAUL CONSTANTINE Assistant Professor University of Colorado Boulder activesubspaces.org! @DrPaulynomial! QUESTIONS? Active Subspaces SIAM (2015)