Slide 6
Slide 6 text
Three types of upsampling layers
(a): Transposed convolution
(b): Interpolation + convolution
(c): Sub-pixel convolution (pixel-suf
fl
er)
Investigation of upsampling layers in HiFi-GAN
6
AAACyXichVFLaxRBEK5MfMT1kTW5CLkMbiKelp4YVHIK5CLkktcmgZ1l6ZntTZrtxzjdu24y9Cm3/AEPOSmEEPwZXsS7h/wE8SJEEMWDNbMDokGtpru/+qq+6uruKBHcWELOx7zxK1evXZ+4Ubl56/adyerdqS2j+2nMGrEWOt2JqGGCK9aw3Aq2k6SMykiw7ai3nMe3Byw1XKtNu5+wlqS7ind5TC1S7WonVOxFrKWkqpOFEXfNoJWFMtJD9LToSGr3/NlaMOtcJY/7vXbWd03Rcj66XT+0XDLjBw4RG9psxC5rNdhMqTKJNsy5drVG6qQw/zIISlCD0lZ19RRC6ICGGPoggYECi1gABYOjCQEQSJBrQYZciogXcQYOKqjtYxbDDIpsD9dd9Jolq9DPa5pCHeMpAmeKSh/myAdyRi7IO/KGfCQ//lorK2rkvezjHo20LGlPHt3b+PpflcTdwt4v1T97ttCFp0WvHHtPCia/RTzSDw5eXmwsrs9lD8hr8gn7f0XOyVu8gRp8iU/W2PoxVPADgj+f+zLYmq8Hj+uP1hZqSwvlV0zADNyHh/jeT2AJnsEqNPDc9/AZvsF3b8V77g29g1GqN1ZqpuE38w5/Aq/csjU=
ku[l]⇥1 ConvTranspose
AAACn3ichVFBTxNBGH2sIKWCVLmQeFltajyYdlobID2RcNATKWAB09Zmdzu0k053N7vThrLpH+APePCiJoQQfoaJ8QYXD/wEwhESLh78drsJQYJ+m5158973vvlmxnSl8BVjZ2Pag/GJh5OJqeSj6ZnHs6knTzd9p+dZvGI50vG2TcPnUti8ooSSfNv1uNE1Jd8yOyuhvtXnni8c+70auLzeNVq22BGWoYhqpEo1xXdV4CtPNHlJH+qdRtAbVmU9V3itjzTdahu2zaUfyu1QzhU+BnLYSKVZlkWh3wX5GKQRR9lJHaKGJhxY6KELDhuKsIQBn74q8mBwiasjIM4jJCKdY4gkeXuUxSnDILZDY4tW1Zi1aR3W9CO3RbtI+j1y6siwX+yIXbKf7Jids9/31gqiGmEvA5rNkZe7jdn9+Y3r/7q6NCu0b1z/7FlhB0tRr4J6dyMmPIU18vf3Pl1ulNYzwUv2jV1Q/1/ZGftOJ7D7V9bBGl//jCQ9QP7v674LNgvZ/EL2zVoxvVyMnyKBZ3iBV3Tfi1jGO5RRoX2/4AdOcKo9195qq1p5lKqNxZ453Artwx8wn6Bi
stride: ku[l]/2, channels: hu/2l
AAACbHichVG7SgNBFD1ZXzE+Eh+FIIIYDLEJswoqqQJaWCbG+EBFdtdJXNwXu5NADP6ArYWFWiiIiJ9h4w9Y5BNEsFGwsfDuZkFU1DvMzJkz99w5M6M6hu4JxpoRqa29o7Mr2h3r6e3rjycGBlc9u+pqvKTZhu2uq4rHDd3iJaELg687LldM1eBr6v6Cv79W466n29aKqDt821Qqll7WNUUQtZFe5GWlaoipnUSSZVgQ4z+BHIIkwsjbiWtsYRc2NFRhgsOCIGxAgUdtEzIYHOK20SDOJaQH+xyHiJG2SlmcMhRi92ms0GozZC1a+zW9QK3RKQZ1l5TjmGQP7Ia9sHt2yx7Z+6+1GkEN30udZrWl5c5O/Gik+PavyqRZYO9T9adngTLmA686eXcCxr+F1tLXDk5eitnlyUaKXbIn8n/BmuyObmDVXrWrAl8+RYw+QP7+3D/B6nRGns3MFKaTuWz4FVGMYgJpeu855LCEPEp0roljnOE88iwNS6PSWCtVioSaIXwJKfUBaSiM5A==
(Default)
AAACdHichVHLSsNAFD2N7/po1I2gi2KouLFMq6i4Ety4EeqjWqhSkjjW0MmDZFrQ4g/4Ay5cKRYRP8ONP+DCTxCXFd248DYNiIp6w2TOnLnnzpm5hiesQDL2GFM6Oru6e3r74v0Dg0MJdXhkO3Crvsnzpitcv2DoAReWw/PSkoIXPJ/rtiH4jlFZae3v1LgfWK6zJY88vmfrZcc6sExdElVSE2tczAQeN6Xvln3dLqkaS7Mwkj9BJgIaosi56jV2sQ8XJqqwweFAEhbQEdBXRAYMHnF7qBPnE7LCfY4TxElbpSxOGTqxFfqXaVWMWIfWrZpBqDbpFEHDJ2USKfbAbliT3bNb9sTef61VD2u0vBzRbLS13CslTsc23/5V2TRLHH6q/vQscYDF0KtF3r2Qad3CbOtrx2fNzaWNVH2KXbJn8n/BHtkd3cCpvZiNdb5xjjg1IPP9uX+C7Ww6M5+eXc9qy3NRK3oxjklM03svYBmryCEf9uQcV2jEXpUJRVNS7VQlFmlG8SWU9AejXJAn
Mel-spectrogram
AAACh3ichVFBLyRBGH2aXYzdNbhIXDomZC87W4MgTkQiLhKGQYJMuts3VNR0d7qrJ2HiLv6Ag5NNNiISV+572T/g4CeII4mLg697OhEr7FepqlevvvfVqyrbVzLUQtw0Gc0tnz63trVnOr58/daZ7epeDr0ocKjkeMoLVm0rJCVdKmmpFa36AVlVW9GKvTMd76/UKAil5y7pXZ82qtaWKyvSsTRT5Wx/fd2umHOR0vJHkRzytayROSNJbZozUSzbL2dzIi+SMN+CQgpySGPey55iHZvw4CBCFQQXmrGChZDbGgoQ8JnbQJ25gJFM9gn7yLA24iziDIvZHR63eLWWsi6v45phonb4FMU9YKWJAXEtzsS9+CvOxa14erdWPakRe9nl2W5oyS93HvYuPv5XVeVZY/tF9aFnjQrGE6+SvfsJE9/Caehre0f3ixPFgfqg+CXu2P+JuBF/+AZu7cH5vUDFY2T4Awr/PvdbsDyUL4zmhxeGcpMj6Ve0oQ/9+M7vPYZJzGIeJT73ABe4xJXRbvw0Ro3xRqrRlGp68CqMqWdx3Zan
Multi-Receptive Field Fusion
AAACbnichVHLSsNAFD2Nr1ofrQoiiFgslbop0yoqrgqCuBH6sFqoRZI4raFpEpK0UEt/wL24EBQFEfEz3PgDLvoJ4kZQcOPC2zQgWtQbJnPmzD13ztyRDFWxbMZaHqGnt69/wDvoGxoeGfUHxsZ3LL1qyjwr66pu5iTR4qqi8ayt2CrPGSYXK5LKd6Xyent/t8ZNS9G1bbtu8EJFLGlKUZFFm6h8pLEnFYNb6Y3mwn4gxKLMiWA3iLkgBDeSeuAGeziADhlVVMChwSasQoRFXx4xMBjEFdAgziSkOPscTfhIW6UsThkisWX6l2iVd1mN1u2alqOW6RSVhknKIMLskd2yV/bA7tgT+/i1VsOp0fZSp1nqaLmx7z+eyrz/q6rQbOPwS/WnZxtFrDpeFfJuOEz7FnJHXzs6fc2spcONeXbFnsn/JWuxe7qBVnuTr1M8fQYfPUDsZ7u7wU48GluOLqbiocSS+xReTGMOEer3ChLYRBJZp2MnOMeF50WYFGaE2U6q4HE1E/gWQuQTcEyNTg==
(MRF)
AAACg3ichVFNSxtRFD1OTY3R1lQ3QkEGQ0qhEO5Mg1EhILjp0o/GCImEmfHFDpkvZl5C7SQ7V/4BF64slNJ2qf+gm/6BLvwJ4lLBjQtvxpHShe19vHfvO++ee897zwwcO5JE5yPKk9HM07HseG5i8tnzqfyL6a3I74aWqFm+44fbphEJx/ZETdrSEdtBKAzXdETd7KwOz+s9EUa2772X+4HYcY09z27bliEZauXnmlJ8lHHbD9WB6lQ1tWnt+jJS+51W3B30W/kClZZoqUykUokS46BMekXXVC1FCkhtzc9/RRO78GGhCxcCHiTHDgxEPBrQQAgY20HMWMiRnZwLDJBjbpezBGcYjHZ43eNdI0U93g9rRgnb4i4Oz5CZKor0m77RFf2iH3RBt4/WipMaQy377M17rghaU4ezmzf/ZbnsJT78Yf1Ts0Qbi4lWm7UHCTK8hXXP7306utpc3ijGr+gzXbL+Ezqnn3wDr3dtfVkXG8fI8Qc8vLL6eLCll7SF0tv1cmGlnH5FFi8xj9f83hWs4B3WUOO+B/iOU5wpGeWNoitprjKScmbwlynVO1cclVY=
for l = 1 · · · |ku
|
AAACdXichVG7SgNBFD1ZXzG+Vm0EEYJRsYqzKipWARsLC40mChrC7jqJS/bF7iQQQ37AH7DQRiGK+Bk2/oCFnyCWCmksvNksiAb1DjNz5sw9d87MaK5p+IKx54jU1d3T2xftjw0MDg2PyKNjWd8pezrP6I7peAea6nPTsHlGGMLkB67HVUsz+b5W2mjt71e45xuOvSeqLs9ZatE2CoauCqLyslw70grxLa6WqvE038rU83KCJVkQ8U6ghCCBMLYd+RZHOIYDHWVY4LAhCJtQ4VM7hAIGl7gcasR5hIxgn6OOGGnLlMUpQyW2RGORVocha9O6VdMP1DqdYlL3SBnHLHtid+yNPbJ79sI+fq1VC2q0vFRp1tpa7uZHziZ2m/+qLJoFTr5Uf3oWKGAt8GqQdzdgWrfQ2/rK6fnb7np6tjbHrtkr+b9iz+yBbmBX3vXGDk9fIEYfoPx87k6QXUwqK8mlneVEajn8iigmMY15eu9VpLCJbWTo3Aou0cBNpClNSTPSXDtVioSacXwLaeETPIGP6w==
LeakyReLU
AAACdnichVHLSsNAFD2N7/po1Y0gSLFUXZVbLSquBDcutVoVrJQkTjWYJiGZ1kfoD/gDLsSFghbxM9z4Ay78BHGpoAsX3qYBUVHvMDNnztxz58yM5piGJ4keIkpLa1t7R2dXtLunty8W7x9Y8+yKq4u8bpu2u6GpnjANS+SlIU2x4bhCLWumWNf2Fhr761XheoZtrcpDR2yV1R3LKBm6KpkqxvsLUhxI3y9opYRUrd1arRhPUpqCSPwEmRAkEcaSHa+jgG3Y0FFBGQIWJGMTKjxum8iA4DC3BZ85l5ER7AvUEGVthbMEZ6jM7vG4w6vNkLV43ajpBWqdTzG5u6xMIEX3dE3PdEc39Ejvv9bygxoNL4c8a02tcIqx46GV139VZZ4ldj9Vf3qWKGE28GqwdydgGrfQm/rq0cnzylwu5Y/RBT2x/3N6oFu+gVV90S+XRe4UUf6AzPfn/gnWJtOZ6fTUcjY5nw2/ohPDGMUEv/cM5rGIJeT53H2c4Qr1yJsyoqSU8WaqEgk1g/gSCn0AG36RSw==
tanh
AAACenichVHLSsNAFD2N7/qKiiC4CS2KopSJFpWuBDcu1dpWUClJnGpoXiRpoQZ/wB9w4UpBRP0MN/6Ai36CuKzgpgtv0oCoqHeYmTNn7rlzZkZ1DN3zGWsmhK7unt6+/oHk4NDwyKg4Nl707Jqr8YJmG7a7pyoeN3SLF3zdN/ie43LFVA1eUqsb4X6pzl1Pt61dv+HwQ1M5tvSKrik+UWVxsspdixs5aXVR0k4UK8JyWUyzDItC+gnkGKQRx5Yt3uIAR7ChoQYTHBZ8wgYUeNT2IYPBIe4QAXEuIT3a5zhDkrQ1yuKUoRBbpfGYVvsxa9E6rOlFao1OMai7pJQww57ZHWuxJ/bAXlj711pBVCP00qBZ7Wi5Ux49n8q//6syafZx8qn607OPCtYirzp5dyImvIXW0ddPL1r53M5MMMuu2Sv5v2JN9kg3sOpv2s0237lEkj5A/v7cP0FxKSOvZJa3l9Lr2fgr+jGNFObovVexjk1soUDnBrjCPR4SbSElzAsLnVQhEWsm8CWE7AdFXZEz
kernel: 7, channel: 1
AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t
Conv1D
AAACfXichVG7SgNBFD1ZXzE+ErUJ2ARDxELCREXFSrCxkiSaKGgIu+skLtkXu5NIDPoB/oCFlaKIiP6EjT9g4SeIZQQbQW82C6JBvcvOnDlzz71nZhRb11zB2FNA6uru6e0L9ocGBoeGw5GR0bxrVR2V51RLt5wtRXa5rpk8JzSh8y3b4bKh6HxTqay09jdr3HE1y9wQdZsXDLlsaiVNlQVRxUi0saOUYjnblQ1qZ5Zja1zsW07lsBiJsyTzItYJUj6Iw4+0FbnCDnZhQUUVBjhMCMI6ZLj0bSMFBpu4AhrEOYQ0b5/jECHSVimLU4ZMbIXGMq22fdakdaum66lV6qLT75AyhgR7ZNesyR7YDXtm77/Wang1Wl7qNCttLbeL4ePo+tu/KoNmgb0v1Z+eBUpY9Lxq5N32mNYp1La+dnDSXF/KJhqT7Jy9kP8z9sTu6QRm7VW9zPDsKUL0AKmf190J8jPJ1HxyNjMTX57znyKIcUxgiu57ActYRRo56nuEC9ziLvAhJaRpKdlOlQK+ZgzfQlr4BB/Vk/U=
Upsampling Network
AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t
Conv1D
AAAChXichVG7SgNBFD2urxhfURvBZjFELDRMNBixUbCx9JUHJCHsrqNZstlddidBXdJa+AMWVgoioq3+gI0/YOEniKWCjYU3mwXRoN5hZs6cuefOmRnVNnRXMPbUIXV2dff0hvrC/QODQ8ORkdGMa9Ucjac1y7CcnKq43NBNnha6MHjOdrhSVQ2eVSurzf1snTuubpnb4sDmxaqyZ+q7uqYIokoRuSD4vvAq3DG5sSSnZmStrJg+bpRLXq1RikRZnPkht4NEAKIIYt2KXKKAHVjQUEMVHCYEYQMKXGp5JMBgE1eER5xDSPf3ORoIk7ZGWZwyFGIrNO7RKh+wJq2bNV1frdEpBnWHlDJi7JFdsVf2wK7ZM/v4tZbn12h6OaBZbWm5XRo+Ht96/1dVpVmg/KX607PALhZ9rzp5t32meQutpa8fnrxuLW3GvCl2zl7I/xl7Yvd0A7P+pl1s8M1ThOkDEj+fux1k5uKJhfj8RjK6kgy+IoQJTGKa3juFFaxhHWk69wg3uMWd1CvNSklpoZUqdQSaMXwLafkTZ+mVwA==
kernel: 7, channel: hu
AAACeXichVHLSgMxFD0d3/VVHwvBTbVUiouSqqi4Ety4rNY+QKXMTFMNzouZtNAWf8AfcOFGBZHqZ7jxB1z4CeJSwYUuvJ0OiBb1hiQnJ/fcnCSaYwhPMvYYUrq6e3r7+gfCg0PDI6ORsfGcZ1dcnWd127DdgqZ63BAWz0ohDV5wXK6amsHz2tFGaz9f5a4nbGtH1hy+b6oHligLXZVEFSOTmZolD7kn6rwUzatVXrZdsxiJsSTzI9oJUgGIIYi0HbnGHkqwoaMCExwWJGEDKjxqu0iBwSFuHw3iXELC3+c4Rpi0FcrilKESe0TjAa12A9aidaum56t1OsWg7pIyijh7YE32wu7ZLXtiH7/Wavg1Wl5qNGttLXeKoydTmbd/VSbNEodfqj89S5Sx6nsV5N3xmdYt9La+Wj99yaxtxxtz7JI9k/8L9sju6AZW9VW/2uLbZwjTB6R+PncnyC0kU8vJxa2F2PpS8BX9mMYsEvTeK1jHJtLI0rl1nKOJm9C7MqMklPl2qhIKNBP4FsriJ6JSkmg=
Synthesized Waveform
AAACg3ichVFdK0RBGH4c3+trcaOUTjYi2WaXkFKkcCVfi0LbOcdg2rPnnObMrtjcufIHXLiiJFzyD9z4Ay78BLmk3Ljw7tlTQninmXnmmfd555kZ07OFrxh7LNPKKyqrqmtqI3X1DY1N0eaWZd/NSYunLNd25app+NwWDk8poWy+6kluZE2br5iZyeL+Sp5LX7jOktrz+EbW2HbElrAMRVQ62tEz0avPiCnRPz0xq09zh0tDuVKf5WrXlZl0NMbiLAj9J0iEIIYw5tzoBdaxCRcWcsiCw4EibMOAT20NCTB4xG2gQJwkJIJ9jgNESJujLE4ZBrEZGrdptRayDq2LNf1AbdEpNnVJSh1d7IFdshd2z67ZE3v/tVYhqFH0skezWdJyL9101Lb49q8qS7PCzqfqT88KWxgJvAry7gVM8RZWSZ/fP35ZHF3oKnSzM/ZM/k/ZI7ujGzj5V+t8ni+cIEIfkPj+3D/BcjKeGIoPzCdj46PhV9SgHZ3oofcexjhmMIcUnXuIK9zgVqvU+rSkNlhK1cpCTSu+hDb2AfFNk7g=
(A) HiFi-GAN Generator Network
AAACj3ichVE9SwNBEH2e3/Er0UawOQxKYhE2EVQsJKCFdokmGogS7s5NPLzcHneXgAb/gJWdhZWCiNjbKtj4ByzyE8RSwcbCucuBaFBn2d2ZN/Nm3+6qlqE7LmPNDqmzq7unt68/NDA4NDwSjoxuOqJmazyvCUPYBVVxuKGbPO/qrsELls2VqmrwLXV/2ctv1bnt6MLMuQcW36kqFVMv65riElQKz8SUuJyzFdOxhMN35WVh1oVR85JybIVrX2G8FI6yBPNNbneSgRNFYBkRvsI2diGgoYYqOEy45BtQ4NAoIgkGi7AdNAizydP9PMcRQsStURWnCoXQfVorFBUD1KTY6+n4bI1OMWjaxJQxxZ7YNXtlj+yGPbOPX3s1/B6elgPa1RaXW6WR4/GN939ZVdpd7H2x/tTsoowFX6tO2i0f8W6htfj1w9PXjcX1qcY0u2AvpP+cNdkD3cCsv2mXWb5+hhB9QPLnc7c7m6lEci4xm01F04vBV/RhApOI0XvPI41VZJCnc09wizvcSxFpXlqS0q1SqSPgjOGbSWufvw2Z2Q==
(a) Transposed Convolution (Deconvolution)
AAACeHichVHLSgMxFD0d3/U12o3gZrD42pS0ioqrghvdVWtVUCkzY6qD82ImLdShP+APuHAhCqLFz3DjD7joJ4jLCoK48HY6ICrqDUlOTu65OUk01zR8wVgjJnV0dnX39PbF+wcGh4blkdEt3yl7Oi/ojul4O5rqc9OweUEYwuQ7rsdVSzP5tna80trfrnDPNxx7U1Rdvm+ph7ZRMnRVEFWUE8GeVlLWbME91zFDslaUkyzFwlB+gnQEkogi58g32MMBHOgowwKHDUHYhAqf2i7SYHCJ20dAnEfICPc5aoiTtkxZnDJUYo9pPKTVbsTatG7V9EO1TqeY1D1SKphkj6zOmuyB3bEn9v5rrSCs0fJSpVlra7lbHD4dy7/+q7JoFjj6VP3pWaCEpdCrQd7dkGndQm/rKydnzfzyxmQwxa7YM/m/ZA12TzewKy/69TrfOEecPiD9/bl/gq1MKr2QmlvPJLPz0Vf0YhwTmKH3XkQWq8ihQOdWcYFb1GNvkiJNS7PtVCkWaRL4ElLmA7f9kgE=
Interpolation
AAACe3ichVHLSgMxFD0d3/VVFURwUyyKipTUN64KblxJq1YFlTIzxjY4nQwzaaFWf8AfcOHKgojUv3DjD7jwE8SlghsFb6cDoqLekOTk5J6bk8RwLOEpxh5CWlNzS2tbe0e4s6u7pzfS17/pyaJr8owpLeluG7rHLWHzjBLK4tuOy/WCYfEt43C5vr9V4q4npL2hyg7fK+g5WxwIU1dEZSOD46tcd7mnojYXubwh3byU+xPZSIzFmR/RnyARgBiCSMnIFXaxDwkTRRTAYUMRtqDDo7aDBBgc4vZQIc4lJPx9jhOESVukLE4ZOrGHNOZotROwNq3rNT1fbdIpFnWXlFGMsnt2zZ7ZHauxR/b2a62KX6PupUyz0dByJ9t7OrT++q+qQLNC/lP1p2eFAyz6XgV5d3ymfguzoS8dnT2vL62NVsZYlT2R/wv2wG7pBnbpxbxM87VzhOkDEt+f+yfYnI4n5uMz6elYcjb4inYMYwTj9N4LSGIFKWTo3GNUUcNN6F2LaZPaVCNVCwWaAXwJbe4DacWStg==
(Nearest neighborhood)
AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t
Conv1D
AAACnXichVFNS+NAGH6Mq9b6VfWy4GGDRfGgdaKixZOwCB5k8atWqN2SxNGGTpOQTItu6B/wD+xBEBRExJ+xHrzozYM/QTy6sBcPvkkDsiu6b8jMM8/zPu+8M2O4wvIlY/ctSuuntvaORGeyq7unty/VP7DpOzXP5DnTEY63Zeg+F5bNc9KSgm+5HterhuB5o/I11PN17vmWY2/IA5cXq/qebe1api6JKqWy25Lvy6DCPZuLebVRKQW1RkEUJ7RxtSmpZlm3SfRJLYfq5NT3QDRKqTTLsCjUt0CLQRpxrDipc2xjBw5M1FAFhw1JWECHT18BGhhc4ooIiPMIWZHO0UCSvDXK4pShE1uhcY9WhZi1aR3W9CO3SbsI+j1yqhhhd+yCPbFrdske2PO7tYKoRtjLAc1G08vdUt/h5/U//3VVaZYov7o+7FliF9moV4t6dyMmPIXZ9Nd//Hxan18bCUbZKXuk/k/YPftFJ7Drv82zVb52hCQ9gPbvdb8Fm1MZbTYzvTqTXpiJnyKBIQxjjO57DgtYwgpytO8xrnCDW+WLsqgsK9+aqUpL7BnEX6HkXwAqwaAB
kernel: ku[l] 1, channels: hu/2l
AAACb3ichVHLSsNAFD2N7/qqulAQpFgU3ZSJioqrQl24bKt9gBVJ4lQH0yQkaUBDf8AP0IULHyAifoYbf8CFnyCupIIbF96mAVFR7zAzZ87cc+fMjGrpwnEZe4xIbe0dnV3dPdHevv6BwdjQcMExa7bG85qpm3ZJVRyuC4PnXeHqvGTZXKmqOi+q++nmftHjtiNMY8M9sPhWVdk1REVoiktU2S+rlXjaNDx5tb4dS7AkCyL+E8ghSCCMjBm7Rhk7MKGhhio4DLiEdShwqG1CBoNF3BZ84mxCItjnqCNK2hplccpQiN2ncZdWmyFr0LpZ0wnUGp2iU7dJGccUe2A3rMHu2S17Yu+/1vKDGk0vBzSrLS23tgePxtbf/lVVaXax96n607OLCpYDr4K8WwHTvIXW0nuHJ431ldyUP80u2TP5v2CP7I5uYHiv2lWW504RpQ+Qvz/3T1CYS8qLyfnsXCK1EH5FN8YxiRl67yWksIYM8nSuhWOc4TzyIo1KE1K8lSpFQs0IvoQ0+wFGFo4t
Conv1D
AAACnnichVFNSxtBGH7cqk1Ta1Z7KfSyGBRBibMatHoSCsWL1ETzAUkMu9vRLJnsLruToF3yB/oHeuihVCil9GcUwZM99eBPKB4jePHgu5uFUqXtu+y8zzzzPu88M2N6wg4kYxcjyoPRsfGHqUfpxxNPJjPq1HQ5cLu+xUuWK1y/ahoBF7bDS9KWglc9nxsdU/CK2X4ZrVd63A9s19mTxx5vdIxDxz6wLUMS1VTX65IfybDNfYeLDa2/sqgNGc1qGQ5xAZHtZtjt10SjFeWl5f1QLOj9ppplORaHdh/oCcgiiR1X/YI63sCFhS464HAgCQsYCOirQQeDR1wDIXE+ITte5+gjTdouVXGqMIht03hIs1rCOjSPegax2qJdBP0+KTXMsp/sKxuwM/aN/WI3f+0Vxj0iL8eUzaGWe83Mu2e71/9VdShLtH6r/ulZ4gAvYq82efdiJjqFNdT33r4f7G4UZ8M5dsIuyf8ndsG+0wmc3pX1ucCLH5CmB9DvXvd9UF7O6au5lUI+u5lPniKF55jBPN33GjaxhR2UaN+POMU5fiia8krZVl4PS5WRRPMUf4RSvQXCC6A8
kernel: 3, channels: ku[l]hu/2l+1
AAACcHichVG7SgNBFD1Z3/EVtREsjIaIWIRZFRUrwcYyD5MIJoTddRIX9+XuJKDBH/AHUtioICJ+ho0/YJFPEDsj2Fh4s1kQDeodZubMmXvunJlRHUP3BGPNkNTT29c/MDgUHh4ZHRuPTEzmPLvqajyr2Ybt7qmKxw3d4lmhC4PvOS5XTNXgefVou72fr3HX021rV5w4vGgqFUsv65oiiCrWC2o5mubeoeLws1IkxhLMj2g3kAMQQxBJO3KLAg5gQ0MVJjgsCMIGFHjU9iGDwSGuiDpxLiHd3+c4Q5i0VcrilKEQe0RjhVb7AWvRul3T89UanWJQd0kZRZw9sTvWYo/snj2zj19r1f0abS8nNKsdLXdK4+fTmfd/VSbNAodfqj89C5Sx4XvVybvjM+1baB197bTRymym4/UFds1eyP8Va7IHuoFVe9NuUjx9gTB9gPzzubtBbjkhryVWUsuxrdXgKwYxg3ks0nuvYws7SCJL5x6jgUtchV6laWlWmuukSqFAM4VvIS19AurAjvQ=
Reshape
AAACpHichVHPTxNBFP5YUbH+oMDFxMvGBuLBlGkhQrhA4sUDB6AUSNrS7K6PdtLZ2c3utBE2/Qf4Bzx40oQYwp/hxYSrHPgTjEdIvHjw7XYTo0R9m5355nvf9+bNjBsqGRshLsesW+O379yduFe4/+Dho8ni1PROHPQjj+peoIJoz3ViUlJT3UijaC+MyPFdRbtu72Wa3x1QFMtAb5vDkFq+09HyQHqOYapdXG0aemOSddId012xh00jfYrtXjvpDxuqNV99bo8Uttd1tCYVs6ibZuer+4katoslURZZ2DdBJQcl5LERFD+iidcI4KEPHwQNw1jBQcxfAxUIhMy1kDAXMZJZnjBEgb19VhErHGZ7PHZ41chZzeu0Zpy5Pd5F8R+x08asuBCn4kp8Fmfiq/jx11pJViPt5ZBnd+SlsD15/Lj2/b8un2eD7i/XP3s2OMBy1qvk3sOMSU/hjfyDo7dXtZWt2WROfBDfuP/34lJ84hPowbV3sklb71DgB6j8ed03wU61XHlRXthcLK0t5k8xgSd4imd830tYwytsoM77nuAcX3BhzVnrVs2qj6TWWO6ZwW9h7f8Ez9qiyQ==
Length: ⇥ ku[l]/2, channels: hu/2l
AAAChHichVFNLwNBGH6s7/oqLhIHGw0hpJkSH3GQJr1wa1GaILK7Rm063dnsTpvQOLr4Aw5OJCLiyi9w8Qcc/ARxrMTFwdvtJoLgnczMM8+8zzvPzJiusH3F2FOD1tjU3NLa1h7p6Ozq7on29q37suRZPGtJIb2cafhc2A7PKlsJnnM9bhRNwTfMQqq2v1Hmnm9LZ00duHy7aOQde8+2DEXUTnRozBzXlx3FPVeKgNMn9JR0ylKU6hkxFmdB6D9BIgQxhJGW0StsYRcSFkoogsOBIixgwKe2iQQYXOK2USHOI2QH+xxHiJC2RFmcMgxiCzTmabUZsg6tazX9QG3RKYK6R0odI+yRXbMqe2A37Jm9/1qrEtSoeTmg2axrubvTczKw+vavqkizwv6n6k/PCnuYD7za5N0NmNotrLq+fHhaXV1YGamMsgv2Qv7P2RO7pxs45VfrMsNXzhChD0h8f+6fYH0qnpiNT2emYsmF8CvaMIhhjNF7zyGJJaSRpXOPcYNb3Gkt2qQ2rc3UU7WGUNOPL6EtfgD4TpUi
(b) Interpolation + Convolution AAACfnichVG7SgNBFD2urxhfURvFJhgMsUicRNCQKmBjmRijgorsrpM4ONld9hGMQez9AQsrBRER9CNs/AELP0EsFWwsvNksiIp6l505c+49d87MaJYUjsvYY4fS2dXd0xvqC/cPDA4NR0ZGVx3Ts3Ve1k1p2uua6nApDF52hSv5umVztaZJvqbtLbbya3VuO8I0VtyGxbdqatUQFaGrLlHbkYmEPhMteVrSEvtcRhdNo25Kr52LsRTzI/oTpAMQQxAFM3KJTezAhA4PNXAYcAlLqHDo20AaDBZxW2gSZxMSfp7jEGHSelTFqUIldo/GKq02Atagdaun46t12kXSb5Myimn2wK7YC7tn1+yJvf/aq+n3aHlp0Ky1tdzaHj4eL739q6rR7GL3U/WnZxcVZH2vgrxbPtM6hd7W1w9OXkq55elmnJ2zZ/J/xh7ZHZ3AqL/qF0W+fIowPUD6+3X/BKuZVHo+NVfMxPK54ClCmMQUEnTfC8hjCQWUad8jXOAGtwqUuJJUZtulSkegGcOXULIfZt6SrQ==
(c) Sub-pixel Convolution