https://www.oreilly.com/ideas/ideas-on-interpreting-machine-learning Figure 14. An illustration of surrogate models for explaining a complex neural network. Figure courtesy of Patrick Hall and the H2O.ai team.
illustration of the LIME process in which a weighted linear model is used to explain a single prediction from a complex neural network. Figure courtesy of Marco Tulio Ribeiro; image used with permission. ˞1ZUIPO࣮ʹͱͮ͘ • ϥϯμϜʹηάϝϯτԽͨ͠σʔλΛੜ • skimage.segmentationͷख๏͕ར༻Մ (quickshiftͳͲ) • ίαΠϯྨࣅͰॏΈ͚ • Ҏ߱ɺςʔϒϧσʔλͱಉ༷ ※RͰະ࣮