CoreMLでアイドル顔認識アプリを作ろう

$PSF.-ͰΞΠυϧإೝࣝ
ΞϓϦΛ࡞Ζ͏
দલ݈ଠ࿠
!LFONB[
J04%$
5SBDL"

View Slide

w ීஈ͸J04ΤϯδχΞ
w ػցֶशͷઐ໳ՈͰ͸ͳ͘ɺ
झຯͰษڧத
ࣗݾ঺հ

View Slide

ຊτʔΫʹ͍ͭͯ
wJ04ΤϯδχΞ͕ػցֶशʹνϟϯϨϯδͯ͠Έͨ
wػցֶशٕज़ɾ$PSF.-Λ࢖ͬͨJ04ΞϓϦͷ։ൃϑ
ϩʔΛ޿͘ઙ͘࿩͠·͢ɻ
wʮࣗ෼Ͱ΋΍Εͦ͏ɺ͓΋͠Ζͦ͏ɺࢼͯ͠Έ͍ͨʯ
ͱօ͞Μʹࢥ͍͚ͬͯͨͩΕ͹޾͍Ͱ͢

View Slide

/%"ʹ͍ͭͯ
w$PSF.-΍J04ʹ͍ͭͯ͸ɺ/%"
ͷؔ܎্ɺݱ࣌఺ͰҰൠެ։͞Εͯ
͍Δൣғͷ৘ใͷΈΛऔΓѻ͍·͢
wσϞϯετϨʔγϣϯ΍࣮ݧ݁Ռͷ
঺հͳͲ͸ߦ͍·ͤΜɻ

View Slide

લఏͱͳΔઐ໳஌ࣝ

View Slide

ΞΠυϧάϧʔϓ

View Slide

αϯϓϧࣄྫɿ
ΞΠυϧإࣝผΞϓϦ
Πϝʔδ
͸ͳ͜

View Slide

J04
7JTJPO$PSF.-
͓͞Β͍

View Slide

7JTJPO

View Slide

7JTJPO
wը૾ೝࣝॲཧ༻ϑϨʔϜϫʔΫ
wϝδϟʔͳը૾ೝࣝॲཧΛඪ४
Ͱఏڙ

View Slide

ग़యɿIUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED

View Slide

࢖͍ํ
7/3FRVFTU)BOEMFS
7/3FRVFTU
7/0CTFSWBUJPO
7/0CTFSWBUJPO
7/0CTFSWBUJPO
࣮ߦ͍ͨ͠ը૾ೝࣝλεΫ
ೖྗը૾
ந৅Խ͞Εͨೝࣝ݁Ռ

View Slide

ྫ
إ෦඼ͷݕ஌
7/%FUFDU'BDF-BOENBSLT
3FRVFTU
7/'BDF-BOENBSLT%
GBDF$POUPVSʢྠֲҐஔʣ
MFGU&ZFʢࠨ໨Ґஔʣ
MFGU&ZFCSPXʢࠨ໨එҐஔʣ
MFGU1VQJMʢࠨ໨؟ٿҐஔʣ
OPTFʢඓҐஔʣ
ʜ
ػցֶश΍ը૾ೝࣝͷ
ৄ͍͠஌ࣝ͸ෆཁ

View Slide

ओͳ7/3FRVFTUͷαϒΫϥε ༻్
7/%FUFDU'BDF3FDUBOHMFT3FRVFTU إͷۣܗݕग़
7/%FUFDU'BDF-BOENBSLT3FRVFTU إͷύʔπݕग़
7/%FUFDU3FDUBOHMFT3FRVFTU ۣܗݕग़
7/%FUFDU5FYU3FDUBOHMFT3FRVFTU ςΩετۣܗݕग़
7/5SBDL0CKFDU3FRVFTU ෺ମݕग़
7/%FUFDU)PSJ[PO3FRVFTU ਫฏݕग़
7/*NBHF3FHJTUSBUJPO3FRVFTU
ը૾ϨδετϨʔγϣϯ
ʢҐஔ߹Θͤʣ
7/%FUFDU#BSDPEFT3FRVFTU όʔίʔυݕग़
7/$PSF.-3FRVFTU ΧελϜͷ$PSF.-Λ༻͍ͨݕग़

View Slide

ओͳ7/3FRVFTUͷαϒΫϥε ༻్
7/%FUFDU'BDF3FDUBOHMFT3FRVFTU إͷۣܗݕग़
7/%FUFDU'BDF-BOENBSLT3FRVFTU إͷύʔπݕग़
7/%FUFDU3FDUBOHMFT3FRVFTU ۣܗݕग़
7/%FUFDU5FYU3FDUBOHMFT3FRVFTU ςΩετۣܗݕग़
7/5SBDL0CKFDU3FRVFTU ෺ମݕग़
7/%FUFDU)PSJ[PO3FRVFTU ਫฏݕग़
7/*NBHF3FHJTUSBUJPO3FRVFTU
ը૾ϨδετϨʔγϣϯ
ʢҐஔ߹Θͤʣ
7/%FUFDU#BSDPEFT3FRVFTU όʔίʔυݕग़
7/$PSF.-3FRVFTU ΧελϜͷ$PSF.-Λ༻͍ͨݕग़
·ͣ͜ΕΒΛ࢖͑ͳ͍͔ݕ౼
ཁ݅ʹ߹Θͳ͚Ε͹
$PSF.-Λબ୒

View Slide

$PSF.-

View Slide

$PSF.-
wػցֶशϑϨʔϜϫʔΫʢਪ࿦ͷΈʣ
wσόΠε୯ମͰಈ࡞
w࣮ߦ࣌ʹαʔόʔෆཁɾߴ଎ɾηΩϡΞ
w$16(16ʹ࠷దԽ͞Ε͓ͯΓύϫϑϧ

View Slide

$PSF.-Λ༻͍ͨΞϓϦͷߏ੒

View Slide

$PSF.-Ϟσϧ

View Slide

$PSF.-Ϟσϧ
wωοτϫʔΫߏ଄ɺֶशࡁΈͷॏΈ

View Slide

$PSF.-Ϟσϧ
wυΩϡϝϯτϝλσʔλ

View Slide

$PSF.-Ϟσϧ
wυΩϡϝϯτϝλσʔλ
wTXJGUPCKDͱͷ*'ͱͳΔΫϥεఆٛ

View Slide

IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
'MPXFS$MBTTpFSNMNPEFM

View Slide

MFUJOQVU$71JYFM#V⒎FS
MFUNPEFM'MPXFS$MBTTJpFS

MFUPVUQVUUSZNPEFMQSFEJDBUF qPXFS*NBHFJOQVU

QSJOU PVQVUqPXFS5ZQF

View Slide

$PSF.-ͷߏ੒
$PSF.-Ϟσϧ

View Slide

$PSF.-ͷߏ੒
Ͳ͏΍ͬͯ༻ҙ͢Δʁ
$PSF.-Ϟσϧ

View Slide

ᶃ܇࿅ࡁΈͷ$PSF.-ϞσϧΛ࢖͏
໊শ αΠζ ༻్ ࣝผྫ
.PCJMF/FU .#
෺ମೝࣝ ໦ɺಈ෺ɺ৯΂෺ɺंɺਓͳͲ
4RVFF[F/FU .#
3FT/FU .#
*ODFQUJPOW .#
7(( .#
1MBDF(PPH-F/FU .# γʔϯೝࣝ ۭߓɺ৸ࣨɺ৿ྛɺԊ؛
"QQMFެࣜఏڙ
IUUQTEFWFMPQFSBQQMFDPNNBDIJOFMFBSOJOH

View Slide

໊শ ༻్
$BS3FDPHOJUJPO ंͷϒϥϯυˍϞσϧࣝผ
:0-0 ෺ମೝࣝ
"HF/FU ਓؒͷإͷ೥ྸਪఆ
(FOEFS/FU ਓؒͷإͷੑผਪఆ
&NPUJPO/FU ਓؒͷإͷײ৘ਪఆ
)&% Τοδநग़
'PPE ྉཧͷࣝผ
0YGPSE Ֆͷछྨͷࣝผ
-PDBUJPO/FU ࣸਅͷࡱӨ஍ਪఆ
ͦͷଞͷެ։$PSF.-Ϟσϧ IUUQTHJUIVCDPNMJLFEBO"XFTPNF$PSF.-.PEFMT

View Slide

໊শ ༻్
$BS3FDPHOJUJPO ंͷϒϥϯυˍϞσϧࣝผ
:0-0 ෺ମೝࣝ
"HF/FU ਓؒͷإͷ೥ྸਪఆ
(FOEFS/FU ਓؒͷإͷੑผਪఆ
&NPUJPO/FU ਓؒͷإͷײ৘ਪఆ
)&% Τοδநग़
'PPE ྉཧͷࣝผ
0YGPSE Ֆͷछྨͷࣝผ
-PDBUJPO/FU ࣸਅͷࡱӨ஍ਪఆ
ͦͷଞͷެ։$PSF.-Ϟσϧ IUUQTHJUIVCDPNMJLFEBO"XFTPNF$PSF.-.PEFMT

ཁ݅ʹ߹͏΋ͷ͕ͳ͚Ε͹
➔ࣗ෼Ͱ$PSF.-ϞσϧΛੜ੒͢Δ

View Slide

ᶄ$PSF.-5PPMTʹΑΔม׵
܇࿅ࡁΈͷ
ػցֶशϞσϧ
1ZUIPO

View Slide

܇࿅ࡁΈͷ
ػցֶशϞσϧ
1ZUIPO

$PSF.-5PPMT
ม׵

View Slide

ᶃެ։͞Ε͍ͯΔ΋ͷΛ࢖͏
w$B⒎F.PEFM;PP
w5FOTPS'MPX.PEFMT
w.9/FU.PEFM;PP
ᶄࣗ෼Ͱ࣮૷ͯ͠܇࿅͢Δ
܇࿅ࡁΈͷ
ػցֶशϞσϧ
1ZUIPO

$PSF.-5PPMT
ม׵

View Slide

7JTJPO$PSF.-
͜͜·Ͱͷ·ͱΊ

View Slide

ը૾ೝࣝΛ࢖ͬͨΞϓϦͷ։ൃཁ݅ :&4
/0

View Slide

ը૾ೝࣝΛ࢖ͬͨΞϓϦͷ։ൃཁ݅
7JTJPOͰ࣮૷Մೳʁ ᶃ7JTJPOϑϨʔϜϫʔΫΛ࢖͏
:&4
/0

View Slide

࢖͑ͦ͏ͳֶशࡁΈ
$PSF.-Ϟσϧ͕͋Δʁ
ᶄֶशࡁΈ$PSF.-ϞσϧΛ࢖͏
:&4
/0

View Slide

࢖͑ͦ͏ͳ1ZUIPO࣮૷ͷ
ֶशࡁΈϞσϧ͕͋Δʁ
ᶅ$PSF.-5PPMTͰ
$PSF.-Ϟσϧʹม׵ͯ͠࢖͏
:&4
/0

View Slide

࣌ؒͱͱڭࢣσʔλͱ
Ϡϧؾ͸͋Δʁ
ᶅ$PSF.-5PPMTͰ
ᶆػցֶशͷίʔυΛ1ZUIPOͰ࣮૷
ˍ܇࿅ͯ͠ɺ$PSF.-5PPMTͰ
:&4
/0

View Slide

࣌ؒͱͱڭࢣσʔλͱ
Ϡϧؾ͸͋Δʁ
ᶅ$PSF.-5PPMTͰ
ᶆػցֶशͷίʔυΛ1ZUIPOͰ࣮૷
ˍ܇࿅ͯ͠ɺ$PSF.-5PPMTͰ
:&4
/0
➔ΞΠυϧإࣝผΞϓϦ

View Slide

ΞΠυϧإࣝผΞϓϦ
ͷ։ൃ

View Slide

શମઃܭ

View Slide

શମઃܭ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ

View Slide

શମઃܭ
ϑϨʔϜը૾औಘ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ

View Slide

શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ

View Slide

શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ

View Slide

શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
ϝϯόʔͷࣝผ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ

View Slide

͸ͳ͜
શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
ϝϯόʔͷࣝผ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ
ࣝผ݁Ռͷදࣔ

View Slide

͸ͳ͜
શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
ϝϯόʔͷࣝผ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ
ࣝผ݁Ռͷදࣔ
"7$BQUVSF

View Slide

͸ͳ͜
શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
ϝϯόʔͷࣝผ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ
ࣝผ݁Ռͷදࣔ
"7$BQUVSF
7JTJPO
7/%FUFDU'BDF3FDUBOHMFT3FRVFTU

View Slide

͸ͳ͜
શମઃܭ
ϑϨʔϜը૾औಘ
إͷݕग़
ϝϯόʔͷࣝผ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ
ࣝผ݁Ռͷදࣔ
"7$BQUVSF
7JTJPO
$PSF.-
ϝϯόʔإࣝผϞσϧ

View Slide

$PSF.-Λ༻͍ͨΞϓϦͷ
։ൃϑϩʔ
ᶃڭࢣσʔλ
ͷ४උ
ᶄϞσϧͷ
࣮૷
ᶅ܇࿅
ᶆֶशࡁΈ
Ϟσϧͷม׵
ᶇΞϓϦ΁ͷ
૊ΈࠐΈ

View Slide

ᶃڭࢣσʔλ
ͷ४උ
ᶄϞσϧͷ
࣮૷
ᶅ܇࿅
ᶆֶशࡁΈ
Ϟσϧͷม׵
ᶇΞϓϦ΁ͷ
૊ΈࠐΈ
ᶃϥϕϧ෇͖ڭࢣσʔλͷ४උ

View Slide

إը૾ͷऩू
wΫϩʔϥͰը૾Λऩू
wը૾ݕࡧ"1*ɺεΫϨΠϐϯά
w4DSBQZ IUUQTTDSBQZPSH

wΫϩʔϦϯάɾεΫϨΠϐϯά༻ϑϨʔϜϫʔΫ
wDTTηϨΫλΛͪΐΖͬͱॻ͚ͩ͘
wաෛՙ๷ࢭɺSPCPUTUYUΛߟྀͨ͠ྱّਖ਼͍͠ΫϩʔϦϯά

View Slide

$ scrapy runspider momospider.py
import scrapy
from crawler.items import MomoItem
class MomoSpider(scrapy.Spider):
name = "momo"
start_urls = [“https://momo.com/blog/“]
def parse(self, response):
image_url = response.css('#main #content .artwork img::attr(src-swap)').extract_first()
member_name = response.css('#title h1::text').extract_first()
item = MomoItem()
item['image_urls'] = [image_url]
item['member_name'] = member_name
return item

View Slide

લॲཧ
w0QFO$7Ͱͬ͘͟Γإ෦෼ͷ੾Γൈ͖
wඍົͳ܏͖΍ζϨ͕ਫ਼౓ʹӨڹΛ༩͑Δ
wը૾ճసɺ໨ඓޱͷҐஔ߹Θͤ
ࢀߟɿإೝࣝҐஔ߹Θͤͷॏཁੑ

View Slide

֤ϝϯόʔຕY
ຕͷڭࢣσʔλΛऩू

View Slide

֤ϝϯόʔຕY
ຕͷڭࢣσʔλΛऩू
ख࡞ۀͰ
ϥϕϧ෇͚ʂ
NBDͷ'JOEFSͰϑΝΠϧΛख࡞ۀͰ෼ྨ

View Slide

ᶃڭࢣσʔλ
ͷ४උ
ᶄϞσϧͷ
࣮૷
ᶅ܇࿅
ᶆֶशࡁΈ
Ϟσϧͷม׵
ᶇΞϓϦ΁ͷ
૊ΈࠐΈ
ᶄϞσϧͷ࣮૷

View Slide

ࣝผϞσϧ
ΞΠυϧإࣝผϞσϧ

View Slide

ࣝผϞσϧ
ೖྗɿY3(#ͷإը૾
ϥϕϧ෇͖ڭࢣը૾
͸ͳ͜
ೖྗ

View Slide

ࣝผϞσϧ
ϝϯόʔ ֬཰
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜
ਪ࿦
ग़ྗ֤ϝϯόʔͷ֬཰
͸ͳ͜
ೖྗ

View Slide

ࣝผϞσϧ
ϝϯόʔ ֬཰
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜
ਪ࿦
͸ͳ͜
ೖྗ
ɹֶश

View Slide

ࣝผϞσϧ
ϝϯόʔ ֬཰
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜
ਪ࿦
ˠը૾ͷଟΫϥε෼ྨ໰୊
͸ͳ͜
ೖྗ
ɹֶश

View Slide

ը૾ͷଟΫϥε෼ྨ໰୊
wը૾ೝࣝͷ෼໺Ͱ͸ϝδϟʔͳ໰୊
wσʔληοτ΍αϯϓϧ࣮૷΋ଟ਺ެ։͞
Ε͍ͯΔ
w৞ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣ
ग़యɿIUUQTXXXUFOTPSqPXPSHHFU@TUBSUFENOJTUCFHJOOFST
ग़యɿIUUQTXXXDTUPSPOUPFEVdLSJ[DJGBSIUNM

View Slide

৞ΈࠐΈχϡʔϥϧωοτϫʔΫ
ʢࡶͳઆ໌ʣ
ݩը૾

View Slide

ʢࡶͳઆ໌ʣ
ݩը૾ ϑΟϧλ

View Slide

ʢࡶͳઆ໌ʣ
ݩը૾ ϑΟϧλ
৞ΈࠐΈ

View Slide

ʢࡶͳઆ໌ʣ
ݩը૾ ϑΟϧλ
ಛ௃ͷநग़
৞ΈࠐΈ

View Slide

ʢࡶͳઆ໌ʣ
ݩը૾ ϑΟϧλ
ಛ௃ͷநग़
৞ΈࠐΈ ϓʔϦϯά

View Slide

ʢࡶͳઆ໌ʣ
ݩը૾ ϑΟϧλ
ಛ௃ͷநग़ ඍখͳҐஔมԽ
ʹର͢Δෆมੑ
Λ࣮ݱ
৞ΈࠐΈ ϓʔϦϯά

View Slide

ʢࡶͳઆ໌ʣ
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜

View Slide

ʢࡶͳઆ໌ʣ
৞ΈࠐΈ૚ɾϓʔϦϯά૚
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜

View Slide

ʢࡶͳઆ໌ʣ
৞ΈࠐΈ૚ɾϓʔϦϯά૚ શ݁߹૚
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜

View Slide

ʢࡶͳઆ໌ʣ
৞ΈࠐΈ૚ɾϓʔϦϯά૚ શ݁߹૚
ΕΈ
͸ͳ͜
͓͍͠
͋ʔΓͦ
΋΋͜
ˠϑΟϧλͷύϥϝʔλɺ݁߹ͷॏΈΛֶश

View Slide

ػցֶशϥΠϒϥϦ
w੍໿
w$PSF.-5PPMT͕αϙʔτ͍ͯ͠
Δ΋ͷΛબ୒͢Δ
wόʔδϣϯ΋ݫີʹ߹ΘͤΔ
➔,FSBT1ZUIPOΛ࠾༻

View Slide

,FSBT෇ଐͷαϯϓϧίʔυ DJGBS@DOOQZ
Λϕʔεʹ࣮૷

View Slide

ᶃڭࢣσʔλ
ͷ४උ
ᶄϞσϧͷ
࣮૷
ᶅ܇࿅
ᶆֶशࡁΈ
Ϟσϧͷม׵
ᶇΞϓϦ΁ͷ
૊ΈࠐΈ
ᶅ܇࿅

View Slide

Ϋϥ΢υ্Ͱͷֶश
w(16Ϛγϯ͸ඞਢ
w.#1$16Ͱ਺೔͔͔Δॲཧ͕(16
ͳΒ਺࣌ؒͰ͢Ή
w"84&$QεϙοτΠϯελϯε
wdIఔ౓
wڭࢣσʔλը૾͸Tʹ഑ஔ
4
FD

View Slide

؀ڥߏங
w"84%FFQ-FBSOJOH".*T
wIUUQTBXTBNB[PODPNKQBNB[POBJBNJT
w(16υϥΠό΍ґଘϥΠϒϥϦ͕ΠϯετʔϧࡁΈ
wىಈ͢Δ͚ͩͰʢ΄΅ʣ͙͢࢖͑Δ

View Slide

ֶश݁Ռ
ΤϙοΫֶश
ޙͷਫ਼౓
܇࿅σʔλ
ݕূσʔλ
ͪΌΜͱͨ͠άϥϑʹ͢Δ

View Slide

ᶃڭࢣσʔλ
ͷ४උ
ᶄϞσϧͷ
࣮૷
ᶅ܇࿅
ᶆֶशࡁΈ
Ϟσϧͷม׵
ᶇΞϓϦ΁ͷ
૊ΈࠐΈ
ᶆֶशࡁΈϞσϧͷม׵

View Slide

$PSF.-Ϟσϧ΁ͷม׵

View Slide

)%'
ܗࣜ
ɾωοτϫʔΫߏ଄
ɾֶशࡁΈͷॏΈ

View Slide

)%'
ܗࣜ
ɾωοτϫʔΫߏ଄
ɾֶशࡁΈͷॏΈ
1 import coremltools
2 coreml_model = coremltools.converters.keras.convert(
3 'model.h5'
4 input_names = 'image',
5 image_input_names = 'image',
6 class_labels = 'labels.txt')
7 coreml_model.save(‘idle_classifer.mlmodel’)

View Slide

$PSF.-Ϟσϧͷݕূ

View Slide

$PSF.-Ϟσϧͷݕূ
͸ͳ͜

View Slide

$PSF.-Ϟσϧͷݕূ
͸ͳ͜

͸ͳ͜

View Slide

$PSF.-Ϟσϧͷݕূ
͸ͳ͜

͸ͳ͜

ਖ਼͘͠ม׵Ͱ͖͍ͯΔ͜ͱ͕ݕূͰ͖ͨ

View Slide

$PSF.-Ϟσϧͷݕূ
1 import coremltools
2 img = load(‘hanako.png’)
3 model = coremltools.models.MLModel('Momomind.mlmodel')
4 res = model.predict(img)
5 print(res) # => ͸ͳ͜ 0.8888
͸ͳ͜

͸ͳ͜

ਖ਼͘͠ม׵Ͱ͖͍ͯΔ͜ͱ͕ݕূͰ͖ͨ

View Slide

$PSF.-5PPMT
IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
֤ϥΠϒϥϦ͝ͱͷ
ίϯόʔλʔ
1ZUIPO$PSF.- PONBD04

ؒͷόΠϯσΟϯά ίϯόʔλʔߏங༻"1*
w $PSF.-ϞσϧϑΥʔϚοτͷ࣮૷
w 9DPEFʹऔΓࠐΜͩࡍͷ*'ఆٛ

View Slide

ᶃڭࢣσʔλ
ͷ४උ
ᶄϞσϧͷ
࣮૷
ᶅ܇࿅
ᶆֶशࡁΈ
Ϟσϧͷม׵
ᶇΞϓϦ΁ͷ
૊ΈࠐΈ
ᶇΞϓϦ΁ͷ૊ΈࠐΈ

View Slide

͸ͳ͜
෦඼͸ἧͬͨ
ϑϨʔϜը૾औಘ
إͷݕग़
ϝϯόʔͷࣝผ
Χϝϥө૾ͷ
ϓϨϏϡʔදࣔ
ݕग़ͨ͠إҐஔʹ
࿮Λදࣔ
ࣝผ݁Ռͷදࣔ
"7$BQUVSF
7JTJPO
$PSF.-
ϝϯόʔإࣝผϞσϧ

View Slide

ϑϨʔϜը૾औಘˍϓϨϏϡʔදࣔ
let session = AVCaptureSession()
let device = AVCaptureDevice.default(for: AVMediaType.video)!
let deviceInput = try! AVCaptureDeviceInput(device: device)
session.addInput(deviceInput)
let previewLayer = AVCaptureVideoPreviewLayer(session: session)
view.layer.insertSublayer(previewLayer, at: 0)
let queue = DispatchQueue(label: “xxx")
let output = AVCaptureVideoDataOutput()
output.setSampleBufferDelegate(self, queue: queue)
session.addOutput(output)
func captureOutput(..., didOutput sampleBuffer: CMSampleBuffer, ..) {
let buffer: CVImageBuffer = CMSampleBufferGetImageBuffer(sampleBuffer)
...
}
ᶃΧϝϥೖྗ
ᶄϓϨϏϡʔදࣔ
ᶅΩϟϓνϟग़ྗ
ᶆϑϨʔϜը૾औಘ

View Slide

إҐஔݕग़
let buffer: CVImageBuffer = ...
let inputImage = CIImage(cvImageBuffer: buffer)
//ᶃإۣܗऔಘϦΫΤετ
let handler = VNImageRequestHandler(ciImage: inputImage)
handler.perform([
VNDetectFaceRectanglesRequest(completionHandler: { (req, err) in
//ᶄإۣܗͷऔಘ
let req = request as! VNDetectFaceRectanglesRequest,
let faces = req.results as! [VNFaceObservation],
let face = faces.first.boundingBox,
let rect = face.boundingBox,
//ᶅإ෦෼ͷ੾Γൈ͖
let faceImage: CIImage = cropImage(from inputImage, rect: rect)

View Slide

إࣝผ
//ᶃֶशࡁΈCoreMLϞσϧͷϩʔυ
let idleClassifier = IdleClassifier()
let model = VNCoreMLModel(for: idleClassifier.model)
//ᶄVision+CoreMLͰਪ࿦Λ࣮ߦ
let image: CIImage = ...
let handler = VNImageRequestHandler(ciImage: image)
try handler.perform([
VNCoreMLRequest(model: model) {(req, err) in
//ᶅࣝผ݁Ռͷऔಘ
let res = req.results!.first as! VNClassificationObservation
let name = res.identifier
let probability = Int(res.confidence * 100)
print(“ࣝผ݁Ռ \(name):\(probability)%”)

View Slide

׬੒ʁ
͸ͳ͜

View Slide

੒௕ʹΑΔإͷมԽ

View Slide

ܧଓతͳ
ࣝผਫ਼౓ͷ޲্

View Slide

ڭࢣσʔλͷ֦ॆ

View Slide

ޡݕ஌ͷใࠂػೳ
4
ͷͷ͔
إը૾ʴਖ਼ղϥϕϧ
͸ͳ͜
໰୊Λใࠂ
ਖ਼ղΛ͓͍͑ͯͩ͘͠͞
ͷͷ͔c
ૹ৴

View Slide

IUUQNPNPNJOELFONB[OFU
4
͋ʔΓͦ
ޡݕ஌ͷใࠂػೳʢϒϥ΢β൛ʣ
إը૾ʴਖ਼ղϥϕϧ

View Slide

ΫϩʔϥʔʹΑΔܧଓతͳऩू
ˍԾϥϕϧ͚ͮ
4
Ϋϩʔϥʔ
ਪ࿦ˍԾϥϕϧ෇͚
खಈ֬ೝˍमਖ਼
΋΋͜
إը૾ʴʢԾͷʣਖ਼ղϥϕϧ

View Slide

͸ͳ͜
໰୊Λใࠂ
ϥϕϧ෇͖ڭࢣσʔλͷ֦ॆ

View Slide

͸ͳ͜
໰୊Λใࠂ
࠶ֶश

View Slide

͸ͳ͜
໰୊Λใࠂ
࠶ֶश
ʁ

View Slide

͸ͳ͜
࠶ੜ੒ͨ͠Ϟσϧͷಈతஔ׵
μ΢ϯϩʔυ
NMNPEFM
NMNPEFMD
class MLModel {
class func compileModel(at modelURL: URL) throws -> URL
ίϯύΠϧ
୺຤಺
JOPVUͷ࢓༷มߋͳͲ
☓
ࢀߟɿ)PUTXBQQJOH$PSF.-NPEFMTPOUIFJ1IPOF

View Slide

͸ͳ͜
໰୊Λใࠂ
࠶ֶश

View Slide

͸ͳ͜
໰୊Λใࠂ
࠶ֶश
$PSF.-Ϟσϧͷ
࠶ੜ੒ˍಈతஔ׵

View Slide

͸ͳ͜
໰୊Λใࠂ
࠶ֶश
$PSF.-Ϟσϧͷ
࠶ੜ੒ˍಈతஔ׵
ਫ਼౓޲্ͷϧʔϓ͕ॏཁ

View Slide

ΞϧΰϦζϜͷվળ
w ຊτʔΫͷൣᙝ֎
w ೔ʑΞϧΰϦζϜ΍ςΫχοΫ͕ൃද͞Ε͍ͯΔ
w ΩϟονΞοϓͯ͠ΈΔ
w 2JJUBUBHTػցֶश
w BS9JW$PNQVUFS7JTJPOBOE1BUUFSO3FDPHOJUJPO

View Slide

Ԡ༻

View Slide

࣮ݧத
ෆద੾ը૾ϦΞϧλΠϜݕ஌
Ϣʔβʔ͔Β௨ใ͞Εͨෆద੾ը૾
ΠϥετΛඳըதʹ
ϦΞϧλΠϜʹ
ෆద੾ը૾Λݕग़
IUUQBOJNFLFONB[OFU
IUUQDIJOLPDIFDLFSLFONB[OFU
5FOTPSqPXͰݸਓαʔϏεʹΞοϓϩʔυ͞Εͨෆద੾ͳΠϥετը૾Λݕग़͢Δ
"OJNF.BLFS J04ΞϓϦ"OESPJEΞϓϦ

ෆద੾ͳඳࣸ
͸΍Ί·͠ΐ͏

View Slide

࣮ݧத
ࣗಈண৭ϚϯΨϏϡʔϫ
ը૾ग़యɿΏΊΈΔΏͼ͖͞ϚϯΨϘοΫεΠϯσΟʔζ
("/
(FOFSBUJWF"EWFSTBSJBM/FUXPSLTBS9JW

View Slide

࣮ݧத
࿝؟޲͚ϚϯΨϏϡʔϫ
ը૾ग़యɿ࿀ͱӕʢӳޠ൛ʣϚϯΨϘοΫε
w 7JTJPO"1*

View Slide

ΞΠσΞ࣍ୈʁ
wͳ෦෼΋͋Δ
wॳظJ1IPOFΞϓϦ։ൃϒʔϜͷࠒʹΑ͘ࣅͯΔʁ
wཧ࿦͸೉͍͕͠ɺָ͍͠

View Slide

·ͱΊ
w7JTJPO$PSF.-Ͱը૾ೝࣝɾػցֶशٕज़
Λ࢖ͬͨΞϓϦͷ։ൃϋʔυϧ͕Լ͕ͬͨ
wܧଓతͳਫ਼౓ͷ޲্ͷͨΊͷ؀ڥͮ͘Γ΋ॏཁ
wΞΠσΞ࣍ୈͰՄೳੑ͕޿͕Δ
wͨͩ͠ػցֶशͷجૅ஌ࣝ΋΍͸Γॏཁ

View Slide

ػցֶशʹαΠΤϯςΟετ͚ͩͷ΋ͷ
ͬͯ͜ͱ͸·ͬͨ͘ͳ͍ʂ

View Slide

DIBMMFOHF

View Slide

ࢀߟจݙ
w ͍Β͢ͱ΍ʮΞΠυϧʯͷݕࡧ݁Ռ
w .BDIJOF-FBSOJOH"QQMF
w ਂ૚ֶश%FFQ-FBSOJOHʢۙ୅Պֶࣾʣ
w ਂ૚ֶशʢػցֶशϓϩϑΣογϣφϧγϦʔζʣ
w θϩ͔Β࡞Δ%FFQ-FBSOJOH
w 5FOTPSqPXCFHJOOFST
w DJGBS
w ("/
(FOFSBUJWF"EWFSTBSJBM/FUXPSLTBS9JW
w )PUTXBQQJOH$PSF.-NPEFMTPOUIFJ1IPOF
w إೝࣝҐஔ߹Θͤͷॏཁੑ

View Slide

CoreMLでアイドル顔認識アプリを作ろう

CoreMLでアイドル顔認識アプリを作ろう

kenmaz

More Decks by kenmaz

Other Decks in Programming

Featured

Transcript