Data Science for Live Music

Presentation by Phil Cowans Chief Architect @Songkick at Data Science London 28/05/12

Transcript

1. 'DWD6FLHQFHIRU/LYH 0XVLF 3KLO&RZDQV SKLO#VRQJNLFNFRP
2. 7UDFN\RXUIDYRULWH DUWLVWVDQGQHYHUPLVV WKHPOLYH
3. :KR:H$UH Ɣ 7KHVHFRQGODUJHVWOLYHPXVLFZHEVLWH ZRUOGZLGH Ɣ (DVW/RQGRQEDVHGVWDUWXSKHOSLQJSHRSOH VHHPRUHOLYHPXVLF Ɣ )RXQGHGLQE\WKUHHPXVLFIDQVQRZ DWKLUW\VWURQJWHDPDQGJURZLQJIDVW Ɣ ,QYHVWPHQWIURP<&RPELQDWRU,QGH[ 9HQWXUHVDQG6HTXRLD&DSLWDO
4. $QG:KR,$P Ɣ 6RQJNLFN VILUVW&72QRZ&KLHI$UFKLWHFW DQGKHDGRIWKHQDVFHQWGDWDVFLHQFHWHDP Ɣ 3K'LQPDFKLQHOHDUQLQJDW&DPEULGJH Ɣ 3UHGLFWLYHWH[WHQWU\ Ɣ 6WDWLVWLFDOODQJXDJHPRGHOV%D\HVLDQ DSSURDFKHVVHDUFKUDQNLQJHWF Ɣ DQGDOVRZHEGHYHORSPHQWDWVFDOH VRIWZDUHDUFKLWHFWXUHVRIWZDUHHQJLQHHULQJ PHWKRGRORJ\HWF
5. VLWHGHPR
6. (PDLODQG0RELOH$OHUWV 6RQJNLFN:HE 0RELOH$SSV $QG0DQ\2WKHU3DUWQHUV 7LFNHW9HQGRUV ,QGXVWU\)HHGV :HE6FUDSLQJ 8VHU*HQHUDWHG&RQWHQW
7. 6RQJNLFN$3, Ɣ 5(67IXO-621;0/FDOOVRYHU+773 Ɣ 0RVWSXEOLFGDWDDYDLODEOHRQWKH$3,ZH UH LPSURYLQJLWDOOWKHWLPH Ɣ 'DWDLQJHVWLRQYLDDVWDQGDUG;0/IRUPDWLI \RXZDQWWREHDGDWDVRXUFH Ɣ 2$XWKDXWKHQWLFDWLRQDYDLODEOHIRU LQWHUDFWLRQDVDXVHUQRW\HWGRFXPHQWHG VRDVNPHLI\RXZDQWWRXVHLW Ɣ 1RQFRPPHUFLDONH\VIRUDOODQGZH GORYHWR WDON%'LI\RXKDYHDFRPPHUFLDODSSOLFDWLRQ LQPLQG
8. GHYVLWHGHPR
9. 2XU'DWD Ɣ XSFRPLQJHYHQWVZRUOGZLGH Ɣ aSDVWHYHQWVGDWDEDFNWRWKH VVSDQQLQJWKHFDUHHUVRIPDQ\PDMRU DQGPLQRU DUWLVWV Ɣ $UWLVWDQGYHQXHPHWDGDWD Ɣ 3KRWRJUDSKVSRVWHUVYLGHRVVHWOLVWV Ɣ 8VHUWDVWHGDWDXSFRPLQJSODQVDQGSDVW DWWHQGDQFH Ɣ :HEDQDO\WLFVSURGXFWORJVHWF
10. 7KH/LYH0XVLF,QGXVWU\,V%URNHQ Ɣ 8SWRKDOIRIDOOOLYHWLFNHWVJRXQVROG Ɣ )HVWLYDOVJHWFDQFHOOHGGXHWRODFNRI GHPDQG Ɣ EXWZHDOOVWLOOPLVVVKRZVEHFDXVHZH GLGQ WILQGRXWVRRQHQRXJK Ɣ 0XFKRIWKHLQGXVWU\LVEHKLQGWKHFXUYH ZKHQLWFRPHVWRPDNLQJV\VWHPDWLFXVHRI GDWD Ɣ VRSOHQW\RIRSSRUWXQLWLHVIRUXV
11. 'DWD&KDOOHQJHVDW 6RQJNLFN
12. 'DWD,QJHVWLRQ Ɣ 3XOOGDWDIURPWLFNHWYHQGRUVLQGXVWU\IHHGV RXUXVHUVZHEVFUDSHUVHWF Ɣ &OHDQXSZKDWFDQEHYHU\PHVV\GDWDWRD VWDQGDUGVXLWDEOHIRUDOHUWV GRWKH\UHDOO\ PHDQ&ROGSOD\" Ɣ 'DWDUHFRQFLOLDWLRQGXSOLFDWHGHWHFWLRQ JHRORFDWLRQHWF Ɣ 6XSSRUWIRUPDQXDOPRGHUDWLRQLIQHFHVVDU\ Ɣ 6RXUFHVKDYHGLIIHUHQWOHYHOVRIWUXVW GHVWLQDWLRQVKDYHGLIIHUHQWWROHUDQFHVIRU HUURU
13. $OHUWLQJ)DQV Ɣ %XLOGWDVWHSURILOHVIRURXUXVHUVIURPWKHLU PXVLFFROOHFWLRQV)DFHERRNSURILOHV6SRWLI\ GDWDHWF Ɣ 0DWFKLQJWDVWHSURILOHVWRLQFRPLQJHYHQWV Ɣ 6HQGDOHUWVRQDWLPHO\EDVLVSHUVRQDOL]H WKHZHEXVHUH[SHULHQFHHWF Ɣ 1HHGVWRZRUNDWVFDOHORWVRIXVHUVQHHG WREHWROGTXLFNO\DERXWQHZVKRZV Ɣ /RWVRIURRPWRH[SHULPHQWZLWKPRUH VRSKLVWLFDWHGWDVWHPRGHOVXVLQJVRFLDOGDWD HWF0RUHGDWDEHFRPLQJDYDLODEOH
14. 8QGHUVWDQGLQJ2XU8VHUV Ɣ 3URGXFWDQDO\WLFVDFURVVPXOWLSOHSODWIRUPV ZHEPRELOH)DFHERRN$3,XVDJHHWF Ɣ $JJUHJDWHWDVWHSURILOHV Ɣ DOORSSRUWXQLWLHVWRSURYLGHDEHWWHUXVHU H[SHULHQFH
15. 8QGHUVWDQGLQJ7KH,QGXVWU\ Ɣ /RWVRIGDWDIRUERWKVXSSO\DQGGHPDQG ZH UHLQDEHWWHUSRVLWLRQWKDQPRVWWRXVH WKLVWRPDNHWKHLQGXVWU\ZRUNEHWWHU Ɣ )LQGLQJPLVVHGRSSRUWXQLWLHVIRUVKRZV Ɣ +HOSLQJJHWWKHYHQXHULJKW Ɣ ,PSURYLQJWKHORJLVWLFVRIUXQQLQJDWRXU Ɣ $QGPXFKPRUH
16. :KHUH:H$UH1RZ Ɣ 6RPHRIWKLV DOHUWVGDWDLQJHVWLRQ KDYH ORQJEHHQDELJSDUWRIZKDWZHGR Ɣ 2WKHUSDUWV LQGXVWU\DQDO\WLFV VWLOOYHU\ PXFKUDPSLQJXS Ɣ 0XFKRIRXUGHYHORSPHQWHIIRUWFXUUHQWO\ IRFXVHGRQGDWD Ɣ %XWWKHUH VURRPIRUDORWPRUHJHWLQWRXFK LI\RXZDQWWRKHOSXV
17. 7KDQNV 3KLO&RZDQV SKLO#VRQJNLFNFRP