On-demand image server with Python

This is about on-demand image server, the "fitter'

Transcript

1. On-demand image server with Python MinJae Kwon (@mingrammer) 2017.05.27 Python Seminar
2. Name ӂ޹੤ (MinJae Kwon) Nickname @mingrammer Email k239507@gmail.com Who ই઱؀೟Ү ࣗ೐౟ਝয೟җ 3೟֙ / Backend Developer Blog https://mingrammer.com Facebook https://facebook.com/mingrammer Github https://github.com/mingrammer Eng Blog https://medium.com/@mingrammer
3. 2. ѐߊ زӝ 5. दաܻয় 3. рױೠ ইఃఫ୊ Contents 6. Next & Future 1. ৡ٣ݔ٘ ੉޷૑ ࢲߡ? 4. ݽٕ ҳഅ୓
4. ৡ٣ݔ٘ ੉޷૑ ࢲߡ?
5. ৡ٣ݔ٘ ੉޷૑ ࢲߡ? Image Server image resized thumbnail rotated
6. ৡ٣ݔ٘ ੉޷૑ ࢲߡ? Image Server image resized thumbnail rotated User Service desired parameters new image
7. ৡ٣ݔ٘ ੉޷૑ ࢲߡ? ੉޷૑ܳ ޷ܻ ࢤࢿ೧ف૑ ঋইب ؽ ਗೡٸ ׮নೠ ഋక੄ ੉޷૑ܳ ৡ٣ݔ٘۽ ࢤࢿ оמ ੢੼
8. ৡ٣ݔ٘ ੉޷૑ ࢲߡ? ੉޷૑ܳ ࢎਊೞח Ѣ੄ ݽٚҔ ׮নೠ ࢎ੉ૉ੄ ੉޷૑о ೙ਃೠ ݽ߄ੌ জ ੉޷૑ ӝ߈ ࢲ࠺झ ੸ਊ оמೠ ࢲ࠺झ
9. ѐߊ زӝ
10. ѐߊ زӝ 1. ഥࢎীࢲ ٣੗੉ցо ੉޷ ٜ݅য֬਷ ੉޷૑ ࢎ੉ૉ੄ ߸҃੉ ೙ਃ 2. ੉޷૑ ਗࠄਸ о૓ ٣੗੉ցীѱ ࢎ੉ૉ ߸҃ ਃ୒੉ ೙ਃ 3. рױೠ ੘সੋ Ѫী ࠺೧ ࣗਊغח ࠺ਊ੉ ֫਺ 4. ٜ݅੗!
11. ѐߊ زӝ ߈ա੺݅ী ٜ݅Ҋ ׮਺ ಁ஖ٸ ੸ਊ ੉޷૑ ܻࢎ੉૚ ੗زച۽ ੋ೧ ࢕੉ ખ ؊ աই૗
12. ѐߊ زӝ ׼द ഥࢎীࢲ ೙ਃೠ ੉޷૑ ܻࢎ੉૚ ӝמ਷ ੉޷૑ ࠺ਯ݅ ਬ૑೧ࢲ “width”݅ ઑ੺ೞҊ நयೞח ӝמ ٯ ೞա But
13. ѐߊ زӝ ખ ؊ ਬোೠ য়೑ࣗझ ৡ٣ݔ٘ ੉޷૑ ࢲߡܳ ٜ݅যࠁ੗ https://github.com/mingrammer/fitter
14. рױೠ ইఃఫ୊
15. рױೠ ইఃఫ୊ API Server API server for fitter
16. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Parse the customizable configuration
17. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Manage storage
18. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Supports source/store storages Source Store
19. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Supports file system and s3 Source Store s3 fs
20. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Source Store s3 fs Engine Processing the transforming
21. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Source Store s3 fs Engine Thumbnail Flip Resize Rotate Various mode
22. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Source Store s3 fs Engine Thumbnail Flip Resize Rotate Cache Server Caching the generated image
23. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Source Store s3 fs Engine Thumbnail Flip Resize Rotate Cache Server Cache Store Manage the cache store
24. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Source Store s3 fs Engine Thumbnail Flip Resize Rotate Cache Server Cache Store in-memory redis Supports in-memory and redis
25. рױೠ ইఃఫ୊ API Server Configuration Parser Fitter Configuration Storage Source Store s3 fs Engine Thumbnail Flip Resize Rotate Cache Server Cache Store in-memory redis Paramter Validator Validate the parameters
26. рױೠ ইఃఫ୊ API Server Configuration Parser Storage Engine Cache Server Cache Store Paramter Validator
27. рױೠ ইఃఫ୊ API Server flask Configuration Parser pyyaml Storage boto3 requests Engine wand Cache Server Cache Store redis-py Paramter Validator Python Fullstack
28. ݽٕ ҳഅ୓
29. ݽٕ ҳഅ୓ ۨನ૑షܻ ҳࢿ
30. ݽٕ ҳഅ୓ API Server Optional URL for Flask? Pre-registered Not pre-registered
31. ݽٕ ҳഅ୓ API Server Optional URL for Flask?
32. ݽٕ ҳഅ୓ Config parsing - Using common classes
33. ݽٕ ҳഅ୓ Config parsing Load Config Parsing & Validating Check Cache Show errors invalid or failed valid
34. ݽٕ ҳഅ୓ Config parsing - Load and validate the required fields
35. ݽٕ ҳഅ୓ Config parsing - Load and validate the required fields and set the configs
36. ݽٕ ҳഅ୓ Config parsing - Load and validate the required fields
37. ݽٕ ҳഅ୓ Params validator Request Validate Params Handling Show errors invalid valid
38. ݽٕ ҳഅ୓ Params validator - Validate all params and restriction of each mode
39. ݽٕ ҳഅ୓ Params validator - Validate the all params before view handling using decorator
40. Double caching? ݽٕ ҳഅ୓ Check Cache Server Check Store Storage Generate Use cached Use cached exists exists not not
41. Double caching? - Use decorators!! Decorator is love ݽٕ ҳഅ୓
42. Double caching? - Use decorators!! Decorator is love ݽٕ ҳഅ୓
43. How to use different classes on same function? ݽٕ ҳഅ୓ Stroage S3 File System Cache Store Source Store Source Store In memory Redis class … class … class … class … class … class …
44. How to use different classes on same function? - Use Interface-like class ݽٕ ҳഅ୓
45. How to use different classes on same function? - Use Interface-like class ݽٕ ҳഅ୓
46. How to use different classes on same function? - Use Interface-like class ݽٕ ҳഅ୓ Two types are totally different but they have same interfaces!
47. There is very-simple engine - Just wrapping the each mode. Common interface :D ݽٕ ҳഅ୓
48. We are the world - Combine these modules! ݽٕ ҳഅ୓ Validate Params Cache Interface Storage Interface Storage Interface Parsing Config Transform Interface Check Cache Store Check Storage Transform Engine Handle Storage
49. दաܻয়
50. दաܻয় 1. ۽ஸ ӝ߈ ੉޷૑ ߸ജ ో 2. ੉޷૑ ߸ജ ߂ ௿ۄ਋٘ ߔস ో 3. ߔূ٘ ৡ٣ݔ٘ ੉޷૑ ࢲߡ
51. दաܻয় 1. ۽ஸ ӝ߈ ੉޷૑ ߸ജ ో 2. ੉޷૑ ߸ജ ߂ ௿ۄ਋٘ ߔস ో 3. ߔূ٘ ৡ٣ݔ٘ ੉޷૑ ࢲߡ
52. दաܻয় நद ࢲߡ ࢸ੿ झషܻ૑ ࢸ੿ ২࣌ ࢸ੿
53. दաܻয় fitter ࢲߡ ҳز
54. दաܻয় ੉޷૑ ߸ജ ਃ୒ Wallpaper/squares_widew.png ੉޷૑ܳ 200 x 300ਵ۽ ߸ജ resize
55. दաܻয় What is ‘get’? show : Retrieve the image information asynchronously (not yet)
 get : Retrieve the image information synchronously redirect : Redirect to url of transformed image
56. दաܻয় ਃ୒ റ ߈ജч
57. दաܻয় நद ࢲߡ (Redis) ഛੋ
58. दաܻয় S3 ߡఉ நद ٣۩షܻ ഛੋ
59. दաܻয় ੉޷૑ ߸ജ Ѿҗ ഛੋ 2880 x 1800 200 x 300
60. दաܻয় IT WORKS GOOD THING
61. Next & Future
62. Next & Future 1. In memory நद झషয ૑ਗ 2. ࠺زӝ ୊ܻ ૑ਗ (Celery) 3. স۽٘ ߂ ৻ࠗ ੉޷૑ ୊ܻ ૑ਗ 4. ୶о ২࣌ (Size, Prefix, Shard ١) ૑ਗ 5. ੉޷૑ ୊ܻ ঘ࣌ ୶о (Crop ١) 6. ࢸ੿/प೯ਊ fitter CLI ઁҕ 7. ۽ஸ ߸ജోਊ ௑ࣛ ઁҕ 8. పझ౟ ௏٘ ੘ࢿ 9. ޙࢲച 10. ٣೒۽੉ ೐۽ࣁझ ઁҕ (Pluggable Service)
63. хࢎ೤פ׮ MinJae Kwon (@mingrammer) 2017.05.27 Python Seminar On-demand image server with Python