Haskell All the Way Down - HaskellSG

Transcript

1. Haskell SG - 2015-05-06 ▪ Arnaud Bailly ▪ arnaud@capital-match.com ▪ http://www.capital-match.com ▪ @abailly 1 Haskell All the Way Down Building a startup using Haskell
2. Haskell SG - 2015-05-06 Agenda ▪ Who/Why/What ▪ How we use Haskell ▪ The Good, the Bad and the Ugly ▪ Future work ! This is not a Monad tutorial…. 2
3. Haskell SG - 2015-05-06 Who? What? Why? 3
4. Haskell SG - 2015-05-06 Who? ▪ Pawel Kuznicki – CEO, ex-Rocket, ex-McKinsey, ex-Zalora ▪ Kevin Lim – CFO, ex-JPMorgan, ex-SCB ▪ Arnaud Bailly – 20+ years experience, mostly Java for food, discovered Haskell in 2001 ▪ Willem van den Ende ▪ 20+ years experience, XP since the beginning, Smalltalk/Clojure/.Net… 4
5. Haskell SG - 2015-05-06 ! What? Marketplace Lending! ~S$32,400 repayment in 1 year Bank P2P lending Bank n lenders n deposits = S$30,000
 @ 1.5% interest rate SME(borrower) S$30,000 loan @ 8% ~S$30,450 repayment in 1 year Return of 6.5% or S$1,950 ~S30,500 or 1.5% RETURN 5 Capital Match Lender 1 Lender 2 Lender 3 SME(borrower) Loan syndication on behalf of the lenders S$30,000 loan @ 6.3% 1%+ underwriting fee = S $300-400 S$5,000 loan @ 7% S$5,000 loan @ 7% S$20,000 loan @ 6% ~S$31,900 repayment in 1 year ~S$31,500 repayment 20% commission on returns = S$400 ~S20,960 or 4.8% ~S$5,280 or 5.6% ~S$5,280 or 5.6% 1% provisional fund = S$300 Provis. Fund
6. Haskell SG - 2015-05-06 Why Haskell? ▪ Pawel had very good experience working with Haskell developers at previous job ▪ He posted job offer on http://functionaljobs.com ▪ I wanted to do some real stuff in Haskell ▪ I had good experience working for people in Singapore ▪ It seemed fun! Let’s do it! 6
7. Haskell SG - 2015-05-06 System Overview 7
8. Haskell SG - 2015-05-06 Application Architecture 8
9. Haskell SG - 2015-05-06 How we use Haskell? 9
10. Haskell SG - 2015-05-06 For (Nearly) Everything! ▪ Dev. Env ⟶ ghc-mod, stylish-haskell ▪ Web Backend ⟶ Scotty, Blaze ▪ Database ⟶ Custom Event Sourcing ▪ Unit/Integration Testing ⟶ HSpec, QuickCheck ▪ End-to-End Testing ⟶ hs-webdriver ▪ Build ⟶ Cabal, Shake ▪ CI Server ⟶ Bake ▪ Configuration Management ⟶ Propellor 10
11. Haskell SG - 2015-05-06 For the rest… ▪ Web Front-end ⟶ Om/Clojurescript ▪ Version Control ⟶ Git (what else?) ▪ Packaging & Deployment ⟶ Docker (because we can) ▪ Infrastructure ⟶ DigitalOcean / S3 ▪ Monitoring ⟶ Riemann, collectd (WIP) 11
12. Haskell SG - 2015-05-06 Emacs Dev. Envt. 12 Compilation FlyCheck HLint Autocompletion
13. Haskell SG - 2015-05-06 Scotty: REST Endpoints 13
14. Haskell SG - 2015-05-06 Scotty: Middleware 14
15. Haskell SG - 2015-05-06 Blaze: Template HTML 15
16. Haskell SG - 2015-05-06 HSpec: Integration Tests 16
17. Haskell SG - 2015-05-06 QuickCheck 17
18. Haskell SG - 2015-05-06 hs-webdriver: ETE Testing 18
19. Haskell SG - 2015-05-06 Shake: Better make 19
20. Haskell SG - 2015-05-06 Bake: CI 20
21. Haskell SG - 2015-05-06 Propellor: Config Mgt. 21
22. Haskell SG - 2015-05-06 The Good, the Bad and the Ugly 22
23. Haskell SG - 2015-05-06 The Good ▪ Safer programming (shines in comparison with front-end dev) thanks to typing and compilation ▪ Types really help a lot: Documentation, intention, design, checking… ▪ Libraries and tools are most often good or very good even when in “beta" or “alpha" (e.g. bake) ▪ Nice and supportive maintainers and community ▪ We feel productive and confident to ship haskell code: Static Typing + Tests Rock! 23
24. Haskell SG - 2015-05-06 The Good (contd.) ▪ Refactoring is easier: Change a type and fix compiler’s errors ▪ Good for hiring: Haskell attracts “interesting" people ▪ Very easy to replace clunky scripts with typesafe and compiled DSL 24
25. Haskell SG - 2015-05-06 The Bad ▪ Cabal – but does its job, no binary packages possible and there is Shake for funky stuff – it is improving (e.g. Stackage) ▪ Dev. Env. is still not on par with Eclipse/IntelliJ/VS – but FPComplete and others are making progress fast and tooling improves ▪ Compilation typing errors – but you get accustomed to it once your code base is stable 25
26. Haskell SG - 2015-05-06 The Bad (contd.) ▪ Hiring: Hard to do if you require local people, Haskell communities are usually small. Be prepared to work remotely ▪ Can get pretty abstract pretty quickly… – pair programming and peer reviews to the rescue! 26
27. Haskell SG - 2015-05-06 The Ugly ▪ String vs. Data.Text vs. Data.Text.Lazy vs. – ⟶ Oh My! Haskell is Old! ▪ Runtime error reporting – ⟶ No Stack Traces! ▪ Aeson deserialization errors – ⟶ Cryptic No Parse ▪ Conflicting GHC versions/Libs requirements ▪ Lazy I/O can bite you 27
28. Haskell SG - 2015-05-06 Future Work 28
29. Haskell SG - 2015-05-06 Platform ▪ Replace clojurescript with Haskell based React bindings ⟶ ghcjs ▪ Generate CSS ⟶ Clay ▪ Replace Scotty with Servant for typesafe routes ▪ Improve End-to-End testing ▪ Performance and resilience testing ⟶ jepsen ▪ Distributed micro-services ⟶ Raft, Cloud Haskell 29
30. Haskell SG - 2015-05-06 Tooling ▪ Improve CI: – handle multiple branches, parallel builds, better reporting ▪ Improve configuration management – replace scripts w/ Haskell code for provisioning, better propellor configs ▪ Better containers builds and orchestration 30
31. Haskell SG - 2015-05-06 Credit Risk Analysis ▪ Build a database and inference engine to better automate Credit Risk Assessment process – NLP, ML, Big Data… 31
32. Haskell SG - 2015-05-06 32 We are hiring! \ http://functionaljobs.com/jobs/8802-full-stack-software-engineer-at-capital-match
33. Haskell SG - 2015-05-06 Questions? 33