Text-Denoising mit Go(lang)

Der Beispiel-Code ist zu finden unter: https://github.com/HorstMumpitz/bedcon2015

Transcript

1. Text-Denoising
 mit Go(lang) Bedcon 2015 – Dennis Kluge – Charité Berlin
2. dataflex-science.de
3. Berlin Expert Days 2015 | Dennis Kluge | Slide 3
4. Berlin Expert Days 2015 | Dennis Kluge | Folie 4
5. NLP Natural Language Processing Berlin Expert Days 2015 | Dennis Kluge | Slide 5
6. ?
7. Die @bedcon ist die großartigste #Konferenz des Jahres. 
 http://bedcon.org Berlin Expert Days 2015 | Dennis Kluge | Slide 7
8. Die bedcon ist die großartigste Konferenz des Jahres Berlin Expert Days 2015 | Dennis Kluge | Slide 8
9. die bedcon ist die großartigste konferenz des jahres Berlin Expert Days 2015 | Dennis Kluge | Slide 9
10. [“di”, “ie”, “e_”, “_b”, “be”, “ed”…] Berlin Expert Days 2015 | Dennis Kluge | Slide 10
12. GO(LANG) • 2009 - erschienen … 2012 - Version 1.0 • kompiliert, stark typisiert, imperativ, strukturiert • optimiert für Nebenläufigkeit • Garbage Collection • C angelehnte Syntax Berlin Expert Days 2015 | Dennis Kluge | Slide 12
13. STRINGS • Go source code is always UTF-8. • A string holds arbitrary bytes. • A string literal, absent byte-level escapes, always holds valid UTF-8 sequences. • Those sequences represent Unicode code points, called runes. • No guarantee is made in Go that characters in strings are normalized. • https://blog.golang.org/strings Berlin Expert Days 2015 | Dennis Kluge | Slide 13
14. Berlin Expert Days 2015 | Dennis Kluge | Slide 14
15. Boolean, Numeric, 
 String, Array, Slice, 
 Map, Interface, Map, Channel Berlin Expert Days 2015 | Dennis Kluge | Slide 15
16. Berlin Expert Days 2015 | Dennis Kluge | Slide 16
17. Type Inference Berlin Expert Days 2015 | Dennis Kluge | Slide 16
18. Berlin Expert Days 2015 | Dennis Kluge | Slide 17
19. Berlin Expert Days 2015 | Dennis Kluge | Slide 18
20. Package Berlin Expert Days 2015 | Dennis Kluge | Slide 19
21. Berlin Expert Days 2015 | Dennis Kluge | Slide 20
22. Großbuchstabe deklariert public Berlin Expert Days 2015 | Dennis Kluge | Slide 21
23. Berlin Expert Days 2015 | Dennis Kluge | Slide 22
24. C-Style Berlin Expert Days 2015 | Dennis Kluge | Slide 23
25. Berlin Expert Days 2015 | Dennis Kluge | Slide 24
26. Berlin Expert Days 2015 | Dennis Kluge | Slide 25
27. • mathiasbynens.be/demo/url-regex • stackoverflow.com/questions/161738/what-is-the-best-regular- expression-to-check-if-a-string-is-a-valid-url MATCHING URLS Berlin Expert Days 2015 | Dennis Kluge | Slide 26
28. Berlin Expert Days 2015 | Dennis Kluge | Slide 27
29. Berlin Expert Days 2015 | Dennis Kluge | Slide 28
30. Berlin Expert Days 2015 | Dennis Kluge | Slide 29
31. Berlin Expert Days 2015 | Dennis Kluge | Slide 30
32. Berlin Expert Days 2015 | Dennis Kluge | Slide 31
33. github.com/horstmumpitz/bedcon2015 Berlin Expert Days 2015 | Dennis Kluge | Slide 32
35. Bigram Tweet 1 Tweet 2 Tweet 3 di 1 2 0 ie 0 5 4 e_ 3 0 9 … BAG OF BIGRAMS Berlin Expert Days 2015 | Dennis Kluge | Slide 34
36. Berlin Expert Days 2015 | Dennis Kluge | Slide 35
37. –dennis.kluge@charite.de
 – @HorstMumpitz Danke