Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Natural Language Pipeline

37e97fd6305d91450db22815cfb554d5?s=47 ddqz
July 06, 2019

A Natural Language Pipeline

Presentation from the spaCy IRL 2019 conference.

37e97fd6305d91450db22815cfb554d5?s=128

ddqz

July 06, 2019
Tweet

Other Decks in Technology

Transcript

  1. A Natural Language Pipeline

  2. More Input

  3. Knowledge” “A compendium of human...

  4. Library

  5. Physical archives became digital records, encoded with metadata

  6. The internet promised rich dynamic experiences

  7. The internet promised rich dynamic experiences but served us banner

    ads
  8. Advertising has and continues to fuel a substantial portion of

    the innovation on the internet
  9. What would The Economist look like if it were founded

    in 2012?
  10. User

  11. First

  12. Experience

  13. “There’s a reason that tech companies are topping the lists

    of most valuable companies and brands. Every company is a tech company.” Maggie Chan Jones
  14. Every story, at its core, is a business story

  15. Language

  16. None
  17. None
  18. Stage -> Stenographer -> Editors -> spaCy -> Data Store

    <-> Backend <- Slack <- Users Proto-Pipeline
  19. Over eight hours we created data from the content of

    the event, building the model in real-time
  20. The model evolved over time

  21. This was the experiment that would evolve into SiO 2

  22. Silicon, a key element in everything from glass to microchips,

    is at the core of global business
  23. Oxygen, the journalistic voice Quartz breathes into the global business

    news cycle
  24. Entities are linguistic anchors, defined by context and around which

    context can be inferred
  25. Standard Entities PERSON FACILITY ORG PRODUCT GPE EVENT... Additional Entities

    TECHNOLOGY PROCESS NATURE MEDIA CONSTRUCT
  26. 70K articles 1.4M blocks of text 85K labeled sentences

  27. Entities

  28. This spaCy model made rich analysis for any given text

    easy to do on the fly
  29. Stored analysis of a large corpus is a vital resource

  30. The language graph...

  31. Graph

  32. The language graph is a mutable map of the language

    model
  33. Any new content is analyzed and then mapped onto the

    language graph
  34. Changes made to the graph can then be incorporated into

    the next model iteration
  35. The language graph becomes a primary resource for extracting training

    data
  36. Snapshots of time can be extracted from the language graph

  37. Context can be derived by looking at the relationships in

    the language graph
  38. Elon Musk

  39. Jeff Bezos

  40. Mark Zuckerberg

  41. Context

  42. SiO 2 is a living Natural Language Pipeline of networked

    algorithms trained on the corpus of Quartz to understand the linguistic patterns of global business news
  43. The Pipeline(s) Quartz Corpus -> Training Sentences -> spaCy Content

    -> spaCy -> Language Graph Language Graph -> Training Data -> Statistical Models / Classifiers Language Graph -> Training Sentences -> spaCy Unseen Content -> spaCy -> Pre-Processed Text / Vectors -> Statistical Models / Classifiers
  44. Thank you