Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Doctrine Lexer Use Case

Doctrine Lexer Use Case

PHPTour Lyon 2014 - 24/06/2014

Olivier Dolbeau

June 24, 2014
Tweet

More Decks by Olivier Dolbeau

Other Decks in Programming

Transcript

  1. Doctrine
    Lexer
    use case

    View Slide

  2. View Slide

  3. Olivier Dolbeau
    @odolbeau
    Web Architect
    About me

    View Slide

  4. RIDESHARING
    Cost of
    motoring
    100€
    25€
    25€
    25€
    25€
    @BlaBlaCar_FR
    ALONE

    View Slide

  5. A fast growing community

    View Slide

  6. A European phenomenon

    View Slide

  7. View Slide

  8. I want to be able to search tweets using a
    human language.

    View Slide

  9. View Slide

  10. View Slide

  11. View Slide

  12. View Slide

  13. Where are my tweets ?

    View Slide

  14. View Slide

  15. View Slide

  16. View Slide

  17. View Slide

  18. View Slide

  19. View Slide

  20. Other solutions
    Logstash
    Home made external river

    View Slide

  21. distributed restful search and analytics
    elasticsearch

    View Slide

  22. View Slide

  23. View Slide

  24. View Slide

  25. View Slide

  26. View Slide

  27. We know what we want.
    We know where our data is.

    View Slide

  28. Now let’s see
    HOW
    we are doing to retrieve it.

    View Slide

  29. How...
    … to translate a human language into a
    technical one.

    View Slide

  30. “ A retweet FROM @CameronNash23 ”

    View Slide

  31. View Slide

  32. What’s a Lexer ?
    In computer science, lexical analysis is
    the process of converting a sequence of
    characters into a sequence of tokens, i.
    e. meaningful character strings.

    View Slide

  33. Tokens !
    Now !

    View Slide

  34. View Slide

  35. View Slide

  36. View Slide

  37. View Slide

  38. “ A retweet FROM @CameronNash23 ”
    T_SELECTOR T_RETWEET T_FROM T_USERNAME

    View Slide

  39. How...
    … to use these tokens to generate an
    ElasticSearch query.

    View Slide

  40. View Slide

  41. View Slide

  42. View Slide

  43. View Slide

  44. It works!

    View Slide

  45. View Slide

  46. View Slide

  47. View Slide

  48. And what about Doctrine ORM ?
    Let’s take a look at :
    Doctrine\ORM\Query\Lexer

    View Slide

  49. From DQL to SQL
    SELECT t0.id AS id1, t0.name AS name3, t0.
    username AS username4, t0.email AS email5
    FROM mos_users t0
    WHERE t0.username = “foobar”
    SELECT u
    FROM MyProject\Model\User u
    WHERE u.username = ‘foobar’

    View Slide

  50. 77 tokens !!

    View Slide

  51. Some patterns...

    View Slide

  52. And a switch (true) !

    View Slide

  53. Forget the Parser !

    View Slide

  54. View Slide

  55. View Slide

  56. View Slide

  57. Example
    A trip OR A search FROM "Paris, France" OR
    TO "Paris, France" BETWEEN 12/01/2013
    AND 26/05/2014
    A trip OR A search
    FROM "Paris, France" OR TO "Paris,
    France"
    BETWEEN 12/01/2013 AND 26/05/2014

    View Slide

  58. Lexer to GET tokens.
    Parser to USE tokens.

    View Slide

  59. @odolbeau
    On recrute ! :)
    MERCI !

    View Slide

  60. @odolbeau
    https://joind.in/ 11246
    https://github.com/odolbeau/elasticsearch-sandbox
    https://speakerdeck.com/odolbeau/doctrine-lexer-use-case

    View Slide