Doctrine Lexer Use Case

PHPTour Lyon 2014 - 24/06/2014

Transcript

1. Doctrine
   Lexer
   use case
   

   View Slide

2. View Slide

3. Olivier Dolbeau
   @odolbeau
   Web Architect
   About me
   

   View Slide

4. RIDESHARING
   Cost of
   motoring
   100€
   25€
   25€
   25€
   25€
   @BlaBlaCar_FR
   ALONE
   

   View Slide

5. A fast growing community
   

   View Slide

6. A European phenomenon
   

   View Slide

7. View Slide

8. I want to be able to search tweets using a
   human language.
   

   View Slide

9. View Slide

10. View Slide

11. View Slide

12. View Slide

13. Where are my tweets ?
    

    View Slide

14. View Slide

15. View Slide

16. View Slide

17. View Slide

18. View Slide

19. View Slide

20. Other solutions
    Logstash
    Home made external river
    

    View Slide

21. distributed restful search and analytics
    elasticsearch
    

    View Slide

22. View Slide

23. View Slide

24. View Slide

25. View Slide

26. View Slide

27. We know what we want.
    We know where our data is.
    

    View Slide

28. Now let’s see
    HOW
    we are doing to retrieve it.
    

    View Slide

29. How...
    … to translate a human language into a
    technical one.
    

    View Slide

30. “ A retweet FROM @CameronNash23 ”
    

    View Slide

31. View Slide

32. What’s a Lexer ?
    In computer science, lexical analysis is
    the process of converting a sequence of
    characters into a sequence of tokens, i.
    e. meaningful character strings.
    

    View Slide

33. Tokens !
    Now !
    

    View Slide

34. View Slide

35. View Slide

36. View Slide

37. View Slide

38. “ A retweet FROM @CameronNash23 ”
    T_SELECTOR T_RETWEET T_FROM T_USERNAME
    

    View Slide

39. How...
    … to use these tokens to generate an
    ElasticSearch query.
    

    View Slide

40. View Slide

41. View Slide

42. View Slide

43. View Slide

44. It works!
    

    View Slide

45. View Slide

46. View Slide

47. View Slide

48. And what about Doctrine ORM ?
    Let’s take a look at :
    Doctrine\ORM\Query\Lexer
    

    View Slide

49. From DQL to SQL
    SELECT t0.id AS id1, t0.name AS name3, t0.
    username AS username4, t0.email AS email5
    FROM mos_users t0
    WHERE t0.username = “foobar”
    SELECT u
    FROM MyProject\Model\User u
    WHERE u.username = ‘foobar’
    

    View Slide

50. 77 tokens !!
    

    View Slide

51. Some patterns...
    

    View Slide

52. And a switch (true) !
    

    View Slide

53. Forget the Parser !
    

    View Slide

54. View Slide

55. View Slide

56. View Slide

57. Example
    A trip OR A search FROM "Paris, France" OR
    TO "Paris, France" BETWEEN 12/01/2013
    AND 26/05/2014
    A trip OR A search
    FROM "Paris, France" OR TO "Paris,
    France"
    BETWEEN 12/01/2013 AND 26/05/2014
    

    View Slide

58. Lexer to GET tokens.
    Parser to USE tokens.
    

    View Slide

59. @odolbeau
    On recrute ! :)
    MERCI !
    

    View Slide

60. @odolbeau
    https://joind.in/ 11246
    https://github.com/odolbeau/elasticsearch-sandbox
    https://speakerdeck.com/odolbeau/doctrine-lexer-use-case
    

    View Slide