Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Groovy journey in Open Source land

A Groovy journey in Open Source land

In dog years... err... Open Source years, the Groovy programming language project is a very mature and successful one, as its 12+ million downloads a year can attest. The Groovy language is certainly the most widely deployed alternative language of the JVM today. But how do we go from a hobby night & week-end project to professionally company sponsored? And back again to hobby mode but joining the wider Apache Software Foundation community?

Guillaume will guide you through the history of the project, its latest developments, and its recent news, outlining the importance of a community around an Open Source project.

Also, we'll discuss what it means to contribute, when it's your hobby or as a paid committer -- what does it change? What it means to join the Apache community, what the impact of professional Open Source is, and more.

Guillaume Laforge

June 02, 2016
Tweet

More Decks by Guillaume Laforge

Other Decks in Technology

Transcript

  1. A Groovy Journey in
    Open Source Land
    Guillaume Laforge / @glaforge
    Chair of the Apache Groovy PMC

    View full-size slide

  2. A Groovy Journey in
    Open Source Land
    Guillaume Laforge / @glaforge
    Chair of the Apache Groovy PMC

    View full-size slide

  3. GR8Conf Promo Code: ctwgr8conftw
    http://www.manning.com/koenig2/
    GROOVY
    IN ACTION
    2ND EDITION

    View full-size slide

  4. From 2003 onward…

    View full-size slide

  5. Bob McWhirter
    James Strachan

    View full-size slide

  6. Bob McWhirter
    James Strachan
    James Strachan and Bob McWhirter
    gave birth to Groovy: a dynamic and
    agile scripting language for the JVM.
    […] James always used to say that
    it was all Bob's fault, but indeed,
    James had so many groovy ideas that
    it's hard to believe it's not his own
    fault. He kept saying: "Wouldn't it
    be groovy if we could do this and
    that...". Hence the name "Groovy".
    That's roughly how it all started.

    View full-size slide

  7. 7
    Groovy pre-1.0
    • Closures available since 2003 on Java 1.4+
    • All the nice shortcuts already, inspired by Python & Ruby
    • native syntax for lists, maps, etc…
    • Tons of useful methods to simplify 

    common Java boiler-plate code
    • Initially dynamically-typed only

    View full-size slide

  8. I join the project in
    2003, patches after
    patches, become
    committer, then lead
    when founders left

    View full-size slide

  9. 11
    Groovy in 2004
    • A brand new parser based on Antlr
    • after two hand-rolled versions
    • by John Rose and Jeremy Rainer
    • Jochen « blackdrag » Theodorou joins the project

    View full-size slide

  10. 17
    First paid committer
    • Jochen becomes the first full-time paid committer
    • sponsored by BigSky Technologies / No Fluff Just Stuff

    View full-size slide

  11. Spock
    the Enterprise
    testing framework

    View full-size slide

  12. 24
    Groovy in 2007 — Groovy 1.5
    • The long awaited Java 5 update
    • annotations, enums, generics…
    • Joint compiler!
    • Varargs support
    • Static imports (including import aliasing)
    • Named parameters without parentheses

    View full-size slide

  13. Paul King, #1 committer
    from 2007 to 2010, and
    overall #1 committer too!

    View full-size slide

  14. 29
    Griffon and Easyb

    View full-size slide

  15. 30
    Groovy++ fork!
    • Not the first fork, but 3rd
    • by Alex Tkachman (former G2One co-founder)
    • Big focus on static compilation
    • interesting playground for our forthcoming static type
    checking and static compilation support

    View full-size slide

  16. I can honestly say if
    someone had shown
    me the Programming
    Scala book back in
    2003, I’d probably
    have never created
    Groovy

    View full-size slide

  17. Have I had JPA
    back then,
    I would
    certainly not
    have created
    Hibernate!

    View full-size slide

  18. 39
    The Groovy Ecosystem grows…

    View full-size slide

  19. 40
    Groovy 1.6
    • Performance improvements with call-site caching
    • Multiple assignments
    • Optional return in if/else, try/catch, switch/case
    • More AST transformations
    • @Singleton, @Lazy, @Immutable, @Delegate
    • The Grape module system with @Grab
    • OSGi support

    View full-size slide

  20. 41
    Groovy 1.7
    • Nested and inner classes, and nested static classes
    • Missing annotation definition support
    • Power Asserts from Spock
    • Customize the Groovy Truth!
    • AST viewer and AST builder
    • SQL support improvements

    View full-size slide

  21. 43
    Groovy ecosystem marching on…
    GContracts

    View full-size slide

  22. 47
    More Groovy ecosystem…

    View full-size slide

  23. 48
    Groovy 1.8
    • Command chain expressions
    • GPars bundled with the Groovy distribution
    • Primitive calculation optimizations
    • Closures
    • as annotation parameters
    • currying, memoization and tail recursion
    • Built-in JSON support

    View full-size slide

  24. I’m joining the
    Groovy team!

    View full-size slide

  25. 52
    Groovy ecosystem continued…
    • Netflix
    • Asgard,
    • Zuul
    • LinkedIn Glu
    • GroovyStream

    View full-size slide

  26. 53
    Groovy 2.0
    • Static type checking and static compilation
    • type inference, flow typing…
    • « Project Coin » enhancements
    • binary literals, underscore in numbers, multicatch block
    • Initial « invoke dynamic » support
    • Modularity of the Groovy code base with modules

    View full-size slide

  27. 56
    Richer Groovy ecosystem…

    View full-size slide

  28. 57
    Groovy 2.1
    • Full « invoke dynamic » support
    • Type-checking extensions
    • Meta-annotations
    • @DelegatesTo annotation
    • Compiler customization scripts
    • Distribution bundling GPars 1.0

    View full-size slide

  29. 58
    Groovy 2.2
    • Implicit closure coercion to SAM types
    • Java lambda friendly!
    • Pre-compiled type checking extensions
    • @Memoized transformations for methods

    View full-size slide

  30. 61
    Groovy ecosystem

    View full-size slide

  31. 62
    Groovy 2.3
    • Traits!
    • Improved JDK 8 support
    • Drastic performance improvement for JSON
    • New AST transformations & improvements
    • @Builder,@Sortable,@SourceURI, @BaseScript
    • New markup template engine
    • More NIO support

    View full-size slide

  32. You’re
    fired!
    2015

    View full-size slide

  33. Oh by the
    way,
    Codehaus
    closes!

    View full-size slide

  34. 2012 2013 2014 2015
    Downloads

    View full-size slide

  35. 2012 2013 2014 2015
    1.7M
    3M
    4.5M
    Downloads 12.7M

    View full-size slide

  36. 3.4 MILLIONS
    FROM MAVEN CENTRAL
    IN 4 MONTHS

    View full-size slide

  37. MAVEN
    CENTRAL
    ONLY

    View full-size slide

  38. MAVEN
    CENTRAL
    ONLY
    +BINTRAY

    View full-size slide

  39. 3 MILLIONS
    FROM BINTRAY

    View full-size slide

  40. 6.4 MILLIONS
    ALREADY IN
    2016 SO FAR

    View full-size slide

  41. 72
    Groovy 2.4 — Android support
    • Write your Android applications
    fully in Groovy!
    • Dedicated Gradle plugin

    View full-size slide

  42. 73
    Groovy 2.4 — Android support
    SwissKnife

    a dedicated 

    Groovy / Android 

    library

    View full-size slide

  43. 74
    Groovy 2.4 — Performance & bytecode
    • Improved bytecode
    • cheaper comparison operations
    • optimization of primitive type coercions with ‘as’
    • Reduced bytecode size
    • no MOP generated methods in static context
    • uneeded inner class distributor methods when no inner
    • timestamp removal
    • Reduced memory consumption

    View full-size slide

  44. 75
    Groovy 2.4 — Traits @SelfType
    class Component {

    void doSomething() {

    println "Done!"

    }

    }

    View full-size slide

  45. 75
    Groovy 2.4 — Traits @SelfType
    class Component {

    void doSomething() {

    println "Done!"

    }

    }
    import groovy.transform.*

    @SelfType(Component)

    @TypeChecked

    trait ComponentDecorator {

    void logAndDoSomething() {

    println "Going to do something"

    doSomething()

    }

    }

    View full-size slide

  46. 75
    Groovy 2.4 — Traits @SelfType
    class Component {

    void doSomething() {

    println "Done!"

    }

    }
    import groovy.transform.*

    @SelfType(Component)

    @TypeChecked

    trait ComponentDecorator {

    void logAndDoSomething() {

    println "Going to do something"

    doSomething()

    }

    }
    class ConcreteComponent

    extends Component

    implements ComponentDecorator {}


    def c = new ConcreteComponent()

    c.logAndDoSomething()

    View full-size slide

  47. 76
    Groovy 2.4 — GDK improvements
    • New methods
    • System.currentTimeSeconds()
    • List: removeAt(index), getIndices()
    • Collection: removeElement(Object)
    • Iterable: disjoin(), size(), dropRight(),
    takeRight()
    • More collection methods moved to iterator-based
    • Favor stream-like traversal methods leveraging iterables
    • Consistency for mutation in place vs new collection creation

    View full-size slide

  48. 77
    Groovy 2.4 — AST transformations
    • @ToString added includeSuperProperties parameter
    • Can define compilation phase for @ASTTest
    • @Synchronized supports explicit static locks used by
    instance methods if needed
    • Cleaned-up code for @AutoExternalizable and
    @EqualsAndHashCode when used with @CompileStatic
    • Improved Java integration for @Builder
    • @PackageScope allowed on constructors

    View full-size slide

  49. 78
    Groovy 2.4 — Groovysh improvements
    • Custom .rc and .profile scripts
    • instanceof completion
    • Static members completion only in a static context
    • Completion candidates in color
    • :set interpreterMode to remember locally-defined variables
    • :load command supports file names with spaces
    • Align arguments & flags with the groovy command
    • Script launch on startup & continue execution of Groovysh
    • Easier to subclass Groovysh for embedded reuse

    View full-size slide

  50. Here come the Indians!

    View full-size slide

  51. MESSAGE TO THE
    COMMUNITY

    View full-size slide

  52. HERE TO
    STAY
    INDEPENDENCE

    View full-size slide

  53. HERE TO
    STAY
    COMMUNITY
    ABOVE ALL
    INDEPENDENCE

    View full-size slide

  54. 83
    Top Level Project at Apache!
    • PMC & Incubator PMC voted for graduation
    • Apache Board agreed to the graduation!
    • (last November)
    • Call us Apache Groovy :-)
    • 2.4.6 was released on February 2016

    View full-size slide

  55. 84
    Entering the TIOBE index
    • 3 months in a row in the top-20 TIOBE index
    • 17th for January
    • 20th for February
    • 17th for March
    • 17th for April
    • 17th for May

    View full-size slide

  56. Little nuggets…

    View full-size slide

  57. 87
    Groovy 2.4.4/5/6 / 2.5
    • Improved compiler performance
    • with an ASM class reader
    • @Canonical becomes a meta-annotation
    • More control on the meta-annotation collector
    • New @MapConstructor transformation
    • Pre/post conditions for @TupleConstructor
    • Property validation in transformation parameters
    • @Delegate on getters
    • Further AST transformation improvements
    • JAXB marshal/unmarshal shortcuts

    View full-size slide

  58. 88
    @Canonical becomes a meta-annotation
    import groovy.transform.*


    @Canonical(includeNames = true)

    class Person {

    String name

    int age

    }


    assert new Person('Guillaume', 38).toString() ==

    'Person(name:Guillaume, age:38)'

    View full-size slide

  59. 88
    @Canonical becomes a meta-annotation
    import groovy.transform.*


    @Canonical(includeNames = true)

    class Person {

    String name

    int age

    }


    assert new Person('Guillaume', 38).toString() ==

    'Person(name:Guillaume, age:38)'
    includeNames
    from @ToString

    View full-size slide

  60. 89
    More control on annotation collector
    DUPLICATE
    Annotations from the annotation
    collection will always be inserted.
    PREFER_COLLECTOR
    Annotations from the collector will be
    added and any existing annotations with
    the same name will be removed.
    PREFER_EXPLICIT
    Annotations from the collector will be
    ignored if any existing annotations with
    the same name are found.
    PREFER_EXPLICIT_MERGED
    Annotations from the collector will be
    ignored if any existing annotations with
    the same name are found but any new
    parameters on the collector annotation
    will be added to existing annotations.
    PREFER_COLLECTOR_MERGED
    Annotations from the collector will be
    added and any existing annotations with
    the same name will be removed but any
    new parameters found within existing
    annotations will be merged into the
    added annotation.

    View full-size slide

  61. 90
    New @MapConstructor transformation
    import groovy.transform.*


    @TupleConstructor

    class Person {

    String first, last

    }


    @CompileStatic // optional

    @ToString(includeSuperProperties = true)

    @MapConstructor(pre = { super(args?.first, args?.last);

    args = args ?: [:] },

    post = { first = first?.toUpperCase() })

    class Author extends Person {

    String bookName

    }
    assert new Author(first: 'Dierk',
    last: 'Koenig',
    bookName: 'ReGinA').toString() ==
    'Author(ReGinA, DIERK, Koenig)'


    assert new Author().toString() ==
    'Author(null, null, null)'

    View full-size slide

  62. 90
    New @MapConstructor transformation
    import groovy.transform.*


    @TupleConstructor

    class Person {

    String first, last

    }


    @CompileStatic // optional

    @ToString(includeSuperProperties = true)

    @MapConstructor(pre = { super(args?.first, args?.last);

    args = args ?: [:] },

    post = { first = first?.toUpperCase() })

    class Author extends Person {

    String bookName

    }
    assert new Author(first: 'Dierk',
    last: 'Koenig',
    bookName: 'ReGinA').toString() ==
    'Author(ReGinA, DIERK, Koenig)'


    assert new Author().toString() ==
    'Author(null, null, null)'
    Can decorate map
    ctor with pre / post-
    instructions

    View full-size slide

  63. 91
    Pre/post events for @TupleConstructor
    import groovy.transform.TupleConstructor
    @TupleConstructor(pre = { first = first?.toLowerCase() })
    class Person {
    String first
    }
    def p = new Person('Jack')
    assert p.first == 'jack'

    View full-size slide

  64. 91
    Pre/post events for @TupleConstructor
    import groovy.transform.TupleConstructor
    @TupleConstructor(pre = { first = first?.toLowerCase() })
    class Person {
    String first
    }
    def p = new Person('Jack')
    assert p.first == 'jack'
    import groovy.transform.TupleConstructor
    import static groovy.test.GroovyAssert.shouldFail
    @TupleConstructor(pre = { assert first })
    class Person {
    String first
    }
    def p = new Person('Jack')
    shouldFail {
    def unknown = new Person()
    }

    View full-size slide

  65. 92
    Properties validated in AST xforms
    import groovy.transform.AutoClone


    @AutoClone(excludes = 'sirName')

    class Person {

    String firstName

    String surName

    }


    new Person(firstName: "John",
    surName: "Doe").clone()

    View full-size slide

  66. 92
    Properties validated in AST xforms
    import groovy.transform.AutoClone


    @AutoClone(excludes = 'sirName')

    class Person {

    String firstName

    String surName

    }


    new Person(firstName: "John",
    surName: "Doe").clone()
    Error during @AutoClone
    processing: 'excludes'
    property 'sirName'
    does not exist.

    View full-size slide

  67. 93
    Prevent @TupleConstructor default ctors
    @TupleConstructor

    class Person {

    String first, last

    int age

    }

    View full-size slide

  68. 93
    Prevent @TupleConstructor default ctors
    @TupleConstructor

    class Person {

    String first, last

    int age

    }
    Generates:
    Person(String first, String last, int age) { /*...*/ }
    Person(String first, String last) { this(first, last, 0) }
    Person(String first) { this(first, null) }
    Person() { this(null) }

    View full-size slide

  69. 94
    Prevent @TupleConstructor default ctors
    @TupleConstructor(defaults = true)

    class Person {
    String first, last

    int age

    }

    View full-size slide

  70. 94
    Prevent @TupleConstructor default ctors
    @TupleConstructor(defaults = true)

    class Person {
    String first, last

    int age

    }
    Generates only:
    Person(String first, String last, int age) { /*...*/ }

    View full-size slide

  71. 95
    @Immutable support in class hierarchy
    import groovy.transform.*


    @EqualsAndHashCode

    class Person {

    String name

    }

    View full-size slide

  72. 95
    @Immutable support in class hierarchy
    import groovy.transform.*


    @EqualsAndHashCode

    class Person {

    String name

    }
    @Immutable

    @TupleConstructor(includeSuperProperties = true)

    @EqualsAndHashCode(callSuper = true)

    @ToString(includeNames = true, includeSuperProperties = true)

    class Athlete extends Person {

    String sport

    }

    View full-size slide

  73. 95
    @Immutable support in class hierarchy
    import groovy.transform.*


    @EqualsAndHashCode

    class Person {

    String name

    }
    @Immutable

    @TupleConstructor(includeSuperProperties = true)

    @EqualsAndHashCode(callSuper = true)

    @ToString(includeNames = true, includeSuperProperties = true)

    class Athlete extends Person {

    String sport

    }
    def d1 = new Athlete('Michael Jordan', 'BasketBall')

    def d2 = new Athlete(name: 'Roger Federer', sport: ‘Tennis')
    assert d1 != d2

    assert d1.toString() == 

    'Athlete(sport:BasketBall, name:Michael Jordan)'

    assert d2.toString() == 

    'Athlete(sport:Tennis, name:Roger Federer)'

    View full-size slide

  74. 96
    :grab command in groovysh
    groovy:000> :grab 'com.google.guava:guava:19.0'
    groovy:000> import com.google.common.collect.BiMap
    ===> com.google.common.collect.BiMap

    View full-size slide

  75. 97
    @Delegate on getters too
    class Person {

    String name
    @Delegate

    String getName() {
    name.toUpperCase()
    }
    }
    def p = new Person('Bill')
    assert p.toUpperCase() == 'BILL'

    View full-size slide

  76. 98
    JAXB marshalling shortcuts
    import groovy.transform.EqualsAndHashCode
    import javax.xml.bind.JAXBContext
    import javax.xml.bind.annotation.*
    @EqualsAndHashCode
    @XmlAccessorType(XmlAccessType.FIELD)
    @XmlRootElement
    class Person {
    String name
    int age
    }

    View full-size slide

  77. 98
    JAXB marshalling shortcuts
    import groovy.transform.EqualsAndHashCode
    import javax.xml.bind.JAXBContext
    import javax.xml.bind.annotation.*
    @EqualsAndHashCode
    @XmlAccessorType(XmlAccessType.FIELD)
    @XmlRootElement
    class Person {
    String name
    int age
    }
    def jaxbContext =
    JAXBContext.newInstance(Person)
    def p = new Person(name: 'Bill', age: 20)
    def xml = jaxbContext.marshal(p)
    assert jaxbContext.unmarshal(xml, Person) == p

    View full-size slide

  78. 99
    Miscellaneous
    • Map#retainAll {} and Map#removeAll {} methods
    • GDK’s createSimilarCollection() and
    createSimilarMap() methods support all the JDK’s
    collections and maps
    • New File#relativePath(file) method

    View full-size slide

  79. To conclude…

    View full-size slide

  80. It’s been a long road!
    And it’s not over yet!

    View full-size slide

  81. Thanks for your attention!

    View full-size slide

  82. Questions & Answers

    View full-size slide