Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The new syntax highlighter for Vim

pocke
November 04, 2017

The new syntax highlighter for Vim

VimConf 2017

pocke

November 04, 2017

Transcript

55 slides
  1. hi

  2. :help pocke • Masataka Kuwabara • Vimmer / Rubyist •

    Actcat, inc. / SideCI • RuboCop's core developer ◦ RuboCop is a static analyzer for Ruby.
  3. Agenda • Talk about syntax highlighters ◦ Introduce the current

    syntax highlighter. ◦ Introduce the new syntax highlighter. ▪ I implement it
  4. :help syntax Syntax highlighting enables Vim to show parts of

    the text in another font or color. Those parts can be specific keywords or text matching a pattern. Vim doesn't parse the whole file (to keep it fast), so the highlighting has its limitations. https://github.com/vim/vim/blob/1d68d9b2bd60d848552c08763e590edde16056c9/runtime/doc/syntax.txt#L9-L12
  5. hello.vim function! Hello(name) abort echom 'Hello, ' . a:name .

    '-san!' endfunction Only two colors... Understanding syntax of the code is difficult.
  6. :help syntax Syntax highlighting enables Vim to show parts of

    the text in another font or color. Those parts can be specific keywords or text matching a pattern. Vim doesn't parse the whole file (to keep it fast), so the highlighting has its limitations. https://github.com/vim/vim/blob/1d68d9b2bd60d848552c08763e590edde16056c9/runtime/doc/syntax.txt#L9-L12
  7. For example: synmaxcol • Vim gives up parsing very long

    line. ◦ The limitation is configurable by `synmaxcol`. • DEMO ◦ https://github.com/pocke/vimconf-2017/blob/mast er/synmaxcol.json
  8. :help syntax Syntax highlighting enables Vim to show parts of

    the text in another font or color. Those parts can be specific keywords or text matching a pattern. Vim doesn't parse the whole file (to keep it fast), so the highlighting has its limitations. https://github.com/vim/vim/blob/1d68d9b2bd60d848552c08763e590edde16056c9/runtime/doc/syntax.txt#L9-L12
  9. Some people, when confronted with a problem, think “I know,

    I’ll use regular expressions.” Now they have two problems. Jamie Zawinski http://regex.info/blog/2006-09-15/247
  10. Conclusion of the Current Syntax Highlighter • The syntax highlighter

    has limitations for performance. ◦ e.g.) On long long line, on large <script>. • The syntax highlighter uses keywords and regexp to highlight text. ◦ The regexp is very difficult, and does not perfect.
  11. Features of iro.vim • The new syntax highlight plugin for

    Vim. • Highlight perfectly with high performance • Understandable code • DEMO
  12. Design • Use `matchaddpos()` instead of `:syntax`. • Use a

    parser that is implemented in the target language to parse perfectly.
  13. Example: "Hello world" in Ruby def foo puts "Hello world!"

    end First, Iro.vim receives the code, and passes the code to `iro#ruby#tokens()`.
  14. iro#ruby#tokens() code to tokens def foo puts "Hello world!" end

    [[[1, 0], :on_kw, "def"], [[1, 3], :on_sp, " "], [[1, 4], :on_ident, "foo"], [[1, 7], :on_nl, "\n"], [[2, 0], :on_sp, " "], [[2, 2], :on_ident, "puts"], [[2, 6], :on_sp, " "], [[2, 7], :on_tstring_beg, "\""], [[2, 8], :on_tstring_content, "Hello world!"], Ripper.lex(code)
  15. iro#ruby#tokens() tokens to highlights data [[[1, 0], :on_kw, "def"], [[1,

    3], :on_sp, " "], [[1, 4], :on_ident, "foo"], [[1, 7], :on_nl, "\n"], [[2, 0], :on_sp, " "], [[2, 2], :on_ident, "puts"], [[2, 6], :on_sp, " "], [[2, 7], :on_tstring_beg, "\""], [[2, 8], :on_tstring_content, "Hello world!"], { "Keyword":[[1,1,3],[3,1,3]], "String":[[2,9,12]], "Delimiter":[[2,8,1], [2,21,1]] }
  16. autoload/iro/ruby.vim.rb • parse a ruby file, and generate highlight data

    • https://github.com/pocke/iro.vim/blob/mast er/autoload/iro/ruby.vim.rb
  17. Performance • Bad news: A performance issue exists ◦ Iro.vim

    is very slow on a ruby file that has 10,000+ lines(DEMO). • Good news: Parsing is not a bottleneck ◦ Vim is very slow when maybe many highlight is registered by `matchaddpos()`.
  18. Current status • Still developing, but it works • Support

    few languages. ◦ Ruby, YAML and Python(experimental). • Welcome Pull-Requests
  19. :endslide • Iro.vim is a new syntax highlighter. ◦ It

    highlights perfectly Thank you for listening

More Decks by pocke

Other Decks in Programming