🕷 software releases

by ryan davis



sitemap

ruby_parser version 3.15.0 has been released!

Published 2020-08-31 @ 17:15

ruby_parser (RP) is a ruby parser written in pure ruby (utilizing racc–which does by default use a C extension). It outputs s-expressions which can be manipulated and converted back to ruby via the ruby2ruby gem.

As an example:

def conditional1 arg1
  return 1 if arg1 == 0
  return 0
end

becomes:

s(:defn, :conditional1, s(:args, :arg1),
  s(:if,
    s(:call, s(:lvar, :arg1), :==, s(:lit, 0)),
    s(:return, s(:lit, 1)),
    nil),
  s(:return, s(:lit, 0)))

Tested against 801,039 files from the latest of all rubygems (as of 2013-05):

  • 1.8 parser is at 99.9739% accuracy, 3.651 sigma
  • 1.9 parser is at 99.9940% accuracy, 4.013 sigma
  • 2.0 parser is at 99.9939% accuracy, 4.008 sigma

Changes:

3.15.0 / 2020-08-31

  • 1 major enhancement:

    • Added tentative 2.7 support.
  • 1 minor enhancement:

    • Improved ruby_parse_extract_error’s handling of moving slow files out.
  • 22 bug fixes:

    • Bumped ruby version to include 3.0 (trunk).
    • Fix an error related to empty ensure bodies. (presidentbeef)
    • Fix handling of bad magic encoding comment.
    • Fixed SystemStackError when parsing a huoooge hash, caused by a splat arg.
    • Fixed a number of errors parsing do blocks in strange edge cases.
    • Fixed a string backslash lexing bug when the string is an invalid encoding. (nijikon, gmcgibbon)
    • Fixed bug assigning line number to some arg nodes.
    • Fixed bug concatinating string literals with differing encodings.
    • Fixed bug lexing heredoc w/ nasty mix of \r\n and \n.
    • Fixed bug lexing multiple codepoints in \u{0000 1111 2222} forms.
    • Fixed bug setting line numbers in empty xstrings in some contexts.
    • Fixed edge case on call w/ begin + do block as an arg.
    • Fixed handling of UTF BOM.
    • Fixed handling of lexer state across string interpolation braces.
    • Fixed infinite loop when lexing backslash+cr+newline (aka dos-files)
    • Fixed lambda + do block edge case.
    • Fixed lexing of some ?\M… and ?\C… edge cases.
    • Fixed more do/brace block edge case failures.
    • Fixed parsing bug where splat was used in the middle of a list.
    • Fixed parsing of interpolation in heredoc-like strings. (presidentbeef)
    • Fixed parsing some esoteric edge cases in op_asgn.
    • Fixed unicode processing in ident chars so now they better mix.
  • home: https://github.com/seattlerb/ruby_parser
  • bugs: https://github.com/seattlerb/ruby_parser/issues
  • rdoc: http://docs.seattlerb.org/ruby_parser