Tokenize.jl

Tokenization for Julia source code

OTHER License

Stars
99
Committers
16

Bot releases are visible (Hide)

Tokenize.jl - Latest Release

Published by pfitzseb 6 months ago

Tokenize.jl -

Published by pfitzseb 10 months ago

Tokenize.jl -

Published by pfitzseb 10 months ago

Tokenize.jl -

Published by pfitzseb 11 months ago

Tokenize.jl -

Published by pfitzseb 11 months ago

Tokenize.jl - v0.5.24

Published by fredrikekre over 2 years ago

Tokenize.jl - v0.5.21

Published by github-actions[bot] about 3 years ago

Tokenize v0.5.21

Diff since v0.5.20

Closed issues:

  • Tokenize 0.5.19 broke JuMPs formatting (#189)

Merged pull requests:

  • #188, but fixed (#191) (@pfitzseb)
Tokenize.jl - v0.5.20

Published by github-actions[bot] about 3 years ago

Tokenize v0.5.20

Diff since v0.5.19

Merged pull requests:

  • Revert "Simplify lex_identifier" (#190) (@KristofferC)
Tokenize.jl - v0.5.19

Published by github-actions[bot] about 3 years ago

Tokenize v0.5.19

Diff since v0.5.18

Merged pull requests:

  • RFC: change optimization level to 1 (#187) (@KristofferC)
  • Simplify lex_identifier (#188) (@ZacLN)
Tokenize.jl - v0.5.18

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.18

Diff since v0.5.17

Merged pull requests:

  • Add LEFT_ARROW and DOUBLE_ARROW (#184) (@pfitzseb)
  • add additional operator suffixes (#185) (@pfitzseb)
  • lex all of Base in tests (#186) (@pfitzseb)
Tokenize.jl - v0.5.17

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.17

Diff since v0.5.16

Closed issues:

  • isopsuffix incomplete (#180)

Merged pull requests:

  • fix isopsuffix (#181) (@pfitzseb)
  • clean up code (#182) (@pfitzseb)
  • 0.5.17 (#183) (@goretkin)
Tokenize.jl - v0.5.16

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.16

Diff since v0.5.15

Closed issues:

  • String interpolation with unicode error ref JuliaFormatter (#178)

Merged pull requests:

  • fix unicode string interpolation (#179) (@pfitzseb)
Tokenize.jl - v0.5.15

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.15

Diff since v0.5.14

Closed issues:

  • Improved string interpolation lexing removes start of string interpolations with parenthesis (#175)
  • bug with Tokenize.jl v0.5.14 for JuliaFormatter (#177)

Merged pull requests:

  • fix string interpolation (#176) (@pfitzseb)
Tokenize.jl - v0.5.14

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.14

Diff since v0.5.13

Closed issues:

  • string interpolation with single-quote errors (#172)
  • incorrect attribute values for tokens of the KEYWORD category (#174)

Merged pull requests:

  • improve string interpolation lexing (#173) (@pfitzseb)
Tokenize.jl - v0.5.13

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.13

Diff since v0.5.12

Merged pull requests:

  • allow PRIME after END kw (#168) (@ZacLN)
  • update list of operators (#169) (@ZacLN)
Tokenize.jl - v0.5.12

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.12

Diff since v0.5.11

Merged pull requests:

  • fix invalid float parse (#167) (@ZacLN)
Tokenize.jl - v0.5.11

Published by github-actions[bot] over 3 years ago

Tokenize v0.5.11

Diff since v0.5.10

Merged pull requests:

  • add missing operator (#164) (@ZacLN)
  • emit error on invalid hexadecimal (#166) (@ZacLN)
Tokenize.jl - v0.5.10

Published by github-actions[bot] almost 4 years ago

Tokenize v0.5.10

Diff since v0.5.9

Merged pull requests:

  • fix comment lexing (#159) (@ZacLN)
Tokenize.jl - v0.5.9

Published by github-actions[bot] almost 4 years ago

Tokenize v0.5.9

Diff since v0.5.8

Closed issues:

  • Store operator metainfo here (#119)

Merged pull requests:

  • also lex stdlibs in benchmark (#158) (@KristofferC)
  • use github actions instead of travis (#160) (@KristofferC)
  • fix string interpolation of Chars (#162) (@ZacLN)
Tokenize.jl - v0.5.8

Published by julia-tagbot[bot] over 4 years ago