Giters
JuliaLang
/
Tokenize.jl
Tokenization for Julia source code
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
101
Watchers:
20
Issues:
51
Forks:
30
JuliaLang/Tokenize.jl Issues
TagBot trigger issue
Closed
3 years ago
Comments count
64
Fails to parse nested open/close comment sequences
Closed
a year ago
Comments count
3
Can you tokenize a string with a regular expression
Closed
2 years ago
Comments count
3
tokenize fails on double quotes
Updated
2 years ago
compound keywords incorrectly tokenized
Closed
2 years ago
Comments count
4
Regression
Closed
2 years ago
Comments count
3
incorrectly errors
Closed
2 years ago
Comments count
1
JET self test
Closed
3 years ago
Comments count
5
Tokenize 0.5.19 broke JuMPs formatting
Closed
3 years ago
Comments count
5
`isopsuffix` incomplete
Closed
3 years ago
Comments count
1
String interpolation with unicode error ref JuliaFormatter
Closed
3 years ago
Improved string interpolation lexing removes start of string interpolations with parenthesis
Closed
3 years ago
Comments count
2
bug with Tokenize.jl v0.5.14 for JuliaFormatter
Closed
3 years ago
Comments count
1
string interpolation with single-quote errors
Closed
3 years ago
incorrect attribute values for tokens of the KEYWORD category
Closed
3 years ago
Comments count
8
hexadecimal error
Updated
3 years ago
Store operator metainfo here
Closed
3 years ago
Comments count
1
number parsing error
Closed
5 years ago
Dot operators have inconsistent location information
Closed
5 years ago
Comments count
1
escaping within cmds
Closed
5 years ago
Fails to precompile on master
Closed
6 years ago
Comments count
1
Precompilation fails
Closed
6 years ago
Comments count
3
v0.7 compatability
Closed
6 years ago
Comments count
7
Make a Documenter documentation.
Closed
6 years ago
Comments count
1
Make Tokenize thread safe
Closed
6 years ago
Comments count
11
startbyte(t::Token) and endbyte(t::Token) are documented but do not exist
Closed
6 years ago
Comments count
5
replace Base.utf8_trailing
Closed
6 years ago
Comments count
1
`:keyword` incorrectly tokenized
Closed
7 years ago
Comments count
6
Perform error checking for more literals, e.g. 0.0.0
Updated
7 years ago
Document RawToken interface in README
Updated
7 years ago
Investigate into accumulating chars while reading them.
Closed
7 years ago
Comments count
4
Tokenize does not recognize hex float literals
Closed
7 years ago
Comments count
1
Investigate performance of stringless tokens
Closed
7 years ago
Comments count
4
Escaped newlines not ignored in comment lexing
Closed
7 years ago
Comments count
1
conflicting unicode characters
Closed
7 years ago
Comments count
1
Hexadecimal ints
Updated
7 years ago
Comments count
1
lex_digit doesn't handle scientific notation
Closed
7 years ago
Lexer enters infinite loop when parsing string interpolation having unbalanced brackets
Closed
7 years ago
Comments count
14
`!` op/identifier mixup
Closed
7 years ago
Comments count
2
failure to lex float with trailing period and non identifier token
Closed
7 years ago
Comments count
3
interpolating strings are incorrectly lexed
Closed
7 years ago
Comments count
6
Lexing binary integer format
Closed
7 years ago
Comments count
1
Add dot operators
Closed
7 years ago
Comments count
2
Get to 100% coverage
Updated
7 years ago
Comments count
1
Get rid of error_type field in Token.
Updated
7 years ago
Some bugs
Closed
7 years ago
Comments count
9
Incorrect lexing of numbers juxtaposed with dot operators
Closed
7 years ago
incorrect RBITSHIFT lexing?
Closed
7 years ago
Comments count
2
Parse error for 0.1..0.3
Closed
7 years ago
Comments count
6
Doesn't recognize Integers in the form `1_000`
Closed
8 years ago
Comments count
2
Previous
Next