osa1 / lexgen

A fully-featured lexer generator, implemented as a proc macro

osa1/lexgen Issues

Question about unicode categories
Updated 8 months ago3
lua5_1.rs example contains return_() and continue_() missing from Lexer?
Closed 8 months ago4
Consider generating a warning (with an option to suppress) for rules that accept empty string
Updated 9 months ago
Confusing match reset behavior in initial state
Closed a year ago3
continue_ doesn't consume input in non-initial rule
Closed a year ago1
Allow let bindings interleaved with rules
Closed a year ago1
Implement DFA minimization
Updated a year ago
Use perfect hashing rather than binary search
Closed a year ago1
Generate DFA directly (no NFA)
Updated a year ago
Make DFA match utf8 rather than char
Updated a year ago3
match until/til?
Closed 2 years ago
Implement "cut" (as in Prolog) for comitting to a choice
Updated 2 years ago1
Allow the user state to carry a lifetime?
Closed 2 years ago1
The state type is required to implement Default even if client code never calls `new` or `new_from_iter`
Closed 2 years ago4
Generated code triggers "manual_range_contains" lint
Closed 2 years ago
Generated code triggers "double_comparisons" lint
Closed 2 years ago
Invalid token doesn't consume input from match_ in non-initial rule
Closed 2 years ago8
Return multiple tokens
Updated 2 years ago1
Implement Default for Loc
Closed 2 years ago5
Consider merging char and range transitions in NFA and DFA
Updated 2 years ago
Rename "user action" -> "semantic action"
Closed 2 years ago
Avoid redunant backtrack state updates
Updated 2 years ago1
Allow initializing lexers with a character iterator
Closed 2 years ago1
Implement fast paths for ASCII in unicode regexes
Updated 2 years ago
Document performance implications and ordering of rules with looakheads
Updated 2 years ago
Lookahead could be useful
Closed 2 years ago8
Provide a way to specify error value when failing to match
Updated 3 years ago
Provide a way to exclude characters
Closed 3 years ago1
Support negated character sets?
Closed 3 years ago3
Implement a way to bind match results in patterns
Updated 3 years ago3
Wrong lexing when rules share prefix
Closed 3 years ago
Rule templates?
Updated 3 years ago1
Empty rule fails or loops depending on other rules
Closed 3 years ago5
Implement an easy way to get the matched char in a wildcard rule
Updated 3 years ago1
Implement location tracking and a way to get a match's location
Closed 3 years ago
Eliminate peeking in generated code
Closed 3 years ago2
Provide a way to fail with "lexer error"
Updated 3 years ago
Provide a way to match end-of-input in non-initial states
Closed 3 years ago1
Implement returning multiple values in NFA and DFA simulations
Closed 3 years ago2
Regex compilation bug when prefix is shared by regexes
Closed 3 years ago6
Consider moving semantic actions to functions, leave inlining decisions to LLVM/rustc
Closed 3 years ago2
Find a better metavariable syntax in documentation
Updated 3 years ago
`switch_and_return` does not consume the returned token?
Closed 3 years ago6
Compile DFAs as lookup tables instead of linear if-elses
Closed 3 years ago2
Consider inlining accepting states without transitions
Closed 3 years ago1
Implement Logos benchmarks in lexgen
Updated 3 years ago
Overlapping ranges break lexing
Closed 3 years ago2
Windows-style line endings cause panic on Lua 5.1 example
Closed 3 years ago2