lexer-generator

There are 13 repositories under lexer-generator topic.

westes / flex
The Fast Lexical Analyzer - scanner generator for lexing in C and C++
c flex lexer lexer-generator
Language:C 3414
logos
maciejhirsz / logos
Create ridiculously fast Lexers
lexer lexer-generator parser parsing rust
Language:Rust 2614
katef / libfsm
DFA regular expression library & friends
fsm regex lexer-generator regexp regexes regex-validator dfa nfa finite-state-machine finite-state-automata finite-state-machines lexer lexical-analysis lexing lex automata compiler compilers compiler-principles
Language:C 897
jflex-de / jflex
The fast scanner generator for Java™ with full Unicode support
bazel-rules cup dfa dfa-minimization flex grammar java lexer lexer-generator lexical-analyzer maven-plugin nfa parsing regexp scanner scanner-generator tokenizer yacc
Language:Java 575
bnfc
BNFC / bnfc
BNF Converter
abstract-syntax-tree bnf bnf-converter bnfc grammar-specification lexer-generator parser-generator pretty-print
Language:TeX 564
Genivia / RE-flex
A high-performance C++ regex library and lexical analyzer generator with Unicode support. Extends Flex++ with Unicode support, indent/dedent anchors, lazy quantifiers, functions for lex and syntax error reporting and more. Seamlessly integrates with Bison and other parsers.
flex regex-library regex-pattern bison lexer regex-engine compiler graphviz-dot regex lexical-analyzer regular-expression regular-expressions flex-regex lexer-generator lex pcre fuzzy-matching
Language:C++ 482
goffrie / plex
a parser and lexer generator as a Rust procedural macro
lexer-generator parser-generator
Language:Rust 397
b3b00 / csly
a C# embeddable lexer and parser generator (.Net core)
csharp dot-net expression-parser grammar-rules lexer lexer-generator mathematical-parser parser parser-generator recursive-descent-parser
Language:C# 334
haskell / alex
A lexical analyser generator for Haskell
lexer-generator
Language:Haskell 292
goccmack / gogll
Generates generalised LL (GLL) and reduced size LR(1) parsers with matching lexers
parser-generator context-free-grammars lexer-generator gll golang go rust compiler-construction compiler-frontend rustlang rust-lang lr-1
Language:Go 185
loloicci / nimly
Lexer Generator and Parser Generator as a Library in Nim.
lexer-generator parser-generator lexer-parser nim compile-time bnf ebnf macro macros
Language:Nim 147
pfnet / rflex
Fast lexer code generator for Rust
lexer lexer-generator rust
Language:Rust 135
jafarlihi / clex
clex is a simple lexer generator
finite-state-machine lex lexer lexer-framework lexer-generator lexer-library lexical-analysis lexical-analyzer nfa regex regex-engine regexp
Language:C 89
osa1 / lexgen
A fully-featured lexer generator, implemented as a proc macro
compilers lexer-generator rust
Language:Rust 60
jack-pappas / facio
Tools for building compilers, interpreters, and analysis tools in F#
fsharp lexer-generator parser-generator grammar cfg regex
Language:F# 45
codewitch-honey-crisis / pck
The Parser Construction Kit ("Puck"): A Parser Generator and Grammar Translator in C#
parser-generator pck transformations yacc lexers parser-construction-kit parser lexer lexer-generator tokenizer generator generators compilers compiler command-line-tool gui-application grammars lalr parse-trees
Language:C# 35
John-Leitch / Aphid
A multiparadigm language intended to be embedded in .NET applications or compiled into other languages like Python or PHP. The internals of Aphid are clean and easy to work with, allowing for rapid creation of derivative domain-specific languages.
aphid c-sharp programming-language programming-language-development lexer-generator parser-generator
Language:C# 32
SilentByte / sb-dynlex
Configurable lexer for PHP featuring a fluid API.
lexer lexer-generator parsing syntax-highlighting
Language:PHP 28
openpeeps / toktok
Generic tokenizer written in Nim language 👑 Powered by Nim's Macros
lexer nim nim-lang tokenizer lexical generic-library hacktoberfest lex lexer-generator nim-language parser programming-language tokens awesome-nim
Language:Nim 27
kivikakk / golex
[mirror] Flex-compatible lexer generator for Go
go golang lexer lexer-generator
Language:Go 21
rollrat / compiler-compiler
🍁 Compiler Compiler based on CSharp with GUI Program
compiler-compiler lexical-analyzer parser-generator scanner-generator slr-parser regular-expression dfa-minimization regex-to-nfa nfa-to-dfa-conversion compiler-construction lexer-generator shift-reduce-parsers
Language:C# 19
chobits / tinylex
A tiny lexical analyser generator
lexer-generator
Language:C 16
christianparpart / klex
C++17 (CLI/embeddable) Lexical Scanner Generator
scanner lexical-analysis regular-expressions generator lexer-generator
Language:C++ 16
sergey0xff / lexit
An open source lexer generator
python compiler lexer lexer-generator grammar grammar-parser lexical-analyzer python3
Language:Python 15
zsmoore / lexr
Lexical analyzer for Javascript developers
lexical-analysis lexical-analyzer lexer-generator lexical lexical-parser lexer lex lexing flex scanner scanning scan token tokenizer tokens tokenization
Language:JavaScript 15
KiJeong-Lim / portfolio
My portfolio contains a lexer generator, a parser generator, my own λProlog interpreter, and several meta-theorems for the propositional logic with their proofs written in Coq.
lambda-prolog lexer-generator natural-deduction parser-generator portfolio proofs
13
squidscode / apli
The Abstract Programming Language Interface (APLI) is a framework for generating Abstract Syntax Trees (ASTs) to enable developers to create domain-specific languages faster.
dfa interpreter lexer-generator nfa-to-dfa-conversion parser-generator
Language:C 12
tianyu / antlr4-webpack-loader
Loads a ANTLR4 grammar file and compiles it to JavaScript
antlr4 webpack webpack-loader grammar lexer lexer-generator parser parser-generator
Language:JavaScript 11
0E9B061F / lexdoc
Simplified token definition and lexer creation library for use with Chevrotain.
chevrotain javascript lexer lexer-generator parsing tokenizer
Language:JavaScript 9
alimpfard / nlp-lex
Hopefully a lexer-generator that doesn't fucking suck
lexer-generator regex-engine hmm-viterbi-algorithm nlp-tool
Language:JavaScript 9
almondtools / rexlex
Regular Expressions and Lexing with DFAs
regular-expressions regular-expression dfa lexer-generator automaton java regex regex-engine regular-expression-engine
Language:Java 9
rrozansk / SPaG
A compiler to translate regular expressions (regular grammars) and LL1 BNF languages (subset of context free grammars) to generated scanners and/or parsers.
backus-naur-form backus-normal-form bnf cli context-free-grammar lexeme lexer lexer-generator lexical-analysis mit-licensed parser parser-generator python regular-expressions regular-grammar scanner scanner-generator script tokenizer tokens
Language:Python 8
sbalmt / xcheme
A set of tools that includes a new programming language to generate lexers and parsers for other languages.
compiler parser-generator parser-library lexer-generator lexer-library xcheme programming-language typescript
Language:TypeScript 6
mxxii / leac
Lexer / tokenizer
lexer-generator tokenizer lexer
Language:TypeScript 5
RowDaBoat / kobold-parsing-kit
An easy to use pattern matcher, lexer generator, and parser generator written in Kotlin, implemented with a packrat parser.
kotlin lexer lexer-generator packrat-parser parser parser-generator
Language:Kotlin 5
ryanovic / ParseLib
.NET runtime LALR parser generator
lalr-parser-generator lexer-generator lexer-parser parser parser-generator grammar
Language:C# 5