lexing

There are 2 repositories under lexing topic.

zesterer / chumsky
Write expressive, high-performance parsers with ease.
parser parser-combinators context-free-grammar errors recursive-descent-parser peg lexing parsing
Language:Rust 4286
katef / libfsm
DFA regular expression library & friends
fsm regex lexer-generator regexp regexes regex-validator dfa nfa finite-state-machine finite-state-automata finite-state-machines lexer lexical-analysis lexing lex automata compiler compilers compiler-principles
Language:C 968
aappleby / matcheroni
A minimalist single-header library for building pattern-matchers, lexers, and parsers.
lexer lexing parser parsing parsing-expression-grammar parsing-expression-grammars regex text-processing c cplusplus-20 pattern-matching regular-expression regular-expression-engine regular-expressions
Language:C++ 210
smolkaj / nice-parser
Nice parsers in OCaml without the boilerplate
ocaml menhir boilerplate parsing lexing parser-generator ocamllex dune
Language:OCaml 126
JuliaLang / Tokenize.jl
Tokenization for Julia source code
lexing tokenizer julia lexer
Language:Julia 104
piotrmurach / lex
Lex is an implementation of lex tool in Ruby.
compiler lexer lexing ruby ruby-gem state-lexer tokenizer
Language:Ruby 57
YaccConstructor / YaccConstructor
Platform for parser generators and other grammarware research and development. GLL, RNGLR, graph parsing algorithms, and many others are included.
parser-generator fsharp glr-parser gll-parser parsing lexical-analysis lexing grammarware ebnf
Language:F# 41
jcs-elpa / parse-it
Basic Parser in Emacs Lisp.
parser parse lex lexer lexing ast emacs grammar
Language:Emacs Lisp 27
abock / dotlang
.NET Standard library for parsing and generating Graphviz DOT files.
graphviz dot-language abstract-syntax-tree ast parsing lexing dotnet-standard dotnet dot
Language:C# 22
quasilyte / parsing-and-go
golang go parsing yacc ragel lexing lexer phpdoc
Language:Go 19
zsmoore / lexr
Lexical analyzer for Javascript developers
lexical-analysis lexical-analyzer lexer-generator lexical lexical-parser lexer lex lexing flex scanner scanning scan token tokenizer tokens tokenization
Language:JavaScript 16
dragonquest / stack-based-vm-csharp
A simple stack-based Virtual Machine in C#
csharp dotnet lexing mono parsing stackvm virtual-machine
Language:C# 15
leodido / ragel-machinery
😈 Automates devilries to make you even more happy together with Ragel and Go
ragel parser parsing lexer lexing scanner scanning streaming stream utilities machinery golang
Language:Go 14
CrazyProger1 / FastPy
FastPy is a statically typed programming language with pythonic syntax.
abstract-syntax-tree custom-programming-language lexing parsing transpiling pythonic-code-style
Language:Python 11
goki / pi
interactive parsing in GoKi / GoGi framework -- makes parsing fun again!
parsing goki gogi recursive-descent-parser parser-generator lexing golang
Language:Go 11
wbsoft / parce
:deciduous_tree: Python lexer that can remember tokens and state and only reparse changed parts of a text document
python3 parsing text lexing tokenizer tree-structure
Language:Python 10
MystPi / chomp
🍪 Lexer step + parser combinators + great error messages [nibble fork]
functional-programming gleam lexer lexing parser parser-combinators parsing
Language:Gleam 9
0x2a-42 / herring
Lexer generator for Rust
lexer lexing logos rust
Language:Rust 8
dmjio / scythe
Fast, RFC-4180 compliant, CSV lexing.
csv haskell lexing
Language:Haskell 8
LuizZak / MiniLexer
A teeny-tiny-weeny lexer written in Swift available as a Swift Package.
lexing swift swiftpm
Language:Swift 8
trag1c / crossandra-rs
(WIP) A straightforward tokenization library for seamless text processing.
lexer lexing regex rust tokenization tokenizer
Language:Rust 8
CalinZBaenen / ParseJS
A simple tokenizer I made for JS while making a project that required tokens.
javascript js lexer lexing library tokeniza tokenizer parsejs
Language:JavaScript 7
boxbeam / RedLex
A lexer-generator/parser-combinator for any context-free format
lexer-generator lexing parser-combinator parsing
Language:Java 6
unhammer / ocaml_cg_streamparse
parsing cg stream format, just to learn sedlex+menhir
sedlex lexing menhir parser
Language:OCaml 5
eccs0103 / ProgrammingLanguage
Programming language model
csharp evaluation interpreter language-model parsing tokenization lexing
Language:C# 4
simonskodt / BPRD-assignments
Assignments in the 5th semester course 'Programmer som data'.
assignments csharp fsharp java lexing parsing c programming-languages
Language:F# 4
andjhop / llk
A parser combinator library for building LL(*) parsers
combinators functional-programming lexing parsing-library go parser
Language:Go 3
FinNLP / lexed
⚙️ [Processor] Multi-lingual, extensible word and sentence tokenizer, for natural language processing.
nlp lexer lexing
Language:TypeScript 3
zacharymarshal / wordhi
Some fun lexing
php lexing html
Language:HTML 3
akashlevy / Vizpiler
An interactive tutorial on lexing/parsing in compilers
tutorial parsing lexical-analysis lexing compilers theory visualization
Language:HTML 2
gravity182 / REPL
A Read–Eval–Print Loop (REPL) and Better Bash Lang & Compiler written in C++
repl tokenize tokenizer lexing lexer parse parser eval evaluator ast compiler
Language:C++ 2
ShadelessFox / calc
Calculator inside your terminal in case you missed the builtin one.
calculator lexing parsing rust
Language:Rust 2
singul4ri7y / mistix-lang
A playful object-oriented toy programming language lovingly crafted using Promit 🔥
interpreters lexing parsing programing-language
Language:Batchfile 2
stephen-bracken / ScalaLex
scala lexing metaprogramming parsing regular-expressions
Language:Scala 2
yaaama / clox
Interpreter written in C for the "Lox" language
c compiler crafting-interpreters lexing parsing interpreter
Language:C 2
andrearcaina / zephyr
tryna create a statically typed interpreted language
ast go interpreter language-learning lexing repl
Language:Go 1

lexing

zesterer / chumsky

katef / libfsm

aappleby / matcheroni

smolkaj / nice-parser

JuliaLang / Tokenize.jl

piotrmurach / lex

YaccConstructor / YaccConstructor

jcs-elpa / parse-it

abock / dotlang

quasilyte / parsing-and-go

zsmoore / lexr

dragonquest / stack-based-vm-csharp

leodido / ragel-machinery

CrazyProger1 / FastPy

goki / pi

wbsoft / parce

MystPi / chomp

0x2a-42 / herring

dmjio / scythe

LuizZak / MiniLexer

trag1c / crossandra-rs

CalinZBaenen / ParseJS

boxbeam / RedLex

unhammer / ocaml_cg_streamparse

eccs0103 / ProgrammingLanguage

simonskodt / BPRD-assignments

andjhop / llk

FinNLP / lexed

zacharymarshal / wordhi

akashlevy / Vizpiler

gravity182 / REPL

ShadelessFox / calc

singul4ri7y / mistix-lang

stephen-bracken / ScalaLex

yaaama / clox

andrearcaina / zephyr