omnia100 / Tokenizer

Compilers CS419: Lexical Analyzer for mini-c language

Tokenizer:

In this project, you will build a small compiler for mini-C language. In the first phase of this project, you are required to build a program that tokenizes a stream of characters and outputs tokens in the order they appeared