raymondchen-byte / dataworker-sql-parser

基于antlr4 解析器，支持spark sql, tidb sql, flink sql, Spark/flink jar 运行命令解析器

介绍

基于antlr4 statement 解析器，支持spark3.0 sql, mysql sql, Presto, PG, T-SQL, jar 运行命令解析

1. MySQL
2. PrestoSQL
3. PostgreSQL
4. Spark 3.0
5. T-SQL

Spark Structed Streaming sql

create stream TABLE tdl_kafka_users (
    user_name "/name" string,
    age	    int,
    email   string
) WITH (
    kafka.bootstrap.servers = 'xxx.xxx.xxx.xxx:9092',
    kafka.group.id = 'dataworker-stream',
    subscribe = 'users',
    includeHeaders = true,
    startingOffsets = 'latest',
    failOnDataLoss = true,
    format='json'
);

insert into bigdata.test_delta_dt select * from tdl_kafka_users;

-- {name:'zhangsan', age: 28, email:'[e-mail]'}