qingchao-kong / mlsql

The Programming Language Designed For Big Data and AI

Home Page:https://www.mlsql.tech/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

MLSQL

MLSQL is a Programming Language Designed For Big Data and AI, and it also have a distributed runtime.

Official WebSite

http://www.mlsql.tech

Find more examples on our user guide.

  1. 中文文档
  2. English Docs

Get PreBuild Distribution

  • The lasted version is MLSQL v1.6.0
  • You can download from MLSQL Website
  • Spark 2.3.2/2.4.3 are tested
  • Spark 3.0.0 is partially supported.

Run PreBuild Distribution:

cp streamingpro-spark_2.x-x.x.x.tar.gz /tmp
cd /tmp && tar xzvf  streamingpro-spark_2.x-x.x.x.tar.gz
cd /tmp/streamingpro-spark_2.x-x.x.x

## make sure spark distribution is available
## visit http://127.0.0.1:9003
export SPARK_HOME="....." ; ./start-local.sh

Build Distribution

# clone project
git clone https://github.com/allwefantasy/streamingpro .
cd streamingpro

## configure build envs
export MLSQL_SPARK_VERSIOIN=2.4
export DRY_RUN=false 
export DISTRIBUTION=false

## build  
./dev/package.sh

Fork and Contribute

If you are planning to contribute to this repository, we first request you to create an issue at our Issue page even if the topic is not related to source code itself (e.g., documentation, new idea and proposal).

This is an active open source project for everyone, and we are always open to people who want to use this system or contribute to it.

Contributors

  • Zhu William/allwefantasy#gmail.com
  • Chen Fu/cfmcgrady#gmail.com
  • Geng Yifei/pigeongeng#gmail.com
  • wanp1989/wanp1989#126.com
  • chenliang613
  • RebieKong
  • CoderOverflow
  • ghsuzzy
  • xubo245
  • zhuohuwu0603
  • liyubin117
  • 9bbword
  • Slash-Wong/523935329#qq.com
  • anan0120/158989903#qq.com

HitCount


WeChat Group

扫码添加小可爱微信号,添加成功后,发送 mlsql 这5个英文字母进群。

About

The Programming Language Designed For Big Data and AI

https://www.mlsql.tech/

License:Apache License 2.0


Languages

Language:JavaScript 53.7%Language:CSS 17.7%Language:Scala 14.7%Language:HTML 10.2%Language:Java 1.9%Language:Python 1.3%Language:Shell 0.3%Language:TSQL 0.1%Language:Roff 0.0%Language:Dockerfile 0.0%Language:ANTLR 0.0%Language:Batchfile 0.0%