birdflyi / query_clickhouse

Connect to clickhouse, and from which query data with sqls.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

zh-cn | en-us

query_clickhouse

Connect to clickhouse, and from which query data with sqls.


Project Directory

Here are three most important directories:

  1. etc/: All of configurations and default settings are here.

    Notes: 'profile.py' is very important for your privacy(be careful when pushing codes), for it includes many authentication settings. 'logging.json' is just for logging runtime informations.

  2. data/: src ----script process----> result. Notes: 'src/' and 'result/' are corresponding with each other.

  3. script/: typical javaweb directories(controller <------service<------utils).

directory-structure

Quick Start

  1. Set your authentication settings in 'profile.py'.

  2. Modify '/script/query_sql.py':

    2.1 Clone your target project within X-lab2017/github-analysis-report, which can be a sub directory of 'github-analysis-report/sql/' or a sub directory of 'github-analysis-report/case-study/sql/'. Drop the copies in 'data/src/'.

    2.2 Modify the pre-process and post-processor logic if necessary.script-query_sql-content

  3. Run 'script/service/query_sql.py'. Check results in the directory 'data/result'.

  1. Related projects: X-lab2017/github-analysis-report

  2. Official account and article: 重磅 |《GitHub 2020 数字洞察报告》正式发布

  3. Related resources: 《GitHub 2020 数字洞察报告》

  4. Laboratory introduction: X-Lab

Description: this projectbirdflyi/query_clickhouse is associated with project X-lab2017/github-analysis-report. Some functions keep consistent with 《GitHub 2020 数字洞察报告》. Refer to the official account:重磅 |《GitHub 2020 数字洞察报告》正式发布.

About

Connect to clickhouse, and from which query data with sqls.

License:MIT License


Languages

Language:Python 71.1%Language:JavaScript 23.1%Language:HTML 5.8%