alibaba / pipcook

Machine learning platform for Web developers

Home Page:https://alibaba.github.io/pipcook/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Benchmarking & Visualization

WenheLI opened this issue · comments

We should track the building, execution, and installing time for every release and visualize them.
This could give us a clear clue on what is improved and what could be improved in the future release.

We can refer to deno's benchmark.

We need a website to show our benchmark firstly :)

We need a website to show our benchmark firstly :)

This could be done via vercel?

That's cool!

Just one thing comes into my mind, how should store the benchmark data?

in JSON or other formats? It depends on what benchmark framework that we choose :)

in JSON or other formats? It depends on what benchmark framework that we choose :)

My concern is how to make persistent storage(DB)? Vercel is essentially a serverless provider which means every time we restart the container, we will lose the previous data. Therefore, persistent storage will help us keep tracks on all data.

How does deno resolve this problem?

How does deno resolve this problem?

Deno seems to put benchmark data under a github repo. We can do host such a repo under imgcook.