State of Tests - Regression
Pavel-Durov opened this issue · comments
Context
For a while, we worked on enabling concurrent JIT compilation in YK while using yklua tests as validation.
Since there is ongoing work in the YK project on an alternative compiler that should solve concurrency and stability problems we decided to focus on only serialised tests in yklua.
For the time being, we want to support only serial compilation, i.e. YKD_SERIALISE_COMPILATION=1
.
State of current tests (only serialised compilation)
Versions
YKLUA
- main/08e6942b107b39c7cf4516bdd99db59850458395
YK
- master/cda769ae01b4a0ffe255e815703fce7f0c3dc19d
Passing
api bwcoercion code gengc pm tracegc cstack
7 passing tests
Failing
closure events goto tpack vararg locals files literals db attrib bitwise strings calls constructs
errors math sort nextvar gc utf8 big coroutine heavy verybig main
25 failing test
Ratio
Ratio: 7 / 32 ~ 22%
State of past tests (based on readme)
Success
api bwcoercion closure code events gengc goto pm tpack tracegc vararg cstack locals
13 passing tests
Failing
files literals db attrib bitwise strings calls constructs errors math
sort nextvar gc utf8 big coroutine heavy verybig main
19 failing tests
Ratio
Ratio: 13 / 32 ~ 40%