probcomp / Gen.jl

A general-purpose probabilistic programming system with programmable inference

Home Page:https://gen.dev

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Failing docstring tests in Julia nightly.

ztangent opened this issue · comments

Finally figured out why our nightly CI builds keep failing --- looks like it's due to this upstream issue with how @doc is implemented in the testing environment: JuliaLang/julia#52986

For reference, this is what the failing test looks like:

docstrings: Test Failed at /home/runner/work/Gen.jl/Gen.jl/test/dsl/dynamic_dsl.jl:533
  Expression: String(take!(io)) == "my documentation\n"
   Evaluated: "nothing" == "my documentation\n"

Stacktrace:
 [1] top-level scope
   @ ~/work/Gen.jl/Gen.jl/test/dsl/dynamic_dsl.jl:8
 [2] macro expansion
   @ /opt/hostedtoolcache/julia/nightly/x64/share/julia/stdlib/v1.12/Test/src/Test.jl:164 [inlined]
 [3] macro expansion
   @ ~/work/Gen.jl/Gen.jl/test/dsl/dynamic_dsl.jl:12 [inlined]
 [4] macro expansion
   @ /opt/hostedtoolcache/julia/nightly/x64/share/julia/stdlib/v1.12/Test/src/Test.jl:164 [inlined]
 [5] macro expansion
   @ ~/work/Gen.jl/Gen.jl/test/dsl/dynamic_dsl.jl:21 [inlined]
 [6] macro expansion
   @ /opt/hostedtoolcache/julia/nightly/x64/share/julia/stdlib/v1.12/Test/src/Test.jl:167 [inlined]
Test Summary:                                      | Pass  Fail  Total  Time
Dynamic DSL                                        |  147     1    148  6.5s

Looks like the issue is being actively addressed upstream, so we can just wait for a fix. (Alternatively, we can add REPL as a test dependency, but then we'll have to remove once the upstream issue is fixed.)