Need help for installing dolma

[Xinlin Zhuang]

Hi, I encountered some problems when running

pip install dolma

At first, the error message prompts me to install Rust.
After I install Rust and set in the system path environments, it runs smoothly for the first few steps but I still get fatal errors at last.
It looks like this:

rflow.rs:216: undefined reference to `getauxval'
                collect2: error: ld returned 1 exit status
      
        = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
        = note: use the `-l` flag to specify native libraries to link
        = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)
      
      error: could not compile `slab` (build script) due to 1 previous error
      💥 maturin failed
        Caused by: Failed to build a native library through cargo
        Caused by: Cargo build finished with "exit status: 101": `env -u CARGO PYO3_ENVIRONMENT_SIGNATURE="cpython-3.10-64bit" PYO3_PYTHON="/mnt/petrelfs/zhuangxinlin/miniconda3/envs/prod-torch2.1/bin/python" PYTHON_SYS_EXECUTABLE="/mnt/petrelfs/zhuangxinlin/miniconda3/envs/prod-torch2.1/bin/python" "cargo" "rustc" "--features" "pyo3/extension-module" "--message-format" "json-render-diagnostics" "--manifest-path" "/tmp/pip-install-ex5zf58w/dolma_cb84cbf3886149e6b3eeed5c1d325424/Cargo.toml" "--release" "--lib"`
      Error: command ['maturin', 'pep517', 'build-wheel', '-i', '/mnt/petrelfs/zhuangxinlin/miniconda3/envs/prod-torch2.1/bin/python', '--compatibility', 'off'] returned non-zero exit status 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for dolma
Failed to build dolma
ERROR: Could not build wheels for dolma, which is required to install pyproject.toml-based projects

My system info:

Linux Thu Nov 8 23:39:32 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Could you please provide any help for installing dolma?

[Xinlin Zhuang]

Here is the Rust version:

rustc 1.78.0 (9b00956e5 2024-04-29)

[Luca Soldaini]

hi @mihara-bot! which could you give me more info on the system you are on? you shouldn't need to install rust under x86-64 to use dolma; pypi package should come with all necessary binaries.

as a workaround, you can clone this repository and run make setup before installing dolma.

[Xinlin Zhuang]

Hi, thanks for your suggestion! It appears that my CMake version is too old. This problem has been solved. :)