Giters

weld-project / weld

High-performance runtime for data analytics applications

Home Page:https://www.weld.rs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Getting compile error: Invalid input token: 'name'

ConcurrencyPractitioner opened this issue · comments

commented

I was testing the data frame snippet from the example in the dataframe PR (#510). However, when running inside the repl (built from tip of master), I got the below error:

Richards-MacBook-Air-2:weld richardyu$ ./target/release/repl
[info] 20:08:05.228: Weld Version 0.4.0 (Build dcbba9a)
Log Level set to 'debug'
>>> df = GrizzlyDataFrame({'name': ['mike', 'sam', 'sally'], 'age': [20, 22, 56]})
[debug] 20:08:13.772: ParsedConf { memory_limit: 1000000000, threads: 1, trace_run: false, enable_sir_opt: true, enable_experimental_passes: false, optimization_passes: [Pass { transforms: [Transformation(experimental=false)], pass_name: "inline-zip" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "inline-apply" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "inline-let" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=true), Transformation(experimental=true)], pass_name: "loop-fusion" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "unroll-static-loop" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "infer-size" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false)], pass_name: "algebraic" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false)], pass_name: "inline-literals" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "cse" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "short-circuit-booleans" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false)], pass_name: "predicate" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "vectorize" }], enable_bounds_checks: false, llvm: LLVMConfig { opt_level: 2, llvm_unroller: true, llvm_vectorizer: true, target_analysis_passes: true, module_optimizations: true, func_optimizations: true, run_func_name: "run" }, dump_code: DumpCodeConfig { enabled: false, filename: "code-1587784093-dd", directory: ".", formats: {LLVMOpt, SIR, Assembly, LLVM, Weld, WeldOpt} } }
REPL: Compile error: Invalid input token: 'name':
commented

You'll need to run this inside the Python REPL, not the Weld REPL; the Weld REPL is just to test compiling Weld language expressions :)

commented

Oh, I see. Thanks for the help.

commented

Hi @sppalkia. After a little bit of experimenting, I encountered an error. For context, I was trying to run the following commands on Mac under weld-python:

$ rustup default nightly
$ python setup.py develop

It was on the second command that I had a problem. (I just used python3 instead of python). The following error was reported:

Traceback (most recent call last):
  File "./setup.py", line 8, in <module>
    from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'

I did try to pip3 install the above module (which passed), and then try the command again. However, that failed, with the same error. Do you know what might be the cause of this error?

Here is my OS:
Darwin Richards-Air-2.attlocal.net 19.2.0 Darwin Kernel Version 19.2.0: Sat Nov 9 03:47:04 PST 2019; root:xnu-6153.61.1~20/RELEASE_X86_64 x86_64
Python version: 3.7.2