Problem with __future__ annotation
yash-srivastava19 opened this issue · comments
Following through the instructions in the repo, there seems to be some problem with the installation of the custom transformers package with the issue :
No module named 'setuptools_rust'
System configs :
OS : Ubuntu 22.04 LTS
The log produced :
`...
Installed /home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/transformers-4.3.2-py3.6.egg
Processing dependencies for transformers==4.3.2
Searching for tokenizers<0.11,>=0.10.1
Reading https://pypi.org/simple/tokenizers/
/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/pkg_resources/init.py:119: PkgResourcesDeprecationWarning: is an invalid version and will not be supported in a future release
PkgResourcesDeprecationWarning,
Downloading https://files.pythonhosted.org/packages/48/2b/b99184cacb1a743edc18290e9127d1b0e658c0c46f2ab5290b27fe865ff4/tokenizers-0.10.3.tar.gz#sha256=1a5d3b596c6d3a237e1ad7f46c472d467b0246be7fd1a364f12576eb8db8f7e6
Best match: tokenizers 0.10.3
Processing tokenizers-0.10.3.tar.gz
Writing /tmp/easy_install-yusrqbr4/tokenizers-0.10.3/setup.cfg
Running tokenizers-0.10.3/setup.py -q bdist_egg --dist-dir /tmp/easy_install-yusrqbr4/tokenizers-0.10.3/egg-dist-tmp-3955d72l
Traceback (most recent call last):
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 156, in save_modules
yield saved
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 198, in setup_context
yield
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 259, in run_setup
_execfile(setup_script, ns)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 46, in _execfile
exec(code, globals, locals)
File "/tmp/easy_install-yusrqbr4/tokenizers-0.10.3/setup.py", line 2, in
#
ModuleNotFoundError: No module named 'setuptools_rust'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "setup.py", line 312, in
cmdclass={"deps_table_update": DepsTableUpdateCommand},
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/init.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/usr/local/lib/python3.6/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/local/lib/python3.6/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/usr/local/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/install.py", line 74, in run
self.do_egg_install()
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/install.py", line 124, in do_egg_install
cmd.run(show_deprecation=False)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 414, in run
self.easy_install(spec, not self.no_deps)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 656, in easy_install
return self.install_item(None, spec, tmpdir, deps, True)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 703, in install_item
self.process_distribution(spec, dist, deps)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 751, in process_distribution
[requirement], self.local_index, self.easy_install
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/pkg_resources/init.py", line 773, in resolve
replace_conflicting=replace_conflicting
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/pkg_resources/init.py", line 1056, in best_match
return self.obtain(req, installer)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/pkg_resources/init.py", line 1068, in obtain
return installer(requirement)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 675, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 701, in install_item
dists = self.install_eggs(spec, download, tmpdir)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 896, in install_eggs
return self.build_and_install(setup_script, setup_base)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 1168, in build_and_install
self.run_setup(setup_script, setup_base, args)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 1152, in run_setup
run_setup(setup_script, args)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 262, in run_setup
raise
File "/usr/local/lib/python3.6/contextlib.py", line 99, in exit
self.gen.throw(type, value, traceback)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 198, in setup_context
yield
File "/usr/local/lib/python3.6/contextlib.py", line 99, in exit
self.gen.throw(type, value, traceback)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 169, in save_modules
saved_exc.resume()
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 143, in resume
raise exc.with_traceback(self._tb)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 156, in save_modules
yield saved
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 198, in setup_context
yield
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 259, in run_setup
_execfile(setup_script, ns)
File "/home/ysriv/PycharmProjects/Intern-YANMTT/venv/lib/python3.6/site-packages/setuptools/sandbox.py", line 46, in _execfile
exec(code, globals, locals)
File "/tmp/easy_install-yusrqbr4/tokenizers-0.10.3/setup.py", line 2, in
#
ModuleNotFoundError: No module named 'setuptools_rust'`
Any help with this would be highly appreciated !!!
I tried rectifying the above error, and was met with __future__ annotations error. The request library installed gave the future annotation error, as it is incompatible for Python version < 3.7
With some googling, I tried using the future annotation package for our Python version(3.6.8) This, however spirals down and the train_mbart.sh and other bash scripts don't run.
Any help in this regard would be really appreciated...