why import cugraph not working in kaggle? - python

I need to use cugraph in kaggle forthat i install rapids with this code:
import sys
!cp ../input/rapids/rapids.21.06 /opt/conda/envs/rapids.tar.gz
!cd /opt/conda/envs/ && tar -xzvf rapids.tar.gz > /dev/null
sys.path = ["/opt/conda/envs/rapids/lib/python3.7/site-packages"] + sys.path
sys.path = ["/opt/conda/envs/rapids/lib/python3.7"] + sys.path
sys.path = ["/opt/conda/envs/rapids/lib"] + sys.path
!cp /opt/conda/envs/rapids/lib/libxgboost.so /opt/conda/lib/
then,
conda install -c nvidia -c rapidsai -c numba -c conda-forge -c defaults cugraph cudatoolkit=10.2
but cugraph not installed, usually i have this error:
ModuleNotFoundError Traceback (most recent call last) /tmp/ipykernel_241/370751810.py in <module>
----> 1 import cugraph
ModuleNotFoundError: No module named 'cugraph'
When i try to use !pip in the installation, i get this error:
Collecting cugraph
Using cached cugraph-0.6.1.post1.tar.gz (1.1 kB)
Building wheels for collected packages: cugraph
Building wheel for cugraph (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /opt/conda/bin/python3.7 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-vayp36a0/cugraph_6683f309da3e4f3da55486b6a34ad47d/setup.py'"'"'; __file__='"'"'/tmp/pip-install-vayp36a0/cugraph_6683f309da3e4f3da55486b6a34ad47d/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-nar691rc
cwd: /tmp/pip-install-vayp36a0/cugraph_6683f309da3e4f3da55486b6a34ad47d/
Complete output (25 lines):
running bdist_wheel
running build
installing to build/bdist.linux-x86_64/wheel
running install
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-vayp36a0/cugraph_6683f309da3e4f3da55486b6a34ad47d/setup.py", line 35, in <module>
cmdclass={'install': InstallWrapper},
File "/opt/conda/lib/python3.7/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/opt/conda/lib/python3.7/distutils/core.py", line 148, in setup
dist.run_commands()
File "/opt/conda/lib/python3.7/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/opt/conda/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/opt/conda/lib/python3.7/site-packages/wheel/bdist_wheel.py", line 335, in run
self.run_command('install')
File "/opt/conda/lib/python3.7/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/opt/conda/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/tmp/pip-install-vayp36a0/cugraph_6683f309da3e4f3da55486b6a34ad47d/setup.py", line 15, in run
raise Exception(long_description)
Exception: Please install cugraph via the rapidsai conda channel. See https://rapids.ai/start.html for instructions.
----------------------------------------
ERROR: Failed building wheel for cugraph

For future reader's reference, the full answer is detailed here:
https://github.com/rapidsai/cugraph/issues/1972#issuecomment-982925312
User needs to specify RPAIDS version, python version and CUDA toolkit Version. The working conda install command for Kaggle, as of writing, is:
!conda install -y -c rapidsai -c nvidia -c conda-forge cugraph=21.08 python=3.7 cudatoolkit=11.0

Related

Error: Failed building wheel for pythonnet

I am trying to install pythonnet and i can't for some reason and it just gives me this error whenever i try to install it
pip3 install pythonnet
Collecting pythonnet
Using cached pythonnet-2.5.2.tar.gz (1.9 MB)
Preparing metadata (setup.py) ... done
Requirement already satisfied: pycparser in c:\users\0991t\appdata\local\packages\pythonsoftwarefoundation.python.3.9_qbz5n2kfra8p0\localcache\local-packages\python39\site-packages (from pythonnet) (2.20)
Building wheels for collected packages: pythonnet
Building wheel for pythonnet (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: 'C:\Users\0991t\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\python.exe' -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\0991t\\AppData\\Local\\Temp\\pip-install-oqtzzy7u\\pythonnet_3e469843a44f4517b9f84bc86e79df93\\setup.py'"'"'; __file__='"'"'C:\\Users\\0991t\\AppData\\Local\\Temp\\pip-install-oqtzzy7u\\pythonnet_3e469843a44f4517b9f84bc86e79df93\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d 'C:\Users\0991t\AppData\Local\Temp\pip-wheel-u9mp60rw'
cwd: C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\
Complete output (80 lines):
running bdist_wheel
running build
running build_ext
Checking for updates from https://www.nuget.org/api/v2/.
Currently running NuGet.exe 4.1.0.
Updating NuGet.exe to 6.0.0.
Update successful.
Cannot find the specified version of msbuild: '14'
MSBuild auto-detection: using msbuild version '16.11.2.50704' from 'C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\MSBuild\Current\bin'.
Restoring NuGet package NUnit.ConsoleRunner.3.11.1.
Restoring NuGet package NUnit.3.12.0.
Restoring NuGet package System.ValueTuple.4.5.0.
Restoring NuGet package UnmanagedExports.1.2.7.
Adding package 'NUnit.3.12.0' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Adding package 'NUnit.ConsoleRunner.3.11.1' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Adding package 'UnmanagedExports.1.2.7' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Adding package 'System.ValueTuple.4.5.0' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Added package 'UnmanagedExports.1.2.7' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Added package 'NUnit.ConsoleRunner.3.11.1' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Added package 'System.ValueTuple.4.5.0' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
Added package 'NUnit.3.12.0' to folder 'C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\packages'
NuGet Config files used:
C:\Users\0991t\AppData\Roaming\NuGet\NuGet.Config
C:\Program Files (x86)\NuGet\Config\Microsoft.VisualStudio.Offline.config
Feeds used:
C:\Users\0991t\.nuget\packages\
https://api.nuget.org/v3/index.json
C:\Program Files (x86)\Microsoft SDKs\NuGetPackages\
Installed:
4 package(s) to packages.config projects
Microsoft (R) Manifest Tool
Copyright (c) Microsoft Corporation.
All rights reserved.
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\setup.py", line 630, in <module>
setup(
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\__init__.py", line 155, in setup
return distutils.core.setup(**attrs)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\core.py", line 148, in setup
return run_commands(dist)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\core.py", line 163, in run_commands
dist.run_commands()
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\dist.py", line 967, in run_commands
self.run_command(cmd)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\dist.py", line 986, in run_command
cmd_obj.run()
File "C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\setup.py", line 612, in run
return bdist_wheel.bdist_wheel.run(self)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\wheel\bdist_wheel.py", line 299, in run
self.run_command('build')
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\dist.py", line 986, in run_command
cmd_obj.run()
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\command\build.py", line 135, in run
self.run_command(cmd_name)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\dist.py", line 986, in run_command
cmd_obj.run()
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\command\build_ext.py", line 339, in run
self.build_extensions()
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\command\build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\setuptools\_distutils\command\build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\setup.py", line 345, in build_extension
manifest = self._get_manifest(dest_dir)
File "C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\setup.py", line 389, in _get_manifest
subprocess.check_call(" ".join(cmd), shell=False)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.9_3.9.2544.0_x64__qbz5n2kfra8p0\lib\subprocess.py", line 373, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'C:\Program Files (x86)\Windows Kits\10\bin\10.0.19041.0\x64\mt.exe -inputresource:"C:\Users\0991t\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\python.exe" -out:"C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\build\lib.win-amd64-3.9\app.manifest"' returned non-zero exit status 31.
----------------------------------------
ERROR: Failed building wheel for pythonnet
Running setup.py clean for pythonnet
Failed to build pythonnet
Installing collected packages: pythonnet
Running setup.py install for pythonnet ... error
ERROR: Command errored out with exit status 1:
command: 'C:\Users\0991t\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\python.exe' -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\0991t\\AppData\\Local\\Temp\\pip-install-oqtzzy7u\\pythonnet_3e469843a44f4517b9f84bc86e79df93\\setup.py'"'"'; __file__='"'"'C:\\Users\\0991t\\AppData\\Local\\Temp\\pip-install-oqtzzy7u\\pythonnet_3e469843a44f4517b9f84bc86e79df93\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\0991t\AppData\Local\Temp\pip-record-l9hhufpc\install-record.txt' --single-version-externally-managed --user --prefix= --compile --install-headers 'C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\Include\pythonnet'
cwd: C:\Users\0991t\AppData\Local\Temp\pip-install-oqtzzy7u\pythonnet_3e469843a44f4517b9f84bc86e79df93\
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: option --single-version-externally-managed not recognized
----------------------------------------
ERROR: Command errored out with exit status 1: 'C:\Users\0991t\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\python.exe' -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\0991t\\AppData\\Local\\Temp\\pip-install-oqtzzy7u\\pythonnet_3e469843a44f4517b9f84bc86e79df93\\setup.py'"'"'; __file__='"'"'C:\\Users\\0991t\\AppData\\Local\\Temp\\pip-install-oqtzzy7u\\pythonnet_3e469843a44f4517b9f84bc86e79df93\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\0991t\AppData\Local\Temp\pip-record-l9hhufpc\install-record.txt' --single-version-externally-managed --user --prefix= --compile --install-headers 'C:\Users\0991t\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\Include\pythonnet' Check the logs for full command output.
I have tried updating setuptools, pip, and wheel. I have tried a lot of things but i just can't wrap my head around why it is causing this error. I am using the latest pip version and using the latest python version. Im also using the latest setuptools version and the latest wheel version. Sorry i am trying to make my question not mostly code so i can actually post it lol.
This can help you #Thomas.
I had the same issue, this solved my problem and install successfully.
Due to pythonnet version mismatch python 3.10.1 reported this error.
Go to: https://pypi.org/project/pythonnet/
Then Follow these steps:
Open the official website :pythonnet.
Click on the "Download files".
Then download "pythonnet-2.5.2-cp38-cp38-win_amd64.whl" (for 64-bit python version)
Modify file name like this:
Before: pythonnet-2.5.2-cp38-cp38-win_amd64.whl
After: pythonnet-2.5.2-cp310-none-any.whl
And now try to install like: pip install path of the file
ex: pip install C:\users\user5\desktop\pythonnet-2.5.2-cp310-none-any.whl
I hope this help you. All the best.
Original post: https://www.codestudyblog.com/cs2112pyc/1221121223.html

Pip installation error on torch install inside virtualenv on RPi4

I tried installing pytorch using pip inside a python3.7 virtual environment on my Raspberry Pi:
(env_hal) pi#raspberrypi:~ $ python3 -m pip install "torch==1.9.0"
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
ERROR: Could not find a version that satisfies the requirement torch==1.9.0 (from versions: 0.1.2, 0.1.2.post1, 0.1.2.post2)
ERROR: No matching distribution found for torch==1.9.0
The index pip looks in seems to be the default one. Why is it not listing torch?
Edit:
If I omit the version from the command, it unsuccessfully attempts to install this ominous torch package, which doesnt seem to be pytorch:
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting torch
Using cached torch-0.1.2.post2.tar.gz (128 kB)
Requirement already satisfied: pyyaml in ./audio/env_hal/lib/python3.7/site-packages (from torch) (5.4.1)
WARNING: The candidate selected for download or install is a yanked version: 'torch' candidate (version 0.1.2.post2 at https://files.pythonhosted.org/packages/f8/02/880b468bd382dc79896eaecbeb8ce95e9c4b99a24902874a2cef0b562cea/torch-0.1.2.post2.tar.gz#sha256=a43e37f8f927c5b18f80cd163daaf6a1920edafcab5102e02e3e14bb97d9c874 (from https://pypi.org/simple/torch/))
Reason for being yanked: 0.1.2 is past it's support date and confuses users on unsupported platforms
Building wheels for collected packages: torch
Building wheel for torch (setup.py): started
Building wheel for torch (setup.py): finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /home/pi/audio/env_hal/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-6h6ghes1
cwd: /tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/
Complete output (30 lines):
running bdist_wheel
running build
running build_deps
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py", line 265, in <module>
description="Tensors and Dynamic neural networks in Python with strong GPU acceleration",
File "/home/pi/audio/env_hal/lib/python3.7/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.7/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.7/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/pi/audio/env_hal/lib/python3.7/site-packages/wheel/bdist_wheel.py", line 299, in run
self.run_command('build')
File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/usr/lib/python3.7/distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py", line 51, in run
from tools.nnwrap import generate_wrappers as generate_nn_wrappers
ModuleNotFoundError: No module named 'tools.nnwrap'
----------------------------------------
ERROR: Failed building wheel for torch
Running setup.py clean for torch
ERROR: Command errored out with exit status 1:
command: /home/pi/audio/env_hal/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' clean --all
cwd: /tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e
Complete output (2 lines):
running clean
error: [Errno 2] No such file or directory: '.gitignore'
----------------------------------------
ERROR: Failed cleaning build dir for torch
Failed to build torch
Installing collected packages: torch
Running setup.py install for torch: started
Running setup.py install for torch: finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /home/pi/audio/env_hal/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15hetl4d/install-record.txt --single-version-externally-managed --compile --install-headers /home/pi/audio/env_hal/include/site/python3.7/torch
cwd: /tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/
Complete output (23 lines):
running install
running build_deps
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py", line 265, in <module>
description="Tensors and Dynamic neural networks in Python with strong GPU acceleration",
File "/home/pi/audio/env_hal/lib/python3.7/site-packages/setuptools/__init__.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.7/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.7/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py", line 99, in run
self.run_command('build_deps')
File "/usr/lib/python3.7/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py", line 51, in run
from tools.nnwrap import generate_wrappers as generate_nn_wrappers
ModuleNotFoundError: No module named 'tools.nnwrap'
----------------------------------------
ERROR: Command errored out with exit status 1: /home/pi/audio/env_hal/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-u4qh01at/torch_77171faa079e464a8ea88699d6c51f7e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15hetl4d/install-record.txt --single-version-externally-managed --compile --install-headers /home/pi/audio/env_hal/include/site/python3.7/torch Check the logs for full command output.
Try pip3 uninstall torch first to clean up install/uninstall leftover, and run pip3 install torch again.

How to install python ta-lib library in Azure Machine Learning Juypyter Notebooks

SO I need to use this python library explained here:
https://medium.com/analytics-vidhya/recognizing-over-50-candlestick-patterns-with-python-4f02a1822cb5
However when I try to execute:
!pip install talib
import talib
I get lots of errors:
Collecting talib
Using cached talib-0.1.1.tar.gz (1.3 kB)
Building wheels for collected packages: talib
Building wheel for talib (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /anaconda/envs/azureml_py36/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lof3_wuc/talib/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lof3_wuc/talib/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-1dvr6fd9
cwd: /tmp/pip-install-lof3_wuc/talib/
Complete output (29 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib
creating build/lib/talib
copying talib/__init__.py -> build/lib/talib
copying talib/cli.py -> build/lib/talib
installing to build/bdist.linux-x86_64/wheel
running install
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-lof3_wuc/talib/setup.py", line 47, in <module>
'talib = talib.cli:cli',
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/core.py", line 148, in setup
dist.run_commands()
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/anaconda/envs/azureml_py36/lib/python3.6/site-packages/wheel/bdist_wheel.py", line 326, in run
self.run_command('install')
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/tmp/pip-install-lof3_wuc/talib/setup.py", line 20, in run
raise Exception("You probably meant to install and run ta-lib")
Exception: You probably meant to install and run ta-lib
----------------------------------------
ERROR: Failed building wheel for talib
Running setup.py clean for talib
Failed to build talib
Installing collected packages: talib
Running setup.py install for talib ... error
ERROR: Command errored out with exit status 1:
command: /anaconda/envs/azureml_py36/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lof3_wuc/talib/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lof3_wuc/talib/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-7fqjayvz/install-record.txt --single-version-externally-managed --compile --install-headers /anaconda/envs/azureml_py36/include/python3.6m/talib
cwd: /tmp/pip-install-lof3_wuc/talib/
Complete output (14 lines):
running install
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-lof3_wuc/talib/setup.py", line 47, in <module>
'talib = talib.cli:cli',
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/core.py", line 148, in setup
dist.run_commands()
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/anaconda/envs/azureml_py36/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/tmp/pip-install-lof3_wuc/talib/setup.py", line 20, in run
raise Exception("You probably meant to install and run ta-lib")
Exception: You probably meant to install and run ta-lib
----------------------------------------
ERROR: Command errored out with exit status 1: /anaconda/envs/azureml_py36/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lof3_wuc/talib/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lof3_wuc/talib/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-7fqjayvz/install-record.txt --single-version-externally-managed --compile --install-headers /anaconda/envs/azureml_py36/include/python3.6m/talib Check the logs for full command output.
---------------------------------------------------------------------------
ModuleNotFoundError Traceback (most recent call last)
<ipython-input-56-ef2dd36041a5> in <module>
1 get_ipython().system('pip install talib')
----> 2 import talib
ModuleNotFoundError: No module named 'talib'
#phd is right. the TA-lib Python library's README.md's says
To use TA-Lib for python, you need to have the TA-Lib already installed.
I just created a new AML Compute Instance and was able to successfully import TA-lib for Python after first manually downloading, building and installing the TA-lib package on the VM. Some steps took around 5 min but YMMV
To install on the Azure ML Compute Instance.
Open the Compute Instance in Jupyter Labs
Open a new Terminal (File:New:Terminal)
Type the following commands (adapted from these linux instructions)
$ wget -c https://sourceforge.net/projects/ta-lib/files/ta-lib/0.4.0/ta-lib-0.4.0-src.tar.gz/download?use_mirror=phoenixnap -O - | tar -xz
$ cd ta-lib/
$ ./configure --prefix=/usr
$ make
$ sudo make install
install TA-lib Python wrapper pip install TA-lib (I had to do this twice for some reason)
open a notebook and run a cell with import talib
. your error means that you don't have the TA-lib back

Cant install pytorch - ModuleNotFoundError: No module named 'tools.nnwrap'

I cannot install PyTorch on python 3.7. This error occurs for others but the suggested fixes did not work. I have tried instaling wheel, and importing tools but neither work.
Got error: ModuleNotFoundError: No module named 'tools.nnwrap'
ran command pip install --pre torch torchvision -f https://download.pytorch.org/whl/nightly/cu102/torch_nightly.html
full output: Looking in links: https://download.pytorch.org/whl/nightly/cu102/torch_nightly.html Collecting torch Using cached torch-0.1.2.post2.tar.gz (128 kB) Collecting torchvision Using cached torchvision-0.2.2.post3-py2.py3-none-any.whl (64 kB) Requirement already satisfied: pyyaml in c:\users\lv7682\documents\repos\security_patch\spms\webapp\securitypatchmanagementsystem\venv\venv\lib\site-packages (from torch) (5.3.1) Collecting pillow>=4.1.1 Using cached Pillow-7.2.0-cp37-cp37m-win32.whl (1.8 MB) Collecting numpy Using cached numpy-1.19.1-cp37-cp37m-win32.whl (10.9 MB) Collecting six Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Using legacy 'setup.py install' for torch, since package 'wheel' is not installed. Installing collected packages: torch, pillow, numpy, six, torchvision Running setup.py install for torch ... error ERROR: Command errored out with exit status 1: command: 'c:\users\lv7682\documents\repos\security_patch\spms\webapp\securitypatchmanagementsystem\venv\venv\scripts\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[ 0] = '"'"'C:\\Users\\LV7682\\AppData\\Local\\Temp\\pip-install-4b80gt33\\torch\\setup.py'"'"'; __file__='"'"'C:\\Users\\LV7682\\AppData\\Local\\Temp\\pip-install-4b80gt33\\torch\\setup .py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --reco rd 'C:\Users\LV7682\AppData\Local\Temp\pip-record-z5_fy7cc\install-record.txt' --single-version-externally-managed --compile --install-headers 'c:\users\lv7682\documents\repos\security _patch\spms\webapp\securitypatchmanagementsystem\venv\venv\include\site\python3.7\torch' cwd: C:\Users\LV7682\AppData\Local\Temp\pip-install-4b80gt33\torch\ Complete output (23 lines): running install running build_deps Traceback (most recent call last): File "<string>", line 1, in <module> File "C:\Users\LV7682\AppData\Local\Temp\pip-install-4b80gt33\torch\setup.py", line 265, in <module> description="Tensors and Dynamic neural networks in Python with strong GPU acceleration", File "c:\users\lv7682\documents\repos\security_patch\spms\webapp\securitypatchmanagementsystem\venv\venv\lib\site-packages\setuptools\__init__.py", line 163, in setup return distutils.core.setup(**attrs) File "C:\Users\LV7682\AppData\Local\Programs\Python\Python37-32\lib\distutils\core.py", line 148, in setup dist.run_commands() File "C:\Users\LV7682\AppData\Local\Programs\Python\Python37-32\lib\distutils\dist.py", line 966, in run_commands self.run_command(cmd) File "C:\Users\LV7682\AppData\Local\Programs\Python\Python37-32\lib\distutils\dist.py", line 985, in run_command cmd_obj.run() File "C:\Users\LV7682\AppData\Local\Temp\pip-install-4b80gt33\torch\setup.py", line 99, in run self.run_command('build_deps') File "C:\Users\LV7682\AppData\Local\Programs\Python\Python37-32\lib\distutils\cmd.py", line 313, in run_command self.distribution.run_command(command) File "C:\Users\LV7682\AppData\Local\Programs\Python\Python37-32\lib\distutils\dist.py", line 985, in run_command cmd_obj.run() File "C:\Users\LV7682\AppData\Local\Temp\pip-install-4b80gt33\torch\setup.py", line 51, in run from tools.nnwrap import generate_wrappers as generate_nn_wrappers ModuleNotFoundError: No module named 'tools.nnwrap' ---------------------------------------- ERROR: Command errored out with exit status 1: 'c:\users\lv7682\documents\repos\security_patch\spms\webapp\securitypatchmanagementsystem\venv\venv\scripts\python.exe' -u -c 'import sys , setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\LV7682\\AppData\\Local\\Temp\\pip-install-4b80gt33\\torch\\setup.py'"'"'; __file__='"'"'C:\\Users\\LV7682\\AppData\\Local\\Temp\\p ip-install-4b80gt33\\torch\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\LV7682\AppData\Local\Temp\pip-record-z5_fy7cc\install-record.txt' --single-version-externally-managed --compile --install-headers 'c:\user s\lv7682\documents\repos\security_patch\spms\webapp\securitypatchmanagementsystem\venv\venv\include\site\python3.7\torch' Check the logs for full command output.
Fixed: needed to use python 64-bit not 32-bit

Error while installing pygraphviz on OS X with Anaconda

I am trying to install pygraphviz in OS X 10.9.5. I am using Python 2.7.12 with Anaconda 2.1.0. I already have graphviz installed.
Here is the error I get when running pip install pygraphviz
#include "graphviz/cgraph.h"
^
compilation terminated.
error: command 'gcc' failed with exit status 1
----------------------------------------
Failed building wheel for pygraphviz
Running setup.py clean for pygraphviz
Failed to build pygraphviz
Installing collected packages: pygraphviz
Running setup.py install for pygraphviz ... error
Complete output from command /Users/safsafi/anaconda/bin/python -u -c "import setuptools, tokenize;__file__='/private/var/folders/vv/w5df7gw55bz_8bry85xf18rh0000gn/T/pip-build-QsLsqM/pygraphviz/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/vv/w5df7gw55bz_8bry85xf18rh0000gn/T/pip-_MkJKV-record/install-record.txt --single-version-externally-managed --compile:
running install
Trying pkg-config
Package libcgraph was not found in the pkg-config search path.
Perhaps you should add the directory containing `libcgraph.pc'
to the PKG_CONFIG_PATH environment variable
No package 'libcgraph' found
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/private/var/folders/vv/w5df7gw55bz_8bry85xf18rh0000gn/T/pip-build-QsLsqM/pygraphviz/setup.py", line 87, in <module>
tests_require=['nose>=0.10.1', 'doctest-ignore-unicode>=0.1.0',],
File "/Users/safsafi/anaconda/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/Users/safsafi/anaconda/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/Users/safsafi/anaconda/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup_commands.py", line 44, in modified_run
self.include_path, self.library_path = get_graphviz_dirs()
File "setup_extra.py", line 121, in get_graphviz_dirs
include_dirs, library_dirs = _pkg_config()
File "setup_extra.py", line 44, in _pkg_config
output = S.check_output(['pkg-config', '--libs-only-L', 'libcgraph'])
File "/Users/safsafi/anaconda/lib/python2.7/subprocess.py", line 574, in check_output
raise CalledProcessError(retcode, cmd, output=output)
subprocess.CalledProcessError: Command '['pkg-config', '--libs-only-L', 'libcgraph']' returned non-zero exit status 1
----------------------------------------
Command "/Users/safsafi/anaconda/bin/python -u -c "import setuptools, tokenize;__file__='/private/var/folders/vv/w5df7gw55bz_8bry85xf18rh0000gn/T/pip-build-QsLsqM/pygraphviz/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/vv/w5df7gw55bz_8bry85xf18rh0000gn/T/pip-_MkJKV-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/vv/w5df7gw55bz_8bry85xf18rh0000gn/T/pip-build-QsLsqM/pygraphviz/
I have also tried running :
conda install --channel https://conda.anaconda.org/garylschultz pygraphviz
Which does not give any error but import pygraphviz still don't work in python.
When I try import pygraphviz in python I get the following error:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Users/safsafi/anaconda/lib/python2.7/site-packages/pygraphviz/__init__.py", line 54, in <module>
from agraph import AGraph, Node, Edge, Attribute, ItemAttribute
File "/Users/safsafi/anaconda/lib/python2.7/site-packages/pygraphviz/agraph.py", line 20, in <module>
import graphviz as gv
File "/Users/safsafi/anaconda/lib/python2.7/site-packages/pygraphviz/graphviz.py", line 7, in <module>
import _graphviz
ImportError: dlopen(/Users/safsafi/anaconda/lib/python2.7/site-packages/pygraphviz/_graphviz.so, 2): Library not loaded: /opt/local/lib/libcgraph.6.dylib
Referenced from: /Users/safsafi/anaconda/lib/python2.7/site-packages/pygraphviz/_graphviz.so
Reason: image not found
Thanks in advance.
On Mac OSX, I solve it with:
pip install graphviz
pip install --install-option="--include-path=/opt/local/include" --install-option="--library-path=/opt/local/lib" pygraphviz
GitHub related issue

Categories