I'm running a Ubuntu 18.04 system, recently installed a new ssd and mapped $HOME onto the ssd then moved the existing files onto it. Somehow, in that process I've mucked up my PYTHONPATH, I believe.
If I run twine upload dist/* I get the following error:
bash: /home/henry/.local/bin/twine: No such file or directory
If I run pip install twine, I get the following output:
Requirement already satisfied: twine in /usr/local/lib/python2.7/dist-packages (1.12.1)
Requirement already satisfied: setuptools>=0.7.0 in /home/henry/.local/lib/python2.7/site-packages (from twine) (39.1.0)
Requirement already satisfied: pkginfo>=1.4.2 in /home/henry/.local/lib/python2.7/site-packages (from twine) (1.4.2)
Requirement already satisfied: readme-renderer>=21.0 in /usr/local/lib/python2.7/dist-packages (from twine) (24.0)
Requirement already satisfied: requests!=2.15,!=2.16,>=2.5.0 in /home/henry/.local/lib/python2.7/site-packages (from twine) (2.18.4)
Requirement already satisfied: tqdm>=4.14 in /home/henry/.local/lib/python2.7/site-packages (from twine) (4.23.3)
Requirement already satisfied: requests-toolbelt>=0.8.0 in /home/henry/.local/lib/python2.7/site-packages (from twine) (0.8.0)
Requirement already satisfied: Pygments in /home/henry/.local/lib/python2.7/site-packages (from readme-renderer>=21.0->twine) (2.2.0)
Requirement already satisfied: six in /home/henry/.local/lib/python2.7/site-packages (from readme-renderer>=21.0->twine) (1.11.0)
Requirement already satisfied: bleach>=2.1.0 in /usr/local/lib/python2.7/dist-packages (from readme-renderer>=21.0->twine) (3.0.2)
Requirement already satisfied: docutils>=0.13.1 in /home/henry/.local/lib/python2.7/site-packages (from readme-renderer>=21.0->twine) (0.14)
Requirement already satisfied: idna<2.7,>=2.5 in /home/henry/.local/lib/python2.7/site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (2.6)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /home/henry/.local/lib/python2.7/site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (1.22)
Requirement already satisfied: certifi>=2017.4.17 in /home/henry/.local/lib/python2.7/site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (2018.1.18)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/henry/.local/lib/python2.7/site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (3.0.4)
Requirement already satisfied: webencodings in /usr/lib/python2.7/dist-packages (from bleach>=2.1.0->readme-renderer>=21.0->twine) (0.5)
echo "PYTHONPATH=$PYTHONPATH" gives me PYTHONPATH=
What do I do to correct?
use
python -m twine upload dist/*
Related
I am working on Jupyter Lab, and I opened the terminal. I tried to install the module spacy, but when I came to the part where it said $ python ..., it said /bin/bash: python: command not found.
My code:
$ pip install -U pip setuptools wheel
$ pip install -U spacy
$ python -m spacy download en_core_web_sm
The output:
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: pip in /usr/local/lib/python3.8/dist-packages (23.0)
Requirement already satisfied: setuptools in /home/repl/.local/lib/python3.8/site-packages (67.2.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.38.4)
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: spacy in /home/repl/.local/lib/python3.8/site-packages (3.5.0)
Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.8/dist-packages (from spacy) (3.0.8)
Requirement already satisfied: typer<0.8.0,>=0.3.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (0.7.0)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4 in /usr/local/lib/python3.8/dist-packages (from spacy) (1.10.2)
Requirement already satisfied: requests<3.0.0,>=2.13.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (2.28.1)
Requirement already satisfied: wasabi<1.2.0,>=0.9.1 in /usr/local/lib/python3.8/dist-packages (from spacy) (0.10.1)
Requirement already satisfied: numpy>=1.15.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (1.23.2)
Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (21.3)
Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (3.3.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from spacy) (3.1.2)
Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from spacy) (2.0.7)
Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.11 in /home/repl/.local/lib/python3.8/site-packages (from spacy) (3.0.12)
Requirement already satisfied: srsly<3.0.0,>=2.4.3 in /usr/local/lib/python3.8/dist-packages (from spacy) (2.4.5)
Requirement already satisfied: pathy>=0.10.0 in /home/repl/.local/lib/python3.8/site-packages (from spacy) (0.10.1)
Requirement already satisfied: smart-open<7.0.0,>=5.2.1 in /usr/local/lib/python3.8/dist-packages (from spacy) (5.2.1)
Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /usr/local/lib/python3.8/dist-packages (from spacy) (2.0.8)
Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (4.64.0)
Requirement already satisfied: thinc<8.2.0,>=8.1.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (8.1.5)
Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (1.0.9)
Requirement already satisfied: setuptools in /home/repl/.local/lib/python3.8/site-packages (from spacy) (67.2.0)
Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /usr/local/lib/python3.8/dist-packages (from spacy) (1.0.3)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging>=20.0->spacy) (3.0.9)
Requirement already satisfied: typing-extensions>=4.1.0 in /usr/local/lib/python3.8/dist-packages (from pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4->spacy) (4.3.0)
Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests<3.0.0,>=2.13.0->spacy) (2.8)
Requirement already satisfied: charset-normalizer<3,>=2 in /usr/local/lib/python3.8/dist-packages (from requests<3.0.0,>=2.13.0->spacy) (2.0.12)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests<3.0.0,>=2.13.0->spacy) (2019.11.28)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3/dist-packages (from requests<3.0.0,>=2.13.0->spacy) (1.25.8)
Requirement already satisfied: confection<1.0.0,>=0.0.1 in /usr/local/lib/python3.8/dist-packages (from thinc<8.2.0,>=8.1.0->spacy) (0.0.3)
Requirement already satisfied: blis<0.8.0,>=0.7.8 in /usr/local/lib/python3.8/dist-packages (from thinc<8.2.0,>=8.1.0->spacy) (0.7.9)
Requirement already satisfied: click<9.0.0,>=7.1.1 in /usr/local/lib/python3.8/dist-packages (from typer<0.8.0,>=0.3.0->spacy) (8.1.3)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->spacy) (2.1.1)
/bin/bash: python: command not found
And the whole point of this was to load the spacy 'en_core_web_sm' tool.
If this is unfixable, then what other ways are there to load the en_core_web_sm model?
When i was running stable-diffusion-webui's preprocess images feature on MacBookpro M1 + macos12.6 + python3.10, it says:
File "user/Desktop/stable-diffusion-webui/modules/deepbooru.py", line 88, in get_deepbooru_tags_model
import deepdanbooru as dd
ModuleNotFoundError: No module named 'deepdanbooru'
somebody have any ideas how to slove this problem?
i also tried
git and reinstall through pip:
tensorflow-macos
tensorflow-io
deepdanbooru
but they all doesn't works
and im already install:
tensorflow-macos 2.1.0, tensorflow-io 0.27.0
when i run pip install deepdanbooru
result is:
Requirement already satisfied: deepdanbooru in /opt/homebrew/lib/python3.10/site-packages/deepdanbooru-1.0.0-py3.10.egg (1.0.0)
Requirement already satisfied: Click>=7.0 in /opt/homebrew/lib/python3.10/site-packages (from deepdanbooru) (8.1.3)
Requirement already satisfied: numpy>=1.16.2 in /opt/homebrew/lib/python3.10/site-packages (from deepdanbooru) (1.23.5)
Requirement already satisfied: scikit-image>=0.15.0 in /opt/homebrew/lib/python3.10/site-packages (from deepdanbooru) (0.19.3)
Requirement already satisfied: requests>=2.22.0 in /opt/homebrew/lib/python3.10/site-packages (from deepdanbooru) (2.28.1)
Requirement already satisfied: six>=1.13.0 in /opt/homebrew/lib/python3.10/site-packages (from deepdanbooru) (1.16.0)
Requirement already satisfied: idna<4,>=2.5 in /opt/homebrew/lib/python3.10/site-packages (from requests>=2.22.0->deepdanbooru) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in /opt/homebrew/lib/python3.10/site-packages (from requests>=2.22.0->deepdanbooru) (2022.9.24)
Requirement already satisfied: charset-normalizer<3,>=2 in /opt/homebrew/lib/python3.10/site-packages (from requests>=2.22.0->deepdanbooru) (2.1.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/homebrew/lib/python3.10/site-packages (from requests>=2.22.0->deepdanbooru) (1.26.12)
Requirement already satisfied: tifffile>=2019.7.26 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (2022.10.10)
Requirement already satisfied: pillow!=7.1.0,!=7.1.1,!=8.3.0,>=6.1.0 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (9.3.0)
Requirement already satisfied: scipy>=1.4.1 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (1.9.3)
Requirement already satisfied: packaging>=20.0 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (21.3)
Requirement already satisfied: imageio>=2.4.1 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (2.22.4)
Requirement already satisfied: networkx>=2.2 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (2.8.8)
Requirement already satisfied: PyWavelets>=1.1.1 in /opt/homebrew/lib/python3.10/site-packages (from scikit-image>=0.15.0->deepdanbooru) (1.4.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /opt/homebrew/lib/python3.10/site-packages (from packaging>=20.0->scikit-image>=0.15.0->deepdanbooru) (3.0.9)```
I am new to python so I am not using any environment, all I am doing is trying to install tensorflow using pip and getting the following:
> pip install tensorflow
Collecting tensorflow
Using cached tensorflow-2.3.1-cp38-cp38-win_amd64.whl (342.5 MB)
Requirement already satisfied: google-pasta>=0.1.8 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (0.2.0)
Requirement already satisfied: tensorboard<3,>=2.3.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (2.3.0)
Requirement already satisfied: grpcio>=1.8.6 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.33.2)
Requirement already satisfied: numpy<1.19.0,>=1.16.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.18.5)
Requirement already satisfied: astunparse==1.6.3 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.6.3)
Requirement already satisfied: opt-einsum>=2.3.2 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (3.3.0)
Requirement already satisfied: wrapt>=1.11.1 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.12.1)
Requirement already satisfied: wheel>=0.26 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (0.35.1)
Requirement already satisfied: h5py<2.11.0,>=2.10.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (2.10.0)
Requirement already satisfied: six>=1.12.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.15.0)
Requirement already satisfied: tensorflow-estimator<2.4.0,>=2.3.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (2.3.0)
Requirement already satisfied: gast==0.3.3 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (0.3.3)
Requirement already satisfied: absl-py>=0.7.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (0.11.0)
Requirement already satisfied: termcolor>=1.1.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.1.0)
Requirement already satisfied: keras-preprocessing<1.2,>=1.1.1 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (1.1.2)
Requirement already satisfied: protobuf>=3.9.2 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorflow) (3.13.0)
Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (1.7.0)
Requirement already satisfied: markdown>=2.6.8 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (3.3.3)
Requirement already satisfied: setuptools>=41.0.0 in c:\program files\windowsapps\pythonsoftwarefoundation.python.3.8_3.8.1776.0_x64__qbz5n2kfra8p0\lib\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (49.2.1)
Requirement already satisfied: werkzeug>=0.11.15 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (1.0.1)
Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (0.4.2)
Requirement already satisfied: google-auth<2,>=1.6.3 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (1.23.0)
Requirement already satisfied: requests<3,>=2.21.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from tensorboard<3,>=2.3.0->tensorflow) (2.24.0)
Requirement already satisfied: requests-oauthlib>=0.7.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard<3,>=2.3.0->tensorflow) (1.3.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from google-auth<2,>=1.6.3->tensorboard<3,>=2.3.0->tensorflow) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4; python_version >= "3.5" in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from google-auth<2,>=1.6.3->tensorboard<3,>=2.3.0->tensorflow) (4.6)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from google-auth<2,>=1.6.3->tensorboard<3,>=2.3.0->tensorflow) (4.1.1)
Requirement already satisfied: chardet<4,>=3.0.2 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from requests<3,>=2.21.0->tensorboard<3,>=2.3.0->tensorflow) (3.0.4)
Requirement already satisfied: idna<3,>=2.5 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from requests<3,>=2.21.0->tensorboard<3,>=2.3.0->tensorflow) (2.10)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from requests<3,>=2.21.0->tensorboard<3,>=2.3.0->tensorflow) (1.25.11)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from requests<3,>=2.21.0->tensorboard<3,>=2.3.0->tensorflow) (2020.11.8)
Requirement already satisfied: oauthlib>=3.0.0 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard<3,>=2.3.0->tensorflow) (3.1.0)
Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in c:\users\teren\appdata\local\packages\pythonsoftwarefoundation.python.3.8_qbz5n2kfra8p0\localcache\local-packages\python38\site-packages (from pyasn1-modules>=0.2.1->google-auth<2,>=1.6.3->tensorboard<3,>=2.3.0->tensorflow) (0.4.8)
Installing collected packages: tensorflow
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: 'C:\\Users\\teren\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.8_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python38\\site-packages\\tensorflow\\include\\external\\com_github_grpc_grpc\\src\\core\\ext\\filters\\client_channel\\lb_policy\\grpclb\\client_load_reporting_filter.h'
The pip version is 20.2.4 and the python version is 3.8.
I am using Windows 10 so I am not sure if this is a windows thing.
I see that the pip is using a cached package so I tried
pip --no-cache-dir install tensorflow
but I still get
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: 'C:\\Users\\teren\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.8_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python38\\site-packages\\tensorflow\\include\\external\\com_github_grpc_grpc\\src\\core\\ext\\filters\\client_channel\\lb_policy\\grpclb\\client_load_reporting_filter.h'
The problem with missing files during pip install on Windows happens when the path is too long.
You can fix this by using regedit, going to HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\FileSystem and changing the value of LongPathsEnabled to 1.
You need to create an environment which is recommended by tensorflow community
Please follow the following link
https://www.tensorflow.org/install/pip
Please ensure you follow this document step by step
Incase if you feel that its a lot of manual work then use Anaconda navigator
Click on Environments tab create Environment named tensorflow and then on to right download all packages which you need to install
Once done click on your new environment and launch jupyter notebook
I have an EC2 instance running Ubuntu 18.04. I had tensorflow 1.14 installed as I was trying to run a cloned repo but I needed to upgrade to tensorflow 2.2. I uninstalled tensorflow 1.14 and tried running pip install tensorflow but I get the following output:
Defaulting to user installation because normal site-packages is not writeable
Collecting tensorflow
Using cached tensorflow-2.2.0-cp36-cp36m-manylinux2010_x86_64.whl (516.2 MB)
Requirement already satisfied: termcolor>=1.1.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.1.0)
Requirement already satisfied: opt-einsum>=2.3.2 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (3.2.1)
Requirement already satisfied: google-pasta>=0.1.8 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (0.2.0)
Requirement already satisfied: absl-py>=0.7.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (0.9.0)
Requirement already satisfied: gast==0.3.3 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (0.3.3)
Requirement already satisfied: h5py<2.11.0,>=2.10.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (2.10.0)
Requirement already satisfied: wrapt>=1.11.1 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.12.1)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (0.34.2)
Requirement already satisfied: tensorboard<2.3.0,>=2.2.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (2.2.2)
Requirement already satisfied: numpy<2.0,>=1.16.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.18.5)
Requirement already satisfied: grpcio>=1.8.6 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.29.0)
Requirement already satisfied: tensorflow-estimator<2.3.0,>=2.2.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (2.2.0)
Requirement already satisfied: scipy==1.4.1; python_version >= "3" in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.4.1)
Requirement already satisfied: keras-preprocessing>=1.1.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.1.2)
Requirement already satisfied: six>=1.12.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.15.0)
Requirement already satisfied: astunparse==1.6.3 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (1.6.3)
Requirement already satisfied: protobuf>=3.8.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorflow) (3.12.2)
Requirement already satisfied: google-auth<2,>=1.6.3 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (1.16.1)
Requirement already satisfied: markdown>=2.6.8 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (3.2.2)
Requirement already satisfied: requests<3,>=2.21.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (2.23.0)
Requirement already satisfied: setuptools>=41.0.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (47.1.1)
Requirement already satisfied: werkzeug>=0.11.15 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (1.0.1)
Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (0.4.1)
Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (1.6.0.post3)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow) (4.1.0)
Requirement already satisfied: rsa<4.1,>=3.1.4 in /home/ubuntu/.local/lib/python3.6/site-packages (from google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow) (4.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/lib/python3/dist-packages (from google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow) (0.2.1)
Requirement already satisfied: importlib-metadata; python_version < "3.8" in /home/ubuntu/.local/lib/python3.6/site-packages (from markdown>=2.6.8->tensorboard<2.3.0,>=2.2.0->tensorflow) (1.6.1)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/lib/python3/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (1.22)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (2018.1.18)
Requirement already satisfied: idna<3,>=2.5 in /usr/lib/python3/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (2.6)
Requirement already satisfied: chardet<4,>=3.0.2 in /usr/lib/python3/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (3.0.4)
Requirement already satisfied: requests-oauthlib>=0.7.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard<2.3.0,>=2.2.0->tensorflow) (1.3.0)
Requirement already satisfied: pyasn1>=0.1.3 in /usr/lib/python3/dist-packages (from rsa<4.1,>=3.1.4->google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow) (0.4.2)
Requirement already satisfied: zipp>=0.5 in /home/ubuntu/.local/lib/python3.6/site-packages (from importlib-metadata; python_version < "3.8"->markdown>=2.6.8->tensorboard<2.3.0,>=2.2.0->tensorflow) (3.1.0)
Requirement already satisfied: oauthlib>=3.0.0 in /home/ubuntu/.local/lib/python3.6/site-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard<2.3.0,>=2.2.0->tensorflow) (3.1.0)
Installing collected packages: tensorflow
ERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device
I have an EBS volume with 11 GiB of free space mounted as /data/. This is the output of df -h:
Filesystem Size Used Avail Use% Mounted on
udev 1.9G 0 1.9G 0% /dev
tmpfs 376M 772K 375M 1% /run
/dev/xvda1 7.7G 5.6G 2.2G 73% /
tmpfs 1.9G 0 1.9G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup
/dev/loop0 94M 94M 0 100% /snap/core/8935
/dev/loop1 18M 18M 0 100% /snap/amazon-ssm-agent/1566
/dev/xvdb 50G 40G 11G 79% /data
/dev/loop2 98M 98M 0 100% /snap/core/9289
tmpfs 376M 0 376M 0% /run/user/1000
With pip, I tried specifying running with --no-cache-dir but it did not work. I set TMPDIR as my data partition; here is the output of echo $TMPDIR: /home/ubuntu/../../data (which is where my partition is)
I also tried pip install --build=/ tensorflow inside my data partition and got really odd behavior; it output:
Defaulting to user installation because normal site-packages is not writeable
Collecting tensorflow
Using cached tensorflow-2.2.0-cp36-cp36m-manylinux2010_x86_64.whl (516.2 MB)
ERROR: Could not install packages due to an EnvironmentError: [Errno 13] Permission denied: '/tensorflow/tensorflow'
Check the permissions.
I ran the same command with sudo and got:
The directory '/home/ubuntu/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/home/ubuntu/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Requirement already satisfied: tensorflow in /usr/local/lib/python2.7/dist-packages
Requirement already satisfied: grpcio>=1.8.6 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: mock>=2.0.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: keras-applications>=1.0.6 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: enum34>=1.1.6 in /usr/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: tensorboard<1.15.0,>=1.14.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: wrapt>=1.11.1 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: protobuf>=3.6.1 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: keras-preprocessing>=1.0.5 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: gast>=0.2.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: wheel in /usr/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: numpy<2.0,>=1.14.5 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: termcolor>=1.1.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: six>=1.10.0 in /usr/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: absl-py>=0.7.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: google-pasta>=0.1.6 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: backports.weakref>=1.0rc1 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: astor>=0.6.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow)
Requirement already satisfied: futures>=2.2.0; python_version < "3.2" in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.8.6->tensorflow)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /usr/local/lib/python2.7/dist-packages (from mock>=2.0.0->tensorflow)
Requirement already satisfied: h5py in /usr/local/lib/python2.7/dist-packages (from keras-applications>=1.0.6->tensorflow)
Requirement already satisfied: setuptools>=41.0.0 in /usr/local/lib/python2.7/dist-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow)
Requirement already satisfied: werkzeug>=0.11.15 in /usr/local/lib/python2.7/dist-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow)
Requirement already satisfied: markdown>=2.6.8 in /usr/local/lib/python2.7/dist-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow)
But this did not actually install tensorflow (as evidenced by pip list)
Requirement already satisfied: termcolor>=1.1.0 in /home/ubuntu/.local/lib/python3.6/site-packages
vs
Requirement already satisfied: tensorflow in /usr/local/lib/python2.7/dist-packages
When you are using sudo. It seems to be switching to a different python.
pip install --build=/ tensorflow
You used this with the absolute path pointing to root. Try with . relative to current directory or the absolute e.g. /home/ubuntu/../../data to your data partition. Making sure you have write permissions to that folder.
I need guidance on what I should do in this situation:
C:\Users\Dave\Desktop\2016Coding\testdist>pip install twine
Collecting twine
Using cached https://files.pythonhosted.org/packages/65/ae/9cfdff186dd4812c59bad890435538858f13fe43dbe6923e0fb20f0adfc8/twine-1.11.0-py2.py3-none-any.whl
Requirement already satisfied: requests!=2.15,!=2.16,>=2.5.0 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from twine) (2.18.4)
Requirement already satisfied: requests-toolbelt>=0.8.0 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from twine) (0.8.0)
Collecting pkginfo>=1.4.2 (from twine)
Using cached https://files.pythonhosted.org/packages/a3/fe/f32a48d48f40a7209be9825fba2566cab92364787cf37de2e08300dd6ce7/pkginfo-1.4.2-py2.py3-none-any.whl
Requirement already satisfied: tqdm>=4.14 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from twine) (4.23.1)
Requirement already satisfied: setuptools>=0.7.0 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from twine) (38.5.1)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (1.22)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (2018.1.18)
Requirement already satisfied: idna<2.7,>=2.5 in c:\users\dave\desktop\2016coding\environments\ipython_env\anaconda3\lib\site-packages (from requests!=2.15,!=2.16,>=2.5.0->twine) (2.6)
Installing collected packages: pkginfo, twine
Found existing installation: pkginfo 1.3.2
Cannot uninstall 'pkginfo'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
I can't find another reference to this issue anywhere on the web.
pip install twine --ignore-installed