We Keep Coding

Python 3 `venv` and the `wheel` package

Starting with python3.8, I noticed that the wheel package seems to be required to pip install packages without errors (at least they look like errors, but behave like warnings).
Note: in all of my examples, I am cleaning up in between by deactivating my environment, removing the environment, and clearing my pip cache:
deactivate
rm test_env/ -rf
rm ~/.cache/pip/ -rf
Example 1: The problem
python3.8 -m venv test_env
source test_env/bin/activate
pip install markuppy
I get the following output:
Collecting markuppy
Downloading MarkupPy-1.14.tar.gz (6.8 kB)
Building wheels for collected packages: markuppy
Building wheel for markuppy (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /home/k/test_env/bin/python3.8 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-tfm9bgxv/markuppy/setup.py'"'"'; __file__='"'"'/tmp/pip-install-tfm9bgxv/markuppy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-cpx9gxcn
cwd: /tmp/pip-install-tfm9bgxv/markuppy/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for markuppy
Running setup.py clean for markuppy
Failed to build markuppy
Installing collected packages: markuppy
Running setup.py install for markuppy ... done
Successfully installed markuppy-1.14
It errored because there is no wheel package installed. This has been addressed in other posts on SO.
Example 2: Fixing the problem by installing wheel into the venv
If I install the wheel package directly after creating a new venv, this does not happen:
python3.8 -m venv test_env
source test_env/bin/activate
pip install wheel
pip install markuppy
Output:
Collecting markuppy
Using cached MarkupPy-1.14.tar.gz (6.8 kB)
Building wheels for collected packages: markuppy
Building wheel for markuppy (setup.py) ... done
Created wheel for markuppy: filename=MarkupPy-1.14-py3-none-any.whl size=7413 sha256=52b3e5c3e317ae21724acd871fe3deb85dde9df305b20d16f2c5592c43b11e91
Stored in directory: /home/k/.cache/pip/wheels/95/13/60/31c9d5f4cd012e491aeac154ef8b0ec964916523623eb02f0b
Successfully built markuppy
Installing collected packages: markuppy
Successfully installed markuppy-1.14
This also works given a requirements.txt file.
requirements.txt:
markuppy
python3.8 -m venv test_env
source test_env/bin/activate
pip install wheel
pip install -r requirements.txt
Output:
Collecting markuppy
Using cached MarkupPy-1.14.tar.gz (6.8 kB)
Building wheels for collected packages: markuppy
Building wheel for markuppy (setup.py) ... done
Created wheel for markuppy: filename=MarkupPy-1.14-py3-none-any.whl size=7413 sha256=52b3e5c3e317ae21724acd871fe3deb85dde9df305b20d16f2c5592c43b11e91
Stored in directory: /home/k/.cache/pip/wheels/95/13/60/31c9d5f4cd012e491aeac154ef8b0ec964916523623eb02f0b
Successfully built markuppy
Installing collected packages: markuppy
Successfully installed markuppy-1.14
Example 3: Adding the wheel package to requirements.txt does not help
It's important to know that if you place the wheel package into the requirements.txt file, and do not install it separately, you get the same problem as in Example 1:
requirements.txt:
wheel
markuppy
python3.8 -m venv test_env
source test_env/bin/activate
pip install -r requirements.txt
Output:
Collecting wheel
Downloading wheel-0.37.0-py2.py3-none-any.whl (35 kB)
Collecting markuppy
Downloading MarkupPy-1.14.tar.gz (6.8 kB)
Building wheels for collected packages: markuppy
Building wheel for markuppy (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /home/k/test_env/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-z7cqzaej/markuppy/setup.py'"'"'; __file__='"'"'/tmp/pip-install-z7cqzaej/markuppy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-kw3_8ayt
cwd: /tmp/pip-install-z7cqzaej/markuppy/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for markuppy
Running setup.py clean for markuppy
Failed to build markuppy
Installing collected packages: wheel, markuppy
Running setup.py install for markuppy ... done
Successfully installed markuppy-1.14 wheel-0.37.0
Wheel installed properly, but was not there in time to install the markuppy package.
Example 4: Installing wheel at the system level does not help
If I install the wheel package directly into the system itself, the venv that was created does not have access to it, so I get the same result as in Example 1.
sudo apt install python3-wheel
python3.8 -m venv test_env
source test_env/bin/activate
pip install markuppy
Output:
Collecting markuppy
Downloading MarkupPy-1.14.tar.gz (6.8 kB)
Building wheels for collected packages: markuppy
Building wheel for markuppy (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /home/k/test_env/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-5xkssq1l/markuppy/setup.py'"'"'; __file__='"'"'/tmp/pip-install-5xkssq1l/markuppy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-aunof5xf
cwd: /tmp/pip-install-5xkssq1l/markuppy/
Complete output (6 lines):
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for markuppy
Running setup.py clean for markuppy
Failed to build markuppy
Installing collected packages: markuppy
Running setup.py install for markuppy ... done
Successfully installed markuppy-1.14
Example 5: Installing wheel at the system level and granting venv access to system site packages works
If I install wheel at the system level, then grant my venv access to system site packages (note the flag on the venv command) when I create it, then this issue does not happen.
sudo apt install python3-wheel
python3.8 -m venv test_env --system-site-packages
source test_env/bin/activate
pip install markuppy
Output:
Collecting markuppy
Downloading MarkupPy-1.14.tar.gz (6.8 kB)
Building wheels for collected packages: markuppy
Building wheel for markuppy (setup.py) ... done
Created wheel for markuppy: filename=MarkupPy-1.14-py3-none-any.whl size=7414 sha256=cefe8d9f20cecaf72253cab1e18acbdcb6d30827d7a3fd5a74bbef4935bc2e44
Stored in directory: /home/k/.cache/pip/wheels/95/13/60/31c9d5f4cd012e491aeac154ef8b0ec964916523623eb02f0b
Successfully built markuppy
Installing collected packages: markuppy
Successfully installed markuppy-1.14
The obvious downside to this approach is that it breaks isolation between your project's venv and the python packages installed on the system itself.
Example 6: None of this happens in Python3.7
python3.7 -m venv test_env
source test_env/bin/activate
pip install -U pip
pip install markuppy
Output:
Collecting markuppy
Downloading MarkupPy-1.14.tar.gz (6.8 kB)
Using legacy 'setup.py install' for markuppy, since package 'wheel' is not installed.
Installing collected packages: markuppy
Running setup.py install for markuppy ... done
Successfully installed markuppy-1.14
Although it does provide a warning that pip used setup.py install in lieu of wheel.
The Question
How are we supposed to deal with this wheel package? It seems that it's expected that we all have this package installed in most (all?) environments, but the environment tooling in the standard library does not automatically provide it.
I like the idea of keeping my project environments completely isolated from the system python environment, so it looks like the only options that I can see are:
Manually install the wheel package immediately after creating a new venv.
Using another tool besides venv to manage environments.

When setting up a venv, before running anything else, just run pip install --upgrade pip wheel first. This was a good practice anyhow to insure you're using the latest version of pip to resolve your dependencies, hence the warning:
WARNING: You are using pip version 22.0.4; however, version 22.2.2 is available.
You should consider upgrading via the '/home/user/tmp/test_env/bin/python3 -m pip install --upgrade pip' command.
It does seem wheel is no longer included by default, as I was able to replicate on 3.10 as well. Specifying --system-site-packages to use system wheel would be expected, the whole point of venv is to avoid touching the system python. Not being used during a requirements.txt install also makes sense, as it's unlikely any of the packages have wheel listed as a dependency, so it's probably being installed in parallel.

pip cmake Failed to build dlib package

I'm trying to install dlib using cmd.
I installed cmake, wheel, opencv-python, cv2 and face_recognition successfully,
but I have trouble to install dlib.
If tried pip install dlib but it's not working.
I also download dlib-19.22.0.tar.
I'm getting this error message:
Collecting dlib
Using cached dlib-19.22.0.tar.gz (7.4 MB)
Building wheels for collected packages: dlib
Building wheel for dlib (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: 'd:\program files\python39\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\washi\\AppData\\Local\\Temp\\pip-install-_kij9b6z\\dlib\\setup.py'"'"'; __file__='"'"'C:\\Users\\washi\\AppData\\Local\\Temp\\pip-install-_kij9b6z\\dlib\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d 'C:\Users\washi\AppData\Local\Temp\pip-wheel-yhq98ysd'
cwd: C:\Users\washi\AppData\Local\Temp\pip-install-_kij9b6z\dlib\
Complete output (55 lines):
running bdist_wheel
running build
running build_py
package init file 'tools\python\dlib\__init__.py' not found (or not a regular file)
running build_ext
Building extension for Python 3.9.4 (tags/v3.9.4:1f2e308, Apr 6 2021, 13:40:21) [MSC v.1928 64 bit (AMD64)]
Invoking CMake setup: 'cmake C:\Users\washi\AppData\Local\Temp\pip-install-_kij9b6z\dlib\tools\python -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=C:\Users\washi\AppData\Local\Temp\pip-install-_kij9b6z\dlib\build\lib.win-amd64-3.9 -DPYTHON_EXECUTABLE=d:\program files\python39\python.exe -DCMAKE_LIBRARY_OUTPUT_DIRECTORY_RELEASE=C:\Users\washi\AppData\Local\Temp\pip-install-_kij9b6z\dlib\build\lib.win-amd64-3.9 -A x64'
-- Building for: Visual Studio 16 2019
-- Selecting Windows SDK version to target Windows 10.0.19041.
-- The C compiler identification is unknown
-- The CXX compiler identification is unknown
CMake Error at CMakeLists.txt:14 (project):
No CMAKE_C_COMPILER could be found.
CMake Error at CMakeLists.txt:14 (project):
No CMAKE_CXX_COMPILER could be found.
--Configuring incomplete, errors occurred!
----------------------------------------
ERROR: Failed building wheel for dlib
Running setup.py clean for dlib
Failed to build dlib
Installing collected packages: dlib
Running setup.py install for dlib ... error

Pip install qiskit: Command errored out with exit status 255:

I am trying to install Qiskit on elementaryOS juno running Python 3.7, using pip. I even upgraded to the latest pip.
I get the following log:
Building wheels for collected packages: qiskit
Building wheel for qiskit (setup.py) ... error
ERROR: Command errored out with exit status 255:
command: /home/laura/.pyenv/versions/anaconda3-2019.03/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-p35oetbg/qiskit/setup.py'"'"'; __file__='"'"'/tmp/pip-install-p35oetbg/qiskit/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-2ms47shp --python-tag cp37
cwd: /tmp/pip-install-p35oetbg/qiskit/
Complete output (1 lines):
running bdist_wheel
----------------------------------------
ERROR: Failed building wheel for qiskit
Running setup.py clean for qiskit
Failed to build qiskit
Installing collected packages: qiskit
Running setup.py install for qiskit ... done
Successfully installed qiskit-0.11.0

This error seems to be reported by various users as per issue log in the Qiskit GitHub repository. Could you please try the following steps.
Install Anaconda
Create a python 3.7 environment: conda create --name your_env python=3.7
conda activate your_env
pip install qiskit
You can report the specific details of the issues in the following GitHub repository issue log if it is persisting after following these steps.
Qiskit GitHub Repository Issue Log

Issues during installation of python jnius library. (dependencies?)

I would like to install jnius library for python using pip. I'm getting an error during installation. Here is what happend:
C:\Users\Janka\AppData\Local\Programs\Python\Python35-32>python.exe -m pip
install jnius
Collecting jnius
Using cached https://files.pythonhosted.org/packages/45/f5/5673f3906a9e8ca68cb7bc2d9a1eaa944c321271c4af621dbb51c13d385a/jnius-1.1.0.tar.gz
Requirement already satisfied: six>=1.7.0 in
c:\users\janka\appdata\local\programs\python\python35-32\lib\site-packages
(from jnius) (1.11.0)
Requirement already satisfied: cython in
c:\users\janka\appdata\local\programs\python\python35-32\lib\site-packages
(from jnius) (0.28.3)
Building wheels for collected packages: jnius
The first error I can't solve:
possibly, I do not have setup.py file. Can I install it somehow through pip? or what should I do? maybee I do have It, if so, where can I find it or how do I check it?
Running setup.py bdist_wheel for jnius ... error
Complete output from command
C:\Users\Janka\AppData\Local\Programs\Python\Python35-32\python.exe -u -c
"import setuptools,
tokenize;__file__='C:\\Users\\Janka\\AppData\\Local\\Temp\\pip-install-
pnoxk945\\jnius\\setup.py';f=getattr(tokenize, 'open', open)
(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code,
__file__, 'exec'))" bdist_wheel -d C:\Users\Janka\AppData\Local\Temp\pip-
wheel-ngvrr7r6 --python-tag cp35:
WARNING: Not able to assign machine() = AMD64 to a cpu value!
(Well, windows did not give up :D)
Using cpu = 'i386' instead!
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win32-3.5
copying jnius_config.py -> build\lib.win32-3.5
creating build\lib.win32-3.5\jnius
copying jnius\reflect.py -> build\lib.win32-3.5\jnius
copying jnius\signatures.py -> build\lib.win32-3.5\jnius
copying jnius\__init__.py -> build\lib.win32-3.5\jnius
running build_ext
cythoning jnius\jnius.pyx to jnius\jnius.c
building 'jnius' extension
Well, I need Microsoft Visual C++ 14.0, I tried the suggested link, but the web page says "expired account"
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual
C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
----------------------------------------
Failed building wheel for jnius
Running setup.py clean for jnius
Failed to build jnius
Installing collected packages: jnius
and again, the setup.py file..
Running setup.py install for jnius ... error
Complete output from command
C:\Users\Janka\AppData\Local\Programs\Python\Python35-32\python.exe -u -c
"import setuptools,
tokenize;__file__='C:\\Users\\Janka\\AppData\\Local\\Temp\\pip-install-
pnoxk945\\jnius\\setup.py';f=getattr(tokenize, 'open', open)
(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code,
__file__, 'exec'))" install --record C:\Users\Janka\AppData\Local\Temp\pip-
record-rdnylq3b\install-record.txt --single-version-externally-managed --
compile:
WARNING: Not able to assign machine() = AMD64 to a cpu value!
Using cpu = 'i386' instead!
running install
running build
running build_py
creating build
creating build\lib.win32-3.5
copying jnius_config.py -> build\lib.win32-3.5
creating build\lib.win32-3.5\jnius
copying jnius\reflect.py -> build\lib.win32-3.5\jnius
copying jnius\signatures.py -> build\lib.win32-3.5\jnius
copying jnius\__init__.py -> build\lib.win32-3.5\jnius
running build_ext
skipping 'jnius\jnius.c' Cython extension (up-to-date)
building 'jnius' extension
error: Microsoft Visual C++ 14.0 is required - again, where can I get it? / how do I install it?
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual
C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
----------------------------------------
Command "C:\Users\Janka\AppData\Local\Programs\Python\Python35-32\python.exe
-u -c "import setuptools,
tokenize;__file__='C:\\Users\\Janka\\AppData\\Local\\Temp\\pip-install-
pnoxk945\\jnius\\setup.py';f=getattr(tokenize, 'open', open)
(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code,
__file__, 'exec'))" install --record C:\Users\Janka\AppData\Local\Temp\pip-
record-rdnylq3b\install-record.txt --single-version-externally-managed --
compile" failed with error code 1 in C:\Users\Janka\AppData\Local\Temp\pip-
install-pnoxk945\jnius\
C:\Users\Janka\AppData\Local\Programs\Python\Python35-32>
(I am using windows 10)

You need to install Visual Studio 2015. During install tick the box for Languages--> C++.
Also you may need to set your environment variable
GYP_MSVS_VERSION = 2015
Alternatively you could download the C++ compiler for Python 2.7 here
https://www.microsoft.com/en-us/download/details.aspx?id=44266
More details on the installation can be found here
https://pyjnius.readthedocs.io/en/latest/installation.html#installation-for-windows

pip install pyemd error?

I'm trying to install pyemd package in Python through pip and getting following error:
C:\Users\dipanwita.neogy>pip install pyemd
Collecting pyemd
Using cached pyemd-0.4.3.tar.gz
Requirement already satisfied: numpy<2.0.0,>=1.9.0 in c:\users\dipanwita.neogy\a
naconda3\lib\site-packages (from pyemd)
Building wheels for collected packages: pyemd
Running setup.py bdist_wheel for pyemd ... error
Complete output from command C:\Users\dipanwita.neogy\Anaconda3\python.exe -u
-c "import setuptools, tokenize;__file__='C:\\Users\\DIPANW~1.NEO\\AppData\\Loca
l\\Temp\\pip-build-nk13uh5b\\pyemd\\setup.py';f=getattr(tokenize, 'open', open)(
__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __fil
e__, 'exec'))" bdist_wheel -d C:\Users\DIPANW~1.NEO\AppData\Local\Temp\tmpngn2np
rmpip-wheel- --python-tag cp36:
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win32-3.6
creating build\lib.win32-3.6\pyemd
copying pyemd\__about__.py -> build\lib.win32-3.6\pyemd
copying pyemd\__init__.py -> build\lib.win32-3.6\pyemd
running build_ext
building 'pyemd.emd' extension
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C+
+ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
----------------------------------------
Failed building wheel for pyemd
Running setup.py clean for pyemd
Failed to build pyemd
Installing collected packages: pyemd
Running setup.py install for pyemd ... error
Complete output from command C:\Users\dipanwita.neogy\Anaconda3\python.exe -
u -c "import setuptools, tokenize;__file__='C:\\Users\\DIPANW~1.NEO\\AppData\\Lo
cal\\Temp\\pip-build-nk13uh5b\\pyemd\\setup.py';f=getattr(tokenize, 'open', open
)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __f
ile__, 'exec'))" install --record C:\Users\DIPANW~1.NEO\AppData\Local\Temp\pip-e
rihhtfj-record\install-record.txt --single-version-externally-managed --compile:
running install
running build
running build_py
creating build
creating build\lib.win32-3.6
creating build\lib.win32-3.6\pyemd
copying pyemd\__about__.py -> build\lib.win32-3.6\pyemd
copying pyemd\__init__.py -> build\lib.win32-3.6\pyemd
running build_ext
building 'pyemd.emd' extension
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual
C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
----------------------------------------
Command "C:\Users\dipanwita.neogy\Anaconda3\python.exe -u -c "import setuptools,
tokenize;__file__='C:\\Users\\DIPANW~1.NEO\\AppData\\Local\\Temp\\pip-build-nk1
3uh5b\\pyemd\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read(
).replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install
--record C:\Users\DIPANW~1.NEO\AppData\Local\Temp\pip-erihhtfj-record\install-r
ecord.txt --single-version-externally-managed --compile" failed with error code
1 in C:\Users\DIPANW~1.NEO\AppData\Local\Temp\pip-build-nk13uh5b\pyemd\
I cannot find anything regarding this error. Please suggest me what should I do?

The error you are receiving is: error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools. You need to read the error message carefully.
You just need to go to the link they have provided for you and follow the instructions: http://landinghub.visualstudio.com/visual-cpp-build-tools

Following below steps helped me overcome the error:
While installing the Visual Studio: Download Visual Studio
-> Desktop development with C++
-> Check C++/CLI support for v142 build tools (14.24)
Having the below dependency ready:
get Python --Version in CLI.
Download and install whl file from Twisted WHL file
pip install C:\"Twisted‑19.10.0‑cp36‑cp36m‑win_amd64.whl"
Finally Run:
pip install -v pyemd