We Keep Coding

LightFM library install error on Sagemaker Notebook

I was using LightFM library on Sagemaker Notebook without any issue before.
However, from yesterday, I started seeing this error message and could no longer complete installation (pip install lightfm)
Building wheels for collected packages: lightfm
Building wheel for lightfm (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [176 lines of output]
/home/ec2-user/anaconda3/envs/python3/lib/python3.10/site-packages/setuptools/dist.py:775: UserWarning: Usage of dash-separated 'description-file' will not be supported in future versions. Please use the underscore name 'description_file' instead
...
...
...
...
In file included from /home/ec2-user/anaconda3/envs/python3/include/python3.10/unicodeobject.h:1046:0,
from /home/ec2-user/anaconda3/envs/python3/include/python3.10/Python.h:83,
from lightfm/_lightfm_fast_openmp.c:20:
/home/ec2-user/anaconda3/envs/python3/include/python3.10/cpython/unicodeobject.h:551:42: note: declared here
Py_DEPRECATED(3.3) PyAPI_FUNC(PyObject*) PyUnicode_FromUnicode(
^~~~~~~~~~~~~~~~~~~~~
error: command '/usr/bin/gcc' failed with exit code 1
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> lightfm
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
I tried several suggestions I found from web, such as
pip install --upgrade pip
pip install --upgrade wheel
pip install --upgrade setuptools
pip install Cmake
pip install requests --no-dependencies
but none of these worked - still getting same error message.
How should I mitigate from this error?

This seems to be an issue with the lightfm package installation. Have you tried installing this in another environment? This can also be dependent on the notebook kernel you are using. Can you try installing in a virtual environment as well?

Cmake problems after upgrading to MacOS 13.0

As mentioned on the title, CMake seems to be broken after upgrading to MacOS 13.0.
Trying to install something that requires Cmakes takes unusually long then the following pop-up shows up.
“CMake” is damaged and can’t be opened. You should move it to the Trash.
This file was downloaded on an unknown date. # this txt is grey and smaller font
Pop-up Options
1. Move to Trash 2. Cancel
Steps to reproduce Err
Cloned EasyOCR
1.1 git clone ...
Made Python venv
2.0. cd EasyOCR/
2.1. python3 -m venv venv
2.2. source venv/bin/activate
2.3. venv info
python --version && pip --version
# output
Python 3.10.6
pip 22.3 from ... # path to venv dir
pip install -r requirements.txt
# requirements.txt content
torch
torchvision>=0.5
opencv-python-headless<=4.5.4.60
scipy
numpy
Pillow
scikit-image
python-bidi
PyYAML
Shapely
pyclipper
ninja
After a while, the aforementioned pop-up, shows up. Clicking on either option will result in the following error.
Building wheels for collected packages: opencv-python-headless
Building wheel for opencv-python-headless (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for opencv-python-headless (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [9 lines of output]
File "/private/var/folders/5h/36chnb_s3b5fpqmqgt_7cz_m0000gn/T/pip-build-env-ea_5u80v/overlay/lib/python3.10/site-packages/skbuild/setuptools_wrap.py", line 613, in setup
cmkr = cmaker.CMaker(cmake_executable)
File "/private/var/folders/5h/36chnb_s3b5fpqmqgt_7cz_m0000gn/T/pip-build-env-ea_5u80v/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 141, in __init__
self.cmake_version = get_cmake_version(self.cmake_executable)
File "/private/var/folders/5h/36chnb_s3b5fpqmqgt_7cz_m0000gn/T/pip-build-env-ea_5u80v/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 95, in get_cmake_version
raise SKBuildError(
Traceback (most recent call last):
Problem with the CMake installation, aborting build. CMake executable is cmake
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for opencv-python-headless
Failed to build opencv-python-headless
ERROR: Could not build wheels for opencv-python-headless, which is required to install pyproject.toml-based projects
Any thoughts on how to fix or get around this? This is the first time I see this pop up.

The pip package is broken on macOS 13 prior to CMake 3.24.2 due to improper code signing. You should upgrade CMake in your virtual environment by running:
$ python -m pip install -U pip setuptools wheel
$ python -m pip install -U 'cmake>=3.24.2'
As CMake is extremely backwards compatible, it should be safe. You can also add cmake>=3.24.2 to your requirements.txt.

I am stack with errors using this command pip install nvidia-tensorflow[horovod]

(tensorholo) C:\Users\alaba\Desktop\MIT PROJECT\tensor_holography-main>pip install nvidia-tensorflow[horovod]
Collecting nvidia-tensorflow[horovod]
Downloading nvidia-tensorflow-0.0.1.dev5.tar.gz`` (7.9 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [19 lines of output]
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\Users\alaba\AppData\Local\Temp\pip-install-ztjzt002\nvidia-tensorflow_001bf7a090024c37a3c7ff91374ac7c4\setup.py", line 150, in <module>
raise RuntimeError(open("ERROR.txt", "r").read())
RuntimeError:
###########################################################################################
The package you are trying to install is only a placeholder project on PyPI.org repository.
This package is hosted on NVIDIA Python Package Index.
This package can be installed as:
```
$ pip install nvidia-pyindex
$ pip install nvidia-tensorflow
```
Please refer to NVIDIA instructions: https://github.com/NVIDIA/tensorflow#install.
###########################################################################################
This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

nvidia-tensorflow[horovod] package doesn't support the Windows platform. You'd need to run it inside a WSL2 (Windows Subsystem for Linux version 2) to make it work on Windows.
Like the official docs say:
The nvidia-tensorflow package includes CPU and GPU support for Linux.
And also this issue on the same repository:

I am running into errors installing a requirements.txt. The issue I am having is with pillow

I am relatively new to the world of coding and am mostly self taught. Currently I am working on a project via a repository from GitHub. One of the steps in working with the code is to install python dependencies via a requirements.txt
I am currently running into errors with pillow. I am working in windows, and currently have python 3.9.7 and conda 4.13.0. When I run the python -m pip install --upgrade -r requirements.txt i get errors as follows:
1) Building wheels for collected packages: pillow
Building wheel for pillow (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [189 lines of output]
C:\Users\kj\AppData\Local\Temp\pip-install-hsdc08bl\pillow_07ce73d2c2484297acb81cb082ed4b48\setup.py:29: RuntimeWarning: Pillow does not yet support Python 3.9 and does not yet provide prebuilt Windows binaries. We do not recommend building from source on Windows.
2) During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\Users\kj\AppData\Local\Temp\pip-install-hsdc08bl\pillow_07ce73d2c2484297acb81cb082ed4b48\setup.py", line 888, in <module>
raise RequiredDependencyException(msg)
__main__.RequiredDependencyException:
The headers or library files could not be found for zlib,
a required dependency when compiling Pillow from source.
Please see the install instructions at:
https://pillow.readthedocs.io/en/latest/installation.html
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for pillow
3) Running setup.py clean for pillow
Failed to build pillow
Installing collected packages: pillow, h5py, pandas, matplotlib, sklearn, scikit-image
Attempting uninstall: pillow
Found existing installation: Pillow 9.1.1
Uninstalling Pillow-9.1.1:
Successfully uninstalled Pillow-9.1.1
Running setup.py install for pillow ... error
error: subprocess-exited-with-error
× Running setup.py install for pillow did not run successfully.
│ exit code: 1
╰─> [193 lines of output]
C:\Users\kj\AppData\Local\Temp\pip-install-hsdc08bl\pillow_07ce73d2c2484297acb81cb082ed4b48\setup.py:29: RuntimeWarning: Pillow does not yet support Python 3.9 and does not yet provide prebuilt Windows binaries. We do not recommend building from source on Windows.
4) The headers or library files could not be found for zlib,
a required dependency when compiling Pillow from source.
Please see the install instructions at:
https://pillow.readthedocs.io/en/latest/installation.html
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
WARNING: No metadata found in c:\programdata\anaconda3\lib\site-packages
Rolling back uninstall of pillow
Moving to c:\programdata\anaconda3\lib\site-packages\pil\
from C:\ProgramData\Anaconda3\Lib\site-packages\~il
Moving to c:\programdata\anaconda3\lib\site-packages\pillow-9.1.1.dist-info\
from C:\ProgramData\Anaconda3\Lib\site-packages\~illow-9.1.1.dist-info
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> pillow
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
These are all the errors I get when I run the install of requirements.txt. I have done some research on my own before looking for help as there are similar questions I have come across. One issue is that pillow does not yet support python 3.9. However, on pillows readthedoc it claims that python 3.9 is supported by pillow >=9.0, and I have pillow 9.1.1 installed. Another issue I see is the headers or library files could not be found for zlib, yet I have used conda install -c anaconda zlib.
To reiterate, I am relatively still a beginner with code. I would appreciate any friendly advice with my current issues.
Thank you

When installing this library, pip tried to find a pre-compiled binary (bdist_wheel) but couldn't find one that matches your python version and OS. So it tried to build it from source, but you don't have zlib installed on your machine. zlib is another program that is used in the python build process. You can install it for windows from here, or I think it is bundled with Python if you install Python using the "Full Installer" as described here: https://docs.python.org/3/using/windows.html

Trying to install onnx using pip and it throwing error: metadata-generation-failed

So i trying to install onnx using pip install.
OS: Windows 10 LTSC Build 17763
(i installed all packages from requirements.txt using pip install -r | onnx entry in req.txt "# onnx>=1.9.0 # ONNX export" but onnx won't install)
I try to install it using:
pip install onnx
pip3 install
pip install onnx>=1.9.0
pip3 install onnx>=1.9.0
on python versions
3.7.0
3.10.4
3.9.something
i try to download onnx : pip download onnx
and every time i get this:
Collecting onnx
Using cached onnx-1.11.0.tar.gz (9.9 MB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [7 lines of output]
fatal: not a git repository (or any of the parent directories): .git
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\Users\Red007Master\AppData\Local\Temp\pip-download-coisn9j3\onnx_f49974f8ac4344abaca0eecae41c15e4\setup.py", line 86, in <module>
assert CMAKE, 'Could not find "cmake" executable!'
AssertionError: Could not find "cmake" executable!
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
what is "cmake" where i can get it and how i can fix it? + why i need that "cmake" only for this package?
AND what alternative was on downloading/installing packages i have? + what i'm doing wrong.

Download (and install + add to PATH) CMake from cmake.org/download/ and use fresh venv on python version 3.9.2.

just install cmake:
sudo apt install cmake