We Keep Coding

Issue installing Scrapy using Python 3.11 on Windows 11

I'm using Windows 11, Python 3.10.1. I created a virtual environment using venv, and installed scrapy, and all requirements. Everything worked perfectly! Then I installed Python 3.11.1, created a virtual environment using venv, installed scrapy, and I received an error:
Building wheel for twisted-iocpsupport (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for twisted-iocpsupport (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [5 lines of output]
running bdist_wheel
running build
running build_ext
building 'twisted_iocpsupport.iocpsupport' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for twisted-iocpsupport
Failed to build twisted-iocpsupport
ERROR: Could not build wheels for twisted-iocpsupport, which is required to install pyproject.toml-based projects
Issue of concern
I already had Microsoft Visual C++ 14.0 installed on my device, and I was able to run scrapy 2.7.1 successfully using Python 3.10. I only experienced this issue with Python 3.11.
Mitigation attempts
Installed a fresh copy of Microsoft Visual C++ 14.0 from the website ~ No resolve. ❌
Uninstalled, reinstalled Python 3.11 ensuring PATH was installed ~ No resolve. ❌
Created a virtual environment using pipenv, and Python 3.11. Same error as using venv ~ no resolve. ❌
Created a virtual environment using venv, and Python 3.10 ~ Scrapy works! ✅
Created a virtual environment using pipenv, and Python 3.10 ~ Scrapy works! ✅
So it seems like this is specific to Python 3.11 perhaps. So, right now I am back to using Python 3.10 for Scrapy projects.
Question
How can I resolve this issue, and use Python 3.11 for Scrapy projects?

MS Visual C++ not recognized when installing Python package

The problem
I am trying to install a Python package called dedupe. It's available with pip install dedupe, but get the following error:
Running setup.py install for Levenshtein-search ... error
error: subprocess-exited-with-error
[...]
Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft
C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools
But I have MS C++ Build Tools installed (the latest version).
And the strange thing is: I once had a 32bit version of Python 3.8 on my PC, and here, dedupe was installed without problems (but then didn't process my data due to a so called MemoryError – a problem I ascribe to the 32bit version).
What I tried
Uninstalled all Python interpreters on the system
Un- and re-installed MS C++ Build Tools
Re-installed Python 3.10 64bit
created a venv-environment with that interpreter
updated setuptools
But still, the error persists.
I have looked for similar questions and tried their solutions:
How to install Visual C++ Build Tools: I have Build Tools installed (Workload "Desktop Development with C++)
Installing Visual Studio doesn't do the job for me, including the latest answer. And the weird thing: While I wasn't able to install misaka, too (the package discussed in this question), installing spacy was not a problem (while some other person had problems with that).
So?
Does anybody have an idea why my 64bit Python might not recognize Visual C++?

Error with simplejson dependency when installing Eve

I am new to Python and am trying to install Eve. I have Python 3.6.3 installed and am using pipenv. When I run pipenv install eve it fails with the error (here's an excerpt):
running build_ext
building 'simplejson._speedups' extension
error: [WinError 3] The system cannot find the path specified: 'C:\\Program Files (x86)\\Microsoft SDKs\\Windows\\v8.1\\lib'
_______________________________________
Error: An error occurred while installing eve!
Failed building wheel for simplejson
From what I can tell, this path is for the Windows 8.1 SDK.
What can I do to fix this? Do I need to install this SDK in order for simplejson to work? I don't really want to install this SDK, so why does simplejson need this?
I suspect that I don't actually need this SDK as I assume all of this can normally be executed in a Linux environment. Why would this dependency exist when executing on a Windows 7 machine as I am trying to do?

I found the answer. Yes, I do need the SDK. Windows compilers are required to "Install a non-pure Python package from sources with Pip" on Windows machines and are included in Microsoft Build Tools. More information can be found here: https://wiki.python.org/moin/WindowsCompilers

pip building wheel fails for pycddlib

I am having severe problems installing pycddlib for Python 3.6 on Windows 10.
The package can be found here. However there is no wheel for Python 3.6 and hence the provided wheels to not support my system.
I followed the instructions on this site to build a wheel. I tried to install Visual C++ Build Tools 2015 however I had no sucess in installing the package as pip install pycddlib throws the error
C:\Program Files (x86)\Microsoft Visual Studio
14.0\VC\BIN\x86_amd64\cl.exe' failed with exit status 2
Instead I installed Visual Studio 2017 with Python development workload and the Native development tools option. Trying to install pycddlib now does not throw the same error but simply the following error
Failed building wheel for pycddlib
This thread suggests that one has to install required packages first, but pycddlib does not seem to require anything else
This website suggests building instructions for the package pycddlib. Nonetheless I am lacking knowledge to update theses instructions in order to build the correct thing for my setup.
Thanks for your help!

The developer has added support for python 3.6. Hence there are working wheels for Python 3.6 under this link available now.

Error installing PyMVPA2

I'm getting the following error when I try to install using pip install for PyMVPA2 for Python. I have installed other libraries without any problems before. I would appreciate if anything could take a look at the errors:
C:\Users\usr>pip install pymvpa2
Collecting pymvpa2
Using cached pymvpa2-2.4.2.tar.gz
Complete output from command python setup.py egg_info:
running egg_info
running build_src
build_src
building extension "mvpa2.clfs.libsmlrc.smlrc" sources
building extension "mvpa2.clfs.libsvmc._svmc" sources
creating build
creating build\src.win32-2.7
creating build\src.win32-2.7\mvpa2
creating build\src.win32-2.7\mvpa2\clfs
creating build\src.win32-2.7\mvpa2\clfs\libsvmc
swig.exe++: mvpa2\clfs\libsvmc\svmc.i
swig.exe -python -I3rd\libsvm -c++ -I3rd\libsvm -o build\src.win32- 2.7\mvpa2\clfs\libsvmc\svmc_wrap.cpp -outdir build\src.win32-2.7\mvpa2\clfs\libsvmc mvpa2\clfs\libsvmc\svmc.i
error: command 'swig.exe' failed: No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in c:\users\usr\appdata\local\temp\pip-build-v_zzkd\pymvpa2\

As the error states you either don't have swig installed or it is not on your path. You are obviously on Windows so you need to download the swig executable from the swig website - download the latest windows package and either unzip it to a directory on your existing path or to a new directory and add it to your path. Easiest, of course, is to unzip it to a new directory and then run your pip command in that directory.
What is swig anyway? Swig parses the interface definitions of code written in C/C++ and can output 'glue code' to allow code written in Python & a pile, currently 22, of other programming or scripting languages to use the C/C++ code transparently. Swig is free, open source and compatible with both open source and commercial use.
Should I keep it to hand? In most cases that I know of in python swig is only invoked during the installation or setup phase but since that setup phase will be used every time that any package built with swig is installed or upgraded there is no reason to get rid of it and quite a lot of reasons to have it somewhere on your path.

sudo apt-get remove swig
sudo apt-get install swig3.0
sudo ln -s /usr/bin/swig3.0 /usr/bin/swig
and then
pip install pymvpa2