How to test a library against different Python *patch* versions? - python

I'm writing a library and want to test against different Python patch versions, like 3.7.1, 3.7.2, etc
I've been using tox for a long time, however, according to this answer, it doesn't really support this kind of usage.
Any suggestions?


For a one of check against 3.8.1 (assuming your python3.8 points to 3.8.2) you can use the discover flag
tox --discover /path/to/python3.8.1 -e py38
If you want to define an environment that always uses 3.8.1 you can do that by defining a new tox environment and setting basepython as python3.8.1.
[testenv:py381]
basepython = python3.8.1
[testenv:py382]
basepython = python3.8.2


Probably the least troublesome (but tedious) way is to install different versions of Python sequentially in a jail or VM and then test your code on it.
If you install Python from source on a UNIX-like system, you could try installing them side by side using different prefixes (eg /opt/patch1, opt/patch2 etc.)
And then expliticly run your test with the correct python like /opt/patch1/bin/python3. One caveat; I'm not sure if the Python executable would find the correct shared library in this case.
The ms-windows installer lets you pick an install location. If you instruct it not to put Python in the PATH and not set up file associations and the like, that might also work. You would also have to explicitly invoke the correct Python with the full path.


I would go Docker and run it container.
$ docker run -it --rm -w /opt -v "$PWD:/opt" python:3.4.2 python <script.py>
-it - interactive mode
--rm - remove container after the run
-w - working directory inside container
-v - map directory $PWD from host to /opt inside container
<container> - python:3.4.2
<command> - python script.py
You can see what images are available with the command:
$ curl -s https://registry.hub.docker.com/v1/repositories/python/tags | \
jq -r .[].name | grep "^[23][.0-9]*$" | sort -V
2
2.7
2.7.7
2.7.8
2.7.9
2.7.10
2.7.11
2.7.12
2.7.13
2.7.14
2.7.15
2.7.16
3
3.2
3.2.6
3.3
3.3.5
3.3.6
3.3.7
3.4
3.4.1
3.4.2
3.4.3
3.4.4
3.4.5
3.4.6
3.4.7
3.4.8
3.4.9
3.4.10
3.5
3.5.0
3.5.1
3.5.2
3.5.3
3.5.4
3.5.5
3.5.6
3.5.7
3.6
3.6.0
3.6.1
3.6.2
3.6.3
3.6.4
3.6.5
3.6.6
3.6.7
3.6.8
3.6.9
3.7
3.7.0
3.7.1
3.7.2
3.7.3
3.7.4
grep filters out beta and alpha versions, so if you need them - just remove the grep.
If you need Python version that is not present in the list, you can build docker image with custom Python.
take eg Alpine linux (it's really small)
https://github.com/docker-library/python/blob/f82205cde8f0a5ffa276103a50d843edced67757/3.7/alpine3.10/Dockerfile

Related

Python Multiple version installation in Linux rocky

I am new to Python and Linux env, so a little confused.
I want to find where my Python3.9 is installed, so that I can update the PATH..
Running python --version or python3 --version give me Python 3.6.8
I want to install Python 3.9, so when I run sudo dnf install -y python39 it gives me
Package python39-3.9.12-1ep1.el8.x86_64 is already installed.
ls /usr/bin/python* doesn't show 3.9
Output of above command - /usr/bin/python /usr/bin/python3 /usr/bin/python3.6
/usr/bin/python3.6m
Also tried alternatives --config python but it shows only 3.6
-----------------------------------------------
* 1 /usr/libexec/no-python
+ 2 /usr/bin/python3
which python3.6 gives /usr/bin/python3.6
which python3.9 gives /usr/bin/which: no python3.9 in....
rpm -ql python39-3.9.12-1ep1.el8.x86_64 gives me
/etc/gdbinit.d/python39.gdb. /opt/python3.9.
/opt/python3.9/bin
I could be missing something obvious, if someone can point me in the right direction it will be awesome.

what happens when you enter the following command: python3 --version and is it any different compared to running python --version?

I am not sure what is your actual requirement is. But if you have already installed python 3.9 in your machine, then you can have this and all previous versions applied to different projects. This is selected when you create virtual environments. For example if you want to run a project that built on 3.6, then you can select python interpreter 3.6 at the time of creation.

So the virtual machine I was working was built using vagrant, it had python 3.6 in usr/bin and python 3.9 in opt/python3.9. Newbie like me who wanna understand what /opt is - https://www.baeldung.com/linux/opt-directory
To search any package used command - rpm -ql python39-3.9.12-1ep1.el8.x86_64
Once package is found add it to path as symlinking binaries can be confusing
vim ~/.bashrc
PATH=/opt/python3.9/bin

Different python versions both os and pycharm

I am running on Ubuntu 18.04 and using Pycharm 2020.1. My system using Python version 3.7.6 and Pycharm using 3.6. And this makes conflicts.
$ python --version
Python 3.7.6
$ ls /usr/bin/python*
/usr/bin/python /usr/bin/python2.7 /usr/bin/python3.6 /usr/bin/python3m
/usr/bin/python2 /usr/bin/python3 /usr/bin/python3.6m
I tried to change python interpreter but not showing in the list. What can I do for using same version both os and pycharm?

You need to choose System Interpreter option not Virtual Environment.
However, is highly not recommended.

How to check all versions of python installed on osx and centos

I just started setting up a centos server today and noticed that the default version of python on centos is set to 2.6.6. I want to use python 2.7 instead. I googled around and found that 2.6.6 is used by system tools such as YUM so I should not tamper with it. Then I opened up a terminal on my mac and found that I had python 2.6.8 and 2.7.5 and 3.3.3 installed. Sorry for the long story. In short I just want to know how to lookup all the version of python installed on centos so I don't accidentally install it twice.

The more easy way its by executing the next command:
ls -ls /usr/bin/python*
Output look like this:
/usr/bin/python /usr/bin/python2.7 /usr/bin/pythonw
/usr/bin/python-config /usr/bin/python2.7-config /usr/bin/pythonw2.7

we can directly use this to see all the pythons installed both by current user and the root by the following:
whereis python

Find out which version of Python is installed by issuing the command
python --version:
$ python --version
Python 2.7.10
If you see something like this, Python 2.7 is your default version. You can also see if you have Python 3 installed:
$ python3 --version
Python 3.7.2
If you also want to know the path where it is installed, you can issue the command "which" with python and python3:
$ which python
/usr/bin/python
$ which python3
/usr/local/bin/python3

Here is a cleaner way to show them (technically without symbolic links). This includes python2 and python3 installs:
ls -1 /usr/bin/python* | grep '.*[2-3]\(.[0-9]\+\)\?$'
Where grep filters the output of ls that that has that numeric pattern at the end ($).
Or using find:
find /usr/bin/python* ! -type l
Which shows all the different (!) of symbolic link type (-type l).

Use, yum list installed command to find the packages you installed.

COMMAND: python --version && python3 --version
OUTPUT:
Python 2.7.10
Python 3.7.1
ALIAS COMMAND: pyver
OUTPUT:
Python 2.7.10
Python 3.7.1
You can make an alias like "pyver" in your .bashrc file or else using a text accelerator like AText maybe.

As someone mentioned in a comment, you can use which python if it is supported by CentOS. Another command that could work is whereis python. In the event neither of these work, you can start the Python interpreter, and it will show you the version, or you could look in /usr/bin for the Python files (python, python3 etc).

It depends on your default version of python setup. You can query by Python Version:
python3 --version //to check which version of python3 is installed on your computer
python2 --version // to check which version of python2 is installed on your computer
python --version // it shows your default Python installed version.

compgen -c python | grep -P '^python\d'
This lists some other python things too, But hey, You can identify all python versions among them.

Sift through the output of this script.
sudo find / -name 'python*' -type f -exec du -h {} + | sort -r -h ~/Documents/python_locations.txt

ls -l /usr/bin/python* & ls -l /usr/local/bin/python*

I would add to #nurealam siddiq answer,
python --version // it shows your default Python installed version.
python2 --version // to check which version of python2 is installed
python3 --version //to check which version of python3 is installed
python3.X --version // to further check which python3.X is installed

To check python versions installed in your OS you can run the below commands:-
python2 -version
python3 -version

Virtualenv cannot specify minor Python version

virtualenv will not let me specify 2.7.5 in the command (the version of python I need), it only allows 2.7. However, specifying 2.7 gives me 2.7.4, the version below the one I need. Is this an inherent limitation of virtualenv or am I missing something?
$ virtualenv test/test --no-site-packages --python=python2.7
System is Ubuntu 13.04, which has Python 2.6.8, 2.7.4 and 3.3.1 installed.

Just download/make/install/apt-get/synaptic python 2.7.5 and point at it's path like so when creating a virtulenv:
virtualenv test/test -p /usr/bin/my_2.7.5_directory/python2.7

Mac OSX: Switch to Python 2.7.3

I've installed the Mac OSX Python 2.7.3, and tried switching to the new version:
$ python2.7 -V
Python 2.7.3 # It was installed
$ python -V
Python 2.6.1 # Default is 2.6
$ export VERSIONER_PYTHON_VERSION=2.5
$ python -V
Python 2.5.4 # I can switch to 2.5
$ export VERSIONER_PYTHON_VERSION=2.6
$ python -V
Python 2.6.1 # And 2.6
But:
$ export VERSIONER_PYTHON_VERSION=2.7
$ python -V
python: VERSIONER_PYTHON_VERSION environment variable error (ignored)
Python 2.6.1
Can't switch to 2.7! Why is that?

The python.org install will put a python executable in /usr/local/bin . Apple's python is in /usr/bin
To call the python.org python you can use its full path /usr/local/bin/python or change your path to put /usr/local/bin before /usr/bin. You will still be able to call Apple's python by using its full path /usr/bin/python
Some python installs e.g. Macports provide a tool that provides symbolic links to various python installs and allows you to switch between them.

I don't think we can switch the python version on the Mac OS X without resorting to something like MacPorts or ActivePython.

I think it's because VERSIONER_PYTHON_VERSION is specific to python packages built by apple.

Categories