We Keep Coding

Pip lists package as outdated but updating results in Requirement already satisfied

Solved using sudo pip install -U <package>
So when I do pip list --outdated I get:
Package Version Latest Type
----------------- ----------- ------ -----
anyio 3.3.3 3.3.4 wheel
cffi 1.14.6 1.15.0 wheel
contextlib2 0.6.0.post1 21.6.0 wheel
idna 3.2 3.3 wheel
ipywidgets 7.6.3 7.6.5 wheel
jsonschema 3.2.0 4.1.0 wheel
jupyter-client 6.1.12 7.0.6 wheel
keyring 23.0.1 23.2.1 wheel
matplotlib-inline 0.1.2 0.1.3 wheel
nbconvert 6.1.0 6.2.0 wheel
packaging 20.9 21.0 wheel
pandocfilters 1.4.3 1.5.0 wheel
pip 20.3.4 21.3 wheel
PyGObject 3.40.1 3.42.0 sdist
pyOpenSSL 20.0.1 21.0.0 wheel
pytz 2021.1 2021.3 wheel
pyzmq 22.2.1 22.3.0 wheel
resolvelib 0.5.5 0.8.1 wheel
setuptools 57.4.0 58.2.0 wheel
sip 4.19.25 6.3.1 wheel
terminado 0.11.1 0.12.1 wheel
trimesh 3.9.31 3.9.32 wheel
websocket-client 0.59.0 1.2.1 wheel
then when I do pip install anyio -U to update the first package I get:
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: anyio in ./.local/lib/python3.9/site-packages (3.3.4)
Requirement already satisfied: idna>=2.8 in ./.local/lib/python3.9/site-packages (from anyio) (3.3)
Requirement already satisfied: sniffio>=1.1 in /usr/lib/python3.9/site-packages (from anyio) (1.2.0)
As I understand the package is already updated, but pip still lists the package as outdated and also doesn't list it in the updated package list.
What is going on?

See this, and as you can guess the problem here is Defaulting to user installation because normal site-packages is not writeable which relates to some permission related issues which I am not sure of.
You can use here python3 -m pip install -U <package>.
A stable solution could be to reinstall python from scratch in your system.

Tensorflow Object Detection Api M1 Macbook Conflict Error

Machine: MacBook Air M1 2020
OS: macOs BigSur 11.4
Python version of venv: Python 3.8.6
Tensorflow version: ATF Apple Tensorflow 0.1a3
Pip version: 21.2.4
I have installed Tensorflow from github using this guide.
Now, my pip list is this.
Package Version
----------------------- ---------
absl-py 0.13.0
appnope 0.1.2
astunparse 1.6.3
backcall 0.2.0
cached-property 1.5.2
cachetools 4.2.2
certifi 2021.5.30
charset-normalizer 2.0.4
cycler 0.10.0
Cython 0.29.24
debugpy 1.4.1
decorator 5.0.9
entrypoints 0.3
flatbuffers 2.0
gast 0.5.2
google-auth 1.35.0
google-auth-oauthlib 0.4.5
google-pasta 0.2.0
grpcio 1.33.2
h5py 2.10.0
idna 3.2
ipykernel 6.2.0
ipython 7.26.0
ipython-genutils 0.2.0
jedi 0.18.0
jupyter-client 7.0.1
jupyter-core 4.7.1
Keras-Preprocessing 1.1.2
kiwisolver 1.3.1
Markdown 3.3.4
matplotlib 3.4.3
matplotlib-inline 0.1.2
nest-asyncio 1.5.1
numpy 1.18.5
oauthlib 3.1.1
opt-einsum 3.3.0
packaging 21.0
parso 0.8.2
pexpect 4.8.0
pickleshare 0.7.5
Pillow 8.3.1
pip 21.2.4
prompt-toolkit 3.0.20
protobuf 3.17.3
ptyprocess 0.7.0
pyasn1 0.4.8
pyasn1-modules 0.2.8
Pygments 2.10.0
pyparsing 2.4.7
python-dateutil 2.8.2
pyzmq 22.2.1
requests 2.26.0
requests-oauthlib 1.3.0
rsa 4.7.2
setuptools 57.4.0
six 1.16.0
tensorboard 2.6.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.0
tensorflow-addons 0.1a3
tensorflow-estimator 2.6.0
tensorflow-hub 0.12.0
tensorflow 0.1a3
termcolor 1.1.0
tornado 6.1
traitlets 5.0.5
typeguard 2.12.1
typing-extensions 3.10.0.0
urllib3 1.26.6
wcwidth 0.2.5
Werkzeug 2.0.1
wheel 0.37.0
wrapt 1.12.1
I want install Object Detection Api from Tensorflow in that link.
I cloned the repo and them I follow the guide. (Python Package Installation)
When I execute this command
python -m pip install --use-feature=2020-resolver .
It starts to download, and start a print very long errors.
At the end of the operations, it gives me this error.
Using cached scipy-1.2.3.tar.gz (23.3 MB)
Collecting pandas
Using cached pandas-1.3.2-cp38-cp38-macosx_11_0_arm64.whl
Collecting tf-models-official>=2.5.1
Using cached tf_models_official-2.6.0-py2.py3-none-any.whl (1.8 MB)
Collecting kaggle>=1.3.9
Using cached kaggle-1.5.12-py3-none-any.whl
Collecting py-cpuinfo>=3.3.0
Using cached py_cpuinfo-8.0.0-py3-none-any.whl
Requirement already satisfied: numpy>=1.15.4 in /Users/stefan/Desktop/Studio/TFOD/tf-m1/lib/python3.8/site-packages (from tf-models-official>=2.5.1->object-detection==0.1) (1.18.5)
Collecting opencv-python-headless
Using cached opencv_python_headless-4.5.3.56-cp38-cp38-macosx_11_0_arm64.whl (10.7 MB)
Collecting tf-models-official>=2.5.1
Using cached tf_models_official-2.5.1-py2.py3-none-any.whl (1.6 MB)
Collecting tensorflow-datasets
Using cached tensorflow_datasets-4.4.0-py3-none-any.whl (4.0 MB)
Collecting google-api-python-client>=1.6.7
Downloading google_api_python_client-2.18.0-py2.py3-none-any.whl (7.4 MB)
|████████████████████████████████| 7.4 MB 3.4 MB/s
Collecting oauth2client
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting tensorflow-model-optimization>=0.4.1
Using cached tensorflow_model_optimization-0.6.0-py2.py3-none-any.whl (211 kB)
Collecting pyyaml>=5.1
Downloading PyYAML-5.4.1.tar.gz (175 kB)
|████████████████████████████████| 175 kB 31.3 MB/s
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing wheel metadata ... done
Collecting gin-config
Using cached gin_config-0.4.0-py2.py3-none-any.whl (46 kB)
Collecting sacrebleu
Using cached sacrebleu-2.0.0-py3-none-any.whl (90 kB)
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of object-detection to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install object-detection because these package versions have conflicting dependencies.
The conflict is caused by:
tf-models-official 2.6.0 depends on tensorflow-text>=2.5.0
tf-models-official 2.5.1 depends on tensorflow-addons
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies

I have the same issue installing the Object Detection API for Tensorflow 2 (OD API) from sources on my MacBook Air M1 2020. It starts to lookup/download all available dependencies with very long errors and after several hours the process drains all available RAM and forces the laptop to reboot. I think the problem is with incompatible dependencies for arm64. I tried to build/install OD API for Tensorflow 1 instead and it worked! I successfully trained a model with TensorFlow 2 and GPU enabled.
Use the tf1 folder when you installing the OD API instead of tf2:
cd models/research
# Compile protos.
protoc object_detection/protos/*.proto --python_out=.
# Install TensorFlow Object Detection API.
cp object_detection/packages/tf1/setup.py .
python -m pip install --use-feature=2020-resolver .
or just use this guide for installing OD API: https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/tf1.md
By the way,
here is a working Tensorflow setup on Apple M1 silicon with the latest TensorFlow versions and Metal GPU acceleration: https://github.com/ctrahey/m1-tensorflow-config
the best guide for object detection: https://neptune.ai/blog/how-to-train-your-own-object-detector-using-tensorflow-object-detection-api

I successfully install it with.
python -m pip install --force --no-dependencies .
My list of commands for install correctly tf2.0 for m1
conda create —-name=tf-m1
conda activate tf-m1
conda install python=3.8.6 -y
sh Desktop/PATH TO GITHUB DIR OF TENSORFLOW MAC(i used 0.1a3)/install_venv.sh /Users/stefan/miniforge3/envs/tf-m1
python -m pip install --upgrade pip
pip install ipykernel jupyter
python -m ipykernel install --user --name=tensorflow-m1.0
Tensorflow Test : ok (import tensorflow as tf; print(tf.__version__))
NOW USE CONDA INSTALL
conda install -c conda-forge matplotlib -y
conda install -c conda-forge scikit-learn -y
conda install -c conda-forge opencv -y
conda install -c conda-forge pandas -y
Tensorflow Test : ok
cd Desktop/PATH/
mkdir -p Tensorflow/models
git clone https://github.com/tensorflow/models Tensorflow/models
cd Tensorflow/models/research && protoc object_detection/protos/*.proto --python_out=. && cp object_detection/packages/tf2/setup.py . && python -m pip install --force --no-dependencies .
Object detection api have some dependencies i had installed.
(Pyarrow and apache-beam are not supported at the moment, but I think this isn't essential for general working of api)
pip install tf-slim
pip install pycocotools
pip install lxml
pip install lvis
pip install contextlib2
pip install --no-dependencies tf-models-official
pip install avro-python3
pip install pyyaml
Pip install gin-config
I don't know if is it the perfect installation of Tensorflow and TensorFlow object-detection-api, but at the moment this worked for me.

Things should work better if you upgrade to OS Monterey and install conda from miniforge and the packages listed below.
As of Oct. 25, 2021 macOS 12 Monterey is generally available.
Upgrade your machine to Monterey.
If you have conda installed, uninstall it.
Then follow the instructions from Apple here.
Cleaned up below:
Download and install Conda from Miniforge:
chmod +x ~/Downloads/Miniforge3-MacOSX-arm64.sh
sh ~/Downloads/Miniforge3-MacOSX-arm64.sh
source ~/miniforge3/bin/activate
In a conda environment, install the TensorFlow dependencies, base TensorFlow, and TensorFlow metal:
conda install -c apple tensorflow-deps
pip install tensorflow-macos
pip install tensorflow-metal
You should be good to go.

pip does not install all of the packages if I ask it to do it just once

I have a fresh installation of python3 and python3-pip on Ubuntu.
I invoked the command:
pip3 install ansible packaging msrestazure docker-py ansible[azure] openshift
Then I invoked pip3 list. Here's the result:
root#7e8175337b62:/# pip3 list
Package Version
------------------- ---------
adal 1.2.4
ansible 2.9.11
cachetools 4.1.1
certifi 2020.6.20
cffi 1.14.1
chardet 3.0.4
cryptography 3.0
docker-py 1.10.6
docker-pycreds 0.4.0
google-auth 1.20.0
idna 2.10
isodate 0.6.0
Jinja2 2.11.2
kubernetes 11.0.0
MarkupSafe 1.1.1
msrest 0.6.18
msrestazure 0.6.4
oauthlib 3.1.0
openshift 0.11.2
packaging 20.4
pip 20.0.2
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycparser 2.20
PyJWT 1.7.1
pyparsing 2.4.7
python-dateutil 2.8.1
python-string-utils 1.0.0
PyYAML 5.3.1
requests 2.24.0
requests-oauthlib 1.3.0
rsa 4.6
ruamel.yaml 0.16.10
ruamel.yaml.clib 0.2.0
setuptools 45.2.0
six 1.15.0
urllib3 1.25.10
websocket-client 0.57.0
wheel 0.34.2
I saw that not all of the azure packages got installed. So, I run pip3 install ansible[azure] this time, although I already asked pip to install that package. After installation finishes, this is the result of pip3 list:
root#7e8175337b62:/# pip3 list
Package Version
------------------------------ ---------
adal 1.2.4
ansible 2.9.11
applicationinsights 0.11.9
argcomplete 1.12.0
azure-cli-core 2.0.35
azure-cli-nspkg 3.0.2
azure-common 1.1.11
azure-graphrbac 0.40.0
azure-keyvault 1.0.0a1
azure-mgmt-authorization 0.51.1
azure-mgmt-automation 0.1.1
azure-mgmt-batch 5.0.1
azure-mgmt-cdn 3.0.0
azure-mgmt-compute 4.4.0
azure-mgmt-containerinstance 1.4.0
azure-mgmt-containerregistry 2.0.0
azure-mgmt-containerservice 4.4.0
azure-mgmt-cosmosdb 0.5.2
azure-mgmt-devtestlabs 3.0.0
azure-mgmt-dns 2.1.0
azure-mgmt-hdinsight 0.1.0
azure-mgmt-iothub 0.7.0
azure-mgmt-keyvault 1.1.0
azure-mgmt-loganalytics 0.2.0
azure-mgmt-marketplaceordering 0.1.0
azure-mgmt-monitor 0.5.2
azure-mgmt-network 2.3.0
azure-mgmt-nspkg 2.0.0
azure-mgmt-rdbms 1.4.1
azure-mgmt-redis 5.0.0
azure-mgmt-resource 2.1.0
azure-mgmt-servicebus 0.5.3
azure-mgmt-sql 0.10.0
azure-mgmt-storage 3.1.0
azure-mgmt-trafficmanager 0.50.0
azure-mgmt-web 0.41.0
azure-nspkg 2.0.0
azure-storage 0.35.1
bcrypt 3.1.7
cachetools 4.1.1
certifi 2020.6.20
cffi 1.14.1
chardet 3.0.4
colorama 0.4.3
cryptography 3.0
docker-py 1.10.6
docker-pycreds 0.4.0
google-auth 1.20.0
humanfriendly 8.2
idna 2.10
isodate 0.6.0
Jinja2 2.11.2
jmespath 0.10.0
knack 0.3.3
kubernetes 11.0.0
MarkupSafe 1.1.1
msrest 0.6.1
msrestazure 0.5.0
oauthlib 3.1.0
openshift 0.11.2
packaging 20.4
paramiko 2.7.1
pip 20.0.2
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycparser 2.20
Pygments 2.6.1
PyJWT 1.7.1
PyNaCl 1.4.0
pyOpenSSL 19.1.0
pyparsing 2.4.7
python-dateutil 2.8.1
python-string-utils 1.0.0
PyYAML 5.3.1
requests 2.24.0
requests-oauthlib 1.3.0
rsa 4.6
ruamel.yaml 0.16.10
ruamel.yaml.clib 0.2.0
setuptools 45.2.0
six 1.15.0
tabulate 0.8.2
urllib3 1.25.10
websocket-client 0.57.0
wheel 0.30.0
xmltodict 0.12.0
As you can see, the second time I requested the installation of ansible[azure] it actually installed all the packages. Why didn't it work the first time I asked?

1- pip3 install packaging ansible msrestazure docker-py ansible[azure] openshift
2- pip3 install packaging msrestazure docker-py ansible[azure] openshift
Why the first one install all the azure packages? but the second is just only installing ansible?
The reason is, when ansible[azure] is executed, pip checks whether the ansible package is installed or not. The ansible package is installed in the first place (pip3 install ansible). Therefore the time we execute pip3 install ansible[azure], pip thought all the necessary packages were installed. Therefore skips the remaining and the crucial azure packages.
Since this is a long explanation I couldn't fit into the comment section. Therefore, I wrote as an answer.

robot: command not found in Mac

I installed python3 and robot framework from command line. When I run robot test cases. I keep getting an error, "robot: command not found". Below is pip list and pip3 list.
Sindoo:~ XXXXXXXXX$ pip list
Package Version
------------------------------ ----------
appdirs 1.4.3
certifi 2020.4.5.1
distlib 0.3.0
filelock 3.0.12
importlib-metadata 1.6.0
pip 20.1
pipenv 2018.11.26
robotframework 3.2
robotframework-seleniumlibrary 3.3.1
selenium 3.141.0
setuptools 46.1.3
six 1.14.0
urllib3 1.25.9
virtualenv 20.0.20
virtualenv-clone 0.5.4
wheel 0.34.2
zipp 3.1.0
Sindoo:~ XXXXXXXXX$ pip3 list
Package Version
------------------------------ ----------
appdirs 1.4.3
certifi 2020.4.5.1
distlib 0.3.0
filelock 3.0.12
importlib-metadata 1.6.0
pip 20.1
pipenv 2018.11.26
robotframework 3.2
robotframework-seleniumlibrary 3.3.1
selenium 3.141.0
setuptools 46.1.3
six 1.14.0
urllib3 1.25.9
virtualenv 20.0.20
virtualenv-clone 0.5.4
wheel 0.34.2
zipp 3.1.0
When I try to check robot --version. I get an error.
robot --version
-bash: robot: command not found
May I know Why robot is not working?

Try running python -m robot or python3 -m robot instead.

How to deal with new pip3.x for each Python version

After recently upgrading from python 3.7 to 3.8, I realized that my packages installed on my system were not transferred over after installing 3.8. Specifically, I am seeing the below for pip3.7 list:
Package Version
----------------- ---------
appdirs 1.4.3
astroid 2.3.3
attrs 19.3.0
click 7.1.1
isort 4.3.21
lazy-object-proxy 1.4.3
mccabe 0.6.1
pathspec 0.7.0
pip 20.0.2
pylint 2.4.4
regex 2020.2.20
setuptools 46.0.0
six 1.14.0
toml 0.10.0
typed-ast 1.4.1
wheel 0.34.2
wrapt 1.11.2
while pip3 or pip3.8 list shows:
Package Version
---------- -------
pip 20.0.2
setuptools 41.2.0
Is this the expected behavior or did not do something wrong while upgrading to 3.8? If this is the expected behavior, how do you transfer the packages over to the new version? Is it not best practice to do so?