We Keep Coding

Transaction check error due to conflicting python versions during packstack install of OpenStack-Train

The packstack installation of openstack is failing with the following error -
/Stage[main]/Nova::Vncproxy/Nova::Generic_service[vncproxy]/Package[nova-vncproxy]/ensure: change from 'purged' to 'present' failed: Execution of '/usr/bin/yum -d 0 -e 0 -y install openstack-nova-novncproxy' returned 1: Transaction check error:
file /usr/bin/websockify from install of python2-websockify-0.8.0-13.el7.noarch conflicts with file from package python3-websockify-0.10.0-3.el8.noarch
file /usr/share/man/man1/websockify.1.gz from install of python2-websockify-0.8.0-13.el7.noarch conflicts with file from package python3-websockify-0.10.0-3.el8.noarch
Above you can see that two files (/usr/bin/websockify & /usr/share/man/man1/websockify.1.gz) are conflicting between python2-websockify & python3-websockify & so any one of them has to be removed but,
while checking the installed packages of the system I can see that python2-websockify is only available in the system but not installed in the system.
[root#controller ~]# yum list | grep -i python2-web
python2-webob.noarch 1.8.5-1.el7 #centos-ceph-nautilus
python2-websocket-client.noarch 0.54.0-1.el7 centos-ceph-nautilus
python2-websockify.noarch 0.8.0-13.el7 centos-openstack-train
[root#controller ~]# yum list installed | grep -i python2-web
python2-webob.noarch 1.8.5-1.el7 #centos-ceph-nautilus
However python3-websockify is installed in the system & I cannot remove it because the nova-novnc package has a dependency on that one.
[root#controller ~]# yum list installed | grep -i python3-web
python3-websockify.noarch 0.10.0-3.el8 #/python3-websockify-0.10.0-3.el8.noarch
Now, how can I remove the python2-websockify.noarch which is not even installed on the system?
& when it is not installed then why the error is mentioning
from install of python2-websockify-0.8.0-13.el7.noarch conflicts with file from package python3-websockify-0.10.0-3.el8.noarch
I tried to delete the python2-websockify but as it is not installed so giving following messages -
[root#controller ~]# yum remove python2-websockify-0.8.0-13.el7.noarch
Loaded plugins: fastestmirror
No Match for argument: python2-websockify-0.8.0-13.el7.noarch
No Packages marked for removal

Problem solved after removing the epel-release because the puppet was coming updated from Epel instead of packstack
#yum autoremove epel-release

How to install GDAL on MacOS with Homebrew?

I am trying to install GDAL on MacOS with Homebrew. But failed. I started with the following commands:
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
brew install gdal --HEAD
brew install gdal —-only-dependencies
brew install gdal
pip3 install gdal
The first command check if I have installed the Homebrew. The others are step by step installation of gdal. It works fun when I try to take a look with the version of gdal:
gdal-config --version
# out put: 3.0.2
But when I trying to convert .tif to .raw with gdal_translate:
gdal_translate –ot UInt16 –scale –of ENVI –outsize 1025 1025 srtm_59_05.tif heightmap.raw
There comes the following problem.
dyld[54967]: Library not loaded: #rpath/libpoppler.91.dylib
Referenced from: /Users/[my_username_here]/opt/anaconda3/lib/libgdal.26.dylib
Reason: tried: '/Users/[my_username_here]/opt/anaconda3/lib/libpoppler.91.dylib' (no such file),
'/Users/[my_username_here]/opt/anaconda3/bin/../lib/libpoppler.91.dylib' (no such file),
'/Users/[my_username_here]/opt/anaconda3/bin/../lib/libpoppler.91.dylib' (no such file),
'/usr/local/lib/libpoppler.91.dylib' (no such file), '/usr/lib/libpoppler.91.dylib' (no such file)
[1] 54967 abort gdal_translate –ot UInt16 –scale –of ENVI –outsize 1025 1025
What should I do? Can anyone help me out?
The problem seems comes from something called poppler, so I ran
brew reinstall poppler
It gives me
Warning: poppler 21.12.0 is already installed and up-to-date.
To reinstall 21.12.0, run:
brew reinstall poppler
If I reinstall poppler, the error is still there.
Here is the result of searching the folder of poppler, using
# locate the folder of poppler, gives "/opt/homebrew/Cellar/poppler/21.12.0"
brew ls --verbose poppler
# search for keyword "poppler" in filenames
find /opt/homebrew/Cellar/poppler/21.12.0 -name '*poppler*'
It gives
/opt/homebrew/Cellar/poppler/21.12.0/.brew/poppler.rb
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/poppler_private_export.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/poppler-config.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-annot.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-page.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-attachment.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-features.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-enums.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-form-field.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-date.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-action.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-layer.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-movie.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-document.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-macros.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-structure-element.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/glib/poppler-media.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-form.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-export.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-optcontent.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-page-transition.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-annotation.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-qt6.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-link.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-version.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/qt6/poppler-media.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-page.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-image.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-global.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-font-private.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-page-transition.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-toc.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-document.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-rectangle.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-page-renderer.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-destination.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler_cpp_export.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-version.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-embedded-file.h
/opt/homebrew/Cellar/poppler/21.12.0/include/poppler/cpp/poppler-font.h
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-qt6.3.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/pkgconfig/poppler.pc
/opt/homebrew/Cellar/poppler/21.12.0/lib/pkgconfig/poppler-cpp.pc
/opt/homebrew/Cellar/poppler/21.12.0/lib/pkgconfig/poppler-glib.pc
/opt/homebrew/Cellar/poppler/21.12.0/lib/pkgconfig/poppler-qt6.pc
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-qt6.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-cpp.0.9.0.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler.a
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-glib.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-cpp.a
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-glib.8.22.0.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-qt6.3.1.0.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-cpp.0.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-glib.8.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler.116.0.0.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-cpp.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler.116.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler.dylib
/opt/homebrew/Cellar/poppler/21.12.0/lib/libpoppler-glib.a
/opt/homebrew/Cellar/poppler/21.12.0/share/pkgconfig/poppler-data.pc
/opt/homebrew/Cellar/poppler/21.12.0/share/poppler

The problem is solved:
As https://github.com/OSGeo/gdal/issues/5348 issue.
It looks to be a mix of Conda and homebrew in your system. Perhaps try deactivating your Conda environment. I'm afraid I can't help more.
Just shot down Anaconda and redo everything with only Homebrew.

How to install libcurl with nss backend in aws ec2? (Python 3.6 64bit Amazon Linux)

I have an ec2 instance in AWS running Python3.6 (Amazon Linux/2.8.3) where I need to install pycurl with NSS ssl backend.
First I tried it by adding pycurl==7.43.0 --global-option="--with-nss" to my requirement.txt file but I was getting errors installation errors. So I ended up doing it by adding a .config file in .ebextensions (that runs during deployment):
container_commands:
09_pycurl_reinstall:
# the upgrade option is because it will run after PIP installs the requirements.txt file.
# and it needs to be done with the virtual-env activated
command: 'source /opt/python/run/venv/bin/activate && PYCURL_SSL_LIBRARY=nss pip3 install pycurl --global-option="--with-nss" --upgrade --no-cache-dir --compile --ignore-installed'
Pycurl seems to be correctly installed, but the celery worker is not running. The celery worker logs show:
__main__.ConfigurationError: Could not run curl-config: [Errno 2] No such file or directory
If I ssh connect to the instance and run python 3.6 -c 'import pycurl' I get a more detailed error:
ImportError: pycurl: libcurl link-time ssl backend (openssl) is different from compile-time ssl backend (nss)
So I guess that my problem is that I had previously installed libcurl with openSSL instead of NSS, and hence the mismatch between libcurl and pycurl.
According to another stackoverflow question, for libcurl to be installed with NSS backend I should have installed it with:
sudo apt libcurl4-nss-dev
But since the server is running Amazon Linux I can't use the apt command. So I did instead:
yum install libcurl-devel
And I guess this is the problem: this installs libcurl with OpenSSL support when I need it with NSS support.
How can I install libcurl with NSS in Amazon Linux?? (I need NSS because I'm running a Django app with celery using SQS as the broker, and SQS requires NSS).
Thank you very much!

I just ran into the same issue and did manage to fix it :)
Retrieve Amazon Linux configure options for libcurl:
curl-config --configure
All options referring to paths can be ignored, but other must be kept if you want the same features than system libcurl. Of course, --with-ssl will be replaced with --without-ssl --with-nss.
1.1 Install prerequisites:
sudo yum install libssh2-devel nss-devel
(of course you should rather add then to the packages > yum section of your ebextensions)
Compile libcurl from source (i chose 7.61.1 to match the one used by Amazon Linux 2018.03):
wget https://curl.haxx.se/download/curl-7.61.1.tar.gz
tar xf curl-7.61.1.tar.gz
cd curl-7.61.1
./configure '--build=x86_64-redhat-linux-gnu' '--host=x86_64-redhat-linux-gnu' '--target=x86_64-amazon-linux-gnu' '--program-prefix=' '--cache-file=../config.cache' '--disable-static' '--enable-symbol-hiding' '--enable-ipv6' '--enable-threaded-resolver' '--with-gssapi' '--with-nghttp2' '--without-ssl' '--with-nss' '--with-ca-bundle=/etc/pki/tls/certs/ca-bundle.crt' '--enable-ldap' '--enable-ldaps' '--enable-manual' '--with-libidn2' '--with-libpsl' '--with-libssh2' 'build_alias=x86_64-redhat-linux-gnu' 'host_alias=x86_64-redhat-linux-gnu' 'target_alias=x86_64-amazon-linux-gnu' 'CFLAGS=-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic'
make
sudo make install
(of course this should be deployed properly as a Shell script through the files section of your ebextensions).
Now you should see libcurl.so.4 created in /usr/local/lib.
Define the following envvars for pycurl to be compiled using your custom libcurl:
LD_LIBRARY_PATH=/usr/local/lib
PYCURL_CURL_CONFIG=/usr/local/bin/curl-config
PYCURL_SSL_LIBRARY=nss
Run your pip install
You can check pycurl linked to the right libcurl:
ldd /opt/python/run/venv/local/lib64/python3.6/site-packages/pycurl.cpython-36m-x86_64-linux-gnu.so
should show you libcurl.so.4 => /usr/local/lib64/libcurl.so.4
And of course python 3.6 -c 'import pycurl' should work.
That's it! You should be able to run Celery with SQS.

I had loads of issues getting pycurl installed on my Python ec2 instance. First up, pip wouldn't install pycurl at all. I had to ssh and run
yum install libcurl-devel
After this, I added the following line to my requirements.txt file so that it included the relevant ssl option (--with-openssl) as an install option:
pycurl==7.43.0.5 --install-option="--with-openssl"
Once I deployed a new version with this change in requirements.txt, pycurl worked fine, which I tested with:
python 'import pycurl'
I knew I needed to use openssl from the error message
libcurl link-time ssl backend (openssl)

brew postinstall python (2.7.13): [Errno 13] Permission denied

I am on OS X 10.11.6. I updated and upgraded brew today. After that, pip did not work. It looked as if it was not installed during the upgrade. When I finished the upgrade I saw the warning:
Warning: The post-install step did not complete successfully You can try again using brew postinstall python
So I ran brew postinstall python and I then encountered the error:
error: [Errno 13] Permission denied: '/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py'
In this post they say:
The post-install step did not complete successfully due to error: could not delete '/usr/local/lib/python2.7/site-packages/pip/__init__.py': Permission denied. Manually deleting that file and then running brew postinstall python again fixed it.
So I thought the fix would be the same and I manually deleted /usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py' so that
$ ls /usr/local/lib/python2.7/site-packages/pkg_resources/
_vendor extern
I ran brew postinstall python again but now I obtain:
...
copying build/lib/easy_install.py -> /usr/local/lib/python2.7/site-packages
copying build/lib/pkg_resources/__init__.py -> /usr/local/lib/python2.7/site-packages/pkg_resources
error: [Errno 13] Permission denied: '/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py'`
I found "a fix" by installing pip using easy_install:
sudo easy_install pip
And now everything seems to work fine. However, I have two questions:
Have I messed up by manually removing '/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py'?
What would be the fix for the [Errno 13] Permission denied when brew postinstall python?
In case it is of any use, here is my brew config and brew doctor outputs after all that happened today:
$ brew config
HOMEBREW_VERSION: 1.1.6
ORIGIN: https://github.com/Homebrew/brew
HEAD: 619791e83d2781dca1b675e20249a8aebe085c7c
Last commit: 6 days ago
Core tap ORIGIN: https://github.com/Homebrew/homebrew-core
Core tap HEAD: 5ce01ec9c8b9958e2d9a7791e4d4e2aa0bf4fd8f
Core tap last commit: 89 minutes ago
HOMEBREW_PREFIX: /usr/local
HOMEBREW_REPOSITORY: /usr/local/Homebrew
HOMEBREW_CELLAR: /usr/local/Cellar
HOMEBREW_BOTTLE_DOMAIN: https://homebrew.bintray.com
CPU: octa-core 64-bit haswell
Homebrew Ruby: 2.0.0-p648
Clang: 8.0 build 800
Git: 2.10.1 => /Applications/Xcode.app/Contents/Developer/usr/bin/git
Perl: /usr/bin/perl
Python: /usr/local/bin/python => /usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/bin/python2.7
Ruby: /usr/bin/ruby => /System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/bin/ruby
Java: 1.8.0_91
macOS: 10.11.6-x86_64
Xcode: 8.2.1
CLT: 8.2.0.0.1.1480973914
X11: 2.7.11 => /opt/X11
$ brew doctor
Warning: Unbrewed dylibs were found in /usr/local/lib.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.
Unexpected dylibs:
/usr/local/lib/libtcl8.6.dylib
/usr/local/lib/libtk8.6.dylib
Warning: Unbrewed header files were found in /usr/local/include.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.
Unexpected header files:
/usr/local/include/fakemysql.h
/usr/local/include/fakepq.h
/usr/local/include/fakesql.h
/usr/local/include/itcl.h
/usr/local/include/itcl2TclOO.h
/usr/local/include/itclDecls.h
/usr/local/include/itclInt.h
/usr/local/include/itclIntDecls.h
/usr/local/include/itclMigrate2TclCore.h
/usr/local/include/itclTclIntStubsFcn.h
/usr/local/include/mysqlStubs.h
/usr/local/include/odbcStubs.h
/usr/local/include/pqStubs.h
/usr/local/include/tcl.h
/usr/local/include/tclDecls.h
/usr/local/include/tclOO.h
/usr/local/include/tclOODecls.h
/usr/local/include/tclPlatDecls.h
/usr/local/include/tclThread.h
/usr/local/include/tclTomMath.h
/usr/local/include/tclTomMathDecls.h
/usr/local/include/tdbc.h
/usr/local/include/tdbcDecls.h
/usr/local/include/tdbcInt.h
/usr/local/include/tk.h
/usr/local/include/tkDecls.h
/usr/local/include/tkPlatDecls.h
Warning: Unbrewed .pc files were found in /usr/local/lib/pkgconfig.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.
Unexpected .pc files:
/usr/local/lib/pkgconfig/tcl.pc
/usr/local/lib/pkgconfig/tk.pc
Warning: Unbrewed static libraries were found in /usr/local/lib.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.
Unexpected static libraries:
/usr/local/lib/libtclstub8.6.a
/usr/local/lib/libtkstub8.6.a

The easiest method I've found to fix this is to simply set the ownership of the folder to your username:
chown -R `whoami` /usr/local/lib/python2.7/site-packages/
Edit: On occasion, I also run this:
sudo -H python3 -m pip install ...
or
sudo -H pip install

How to install Rust without getting a timeout error during a file download?

In a Terminal window on my Mac Pro (OS X 10.9.5), I want to get rust via rustup using the linux command: '$ curl https://sh.rustup.rs -sSf | sh'
But, this timeout error is printed:
Current installation options:
default host triple: x86_64-apple-darwin
default toolchain: stable
modify PATH variable: yes
1) Proceed with installation (default)
2) Customize installation
3) Cancel installation
info: syncing channel updates for 'stable-x86_64-apple-darwin'
error: could not download file from 'https://static.rust-lang.org/dist/channel-rust-stable.toml.sha256' to '/Users/laurence/.multirust/tmp/q3f6bbl3suzhpl6m_file
info: caused by: error during download
info: caused by: [28] Timeout was reached (Connection timed out after 30056 milliseconds)
rustup: command failed: /var/folders/rn/slxkq6md5jvcwp99zm0_tq_40000gs/T/rustup.H6IPudqd/rustup-init
Do you have a solution?
Thanks a lot,
Laurence_D

use Homebrew for easily installing stuffs on mac
do to install Homebrew
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
Then install rust with the command
brew install rust