How I Update pandas using spyder? - python

I try to convert a datastucture i get from pandas to an array using .to_numpy but my pandas version is too old. Trying to update it writing: conda install -c anaconda pandas inside anaconda prompt resolves in this issue: ERROR conda.core.link:_execute_actions(337): An error occurred while installing package 'anaconda::tqdm-4.50.2-py_0'. CondaError: Cannot link a source that does not exist. C:\Users\domyb\Anaconda3\Scripts\conda.exe Running conda clean --packages may resolve your problem. Attempting to roll back.
CondaError: Cannot link a source that does not exist. C:\Users\domyb\Anaconda3\Scripts\conda.exe Running conda clean --packages may resolve your problem. Any idea?

Related

Pandas installation fails with "OSError: [WinError8] Not enough storage is available to process this command"

I was trying to install pandas using this command:
python -m pip install pandas
Installation starts initially but then goes all red and returns this error:
Could not install packages due to an OSError: [WinError8] Not enough storage is available to process this command
--- Logging error ---
I don't think it's a memory issue because I checked usage and it was at a normal level.
I'm using Python 3.7 on Windows 7.
Any suggestions on how to fix it??
Eureka! I'm posting solution in case anyone encounters the same problem in the future.
After hours of trying a lot of different solutions I have finally succeed even though I still don't know what was the source of this problem.
To install pandas in case of facing error while downloading using pip command first download manually .whl files of pandas from PyPI website:
https://pypi.org/project/pandas/#files
Copy it to the folder that is used as your path in cmd console- don't change name of the file.
In cmd console use:
python -m pip install fullnameofthedownloadedfile.whl --no-deps
Use --no-deps as it's very likely that automatically downloaded dependencies will encounter similar errors during downloading as pandas- you will install them manually instead.
Once this is finished repeat process for numpy and dateutil and any other packages that might be required.
What a relief!!! Happy coding;)

Error when importing geopandas OSError: Could not find lib c or load any of its variants []

I'm using Spyder with Anaconda and since MacOS last update (Big Sur 11.0.1), when doing
import geopandas, I get the following error:
OSError: Could not find lib c or load any of its variants [].
There are several subjects on the matter (particularly this one and this one), that mainly recommends to reset the environment variable DYLD_FALLBACK_LIBRARY_PATH by putting in the Terminal:
export DYLD_FALLBACK_LIBRARY_PATH=$(HOME)/lib:/usr/local/lib:/lib:/usr/lib
However, here is what I get:
-bash: HOME: command not found
A brew or pip install didn't fix the problem either.
Does anyone have an idea on how I can fix this? Am I suppose to replace $(HOME) by something?
Many thanks!
I had the same error and fixed it just by reinstalling Shapely:
pip install --upgrade --force-reinstall shapely
I had the same issue. To fix the problem, use:
Change the Shapely package
https://github.com/Toblerity/Shapely/commit/a34ec59a7dc9089a71968c6871e29addd872ea3b
And then reinstall Xcode:
xcode-select --install
The geos.py file and line number you need to modify will be in the log output that generated the OSError. Just look a few lines up.
For references: I ended up reinstalling a new environment on Anaconda an it works but I wasn't able to fix the original problem.

Need help installing fiona and geopandas for python in Windows 10 - getting can't load requested DLL error

I am trying to install fiona and geopandas for python on Windows 10 and keep running into an error "ERROR 1: Can't load requested DLL".
I know this question is similar to other questions that have been asked, but I have followed the steps in multiple answers and tutorials and still can't seem to get this to work.
The closest I got was using the steps outlined in this tutorial : https://geoffboeing.com/2014/09/using-geopandas-windows/
and are summarized as follows:
installed the .whl files for rtree, pyproj, shapely, gdal, geopandas, fiona from https://www.lfd.uci.edu/~gohlke/pythonlibs/
Rtree-0.8.3-cp37-cp37m-win_amd64.whl
pyproj-2.2.1-cp37-cp37m-win_amd64.whl
GDAL-3.0.0-cp37-cp37m-win_amd64.whl
geopandas-0.5.0-py2.py3-none-any.whl
Fiona-1.8.6-cp37-cp37m-win_amd64.whl
Shapely-1.6.4.post2-cp37-cp37m-win_amd64.whl
navigated to download folder and used pip install to install GDAL wheel
added the osgeo path to my windows user Path environment variable
used pip install to install remaining wheels (geopandas last), everything installed without errors
As a check, I ran gdalinfo --help-general and get the following output:
This is where I get the "ERROR 1: Can't load requested DLL:" error. It says it cannot find the specified module "ogr_FileGDB.dll". The weird thing is, that .dll is actually in the location that it is looking in???
Also, in python shell, when trying to import fiona or geopandas I get the following errors:
This is beyond my level of troubleshooting...would really appreciate if anyone could get this thing working for me!!!!
FYI - running Python 3.7.3, Windows 10, pip is updated.
Lastly and potentially important (not sure how it plays in?) I already have a GDAL_DATA system variable defined, and also (maybe incorrectly?) also tried adding the osgeo path to my system path variable:
I was using a GDAL version that was not compatible with Fiona and subsequently causing issues with geopandas.
I uninstalled GDAL 3 and installed GDAL 2.4.1 and it worked fine, as cgohlke suggested.
Install fiona with conda, then that will solve the GDAL problem. pip install geopandas should work after that.

Facing issue while installing fancyimpute

For installing the fancyimpute, i am using the below commands:
conda install ecos
conda install CVXcanon
pip install fancyimpute
On firing the 1st command "conda install ecos", i am getting the below error. Please help me on this resolution.
Preparing transaction: done
Verifying transaction: done
Executing transaction: | DEBUG menuinst_win32:__init__(196): Menu: name: 'Anaconda${PY_VER} ${PLATFORM}', prefix: 'C:\Users\Deepak\Anaconda3', env_name: 'None', mode: 'user', used_mode: 'user'
DEBUG menuinst_win32:create(320): Shortcut cmd is C:\Users\Deepak\Anaconda3\pythonw.exe, args are ['C:\\Users\\Deepak\\Anaconda3\\cwp.py', 'C:\\Users\\Deepak\\Anaconda3', 'C:\\Users\\Deepak\\Anaconda3\\pythonw.exe', 'C:\\Users\\Deepak\\Anaconda3\\Scripts\\spyder-script.py']
/ DEBUG menuinst_win32:create(320): Shortcut cmd is C:\Users\Deepak\Anaconda3\python.exe, args are ['C:\\Users\\Deepak\\Anaconda3\\cwp.py', 'C:\\Users\\Deepak\\Anaconda3', 'C:\\Users\\Deepak\\Anaconda3\\python.exe', 'C:\\Users\\Deepak\\Anaconda3\\Scripts\\spyder-script.py', '--reset']
failed
ERROR conda.core.link:_execute(502): An error occurred while installing package 'conda-forge::automat-0.7.0-py_1'.
CondaError: Cannot link a source that does not exist. C:\Users\Deepak\Anaconda3\Scripts\conda.exe
Running `conda clean --packages` may resolve your problem.
Attempting to roll back.
Rolling back transaction: done
CondaError: Cannot link a source that does not exist. C:\Users\Deepak\Anaconda3\Scripts\conda.exe
Running `conda clean --packages` may resolve your problem.
Note: Tried the same command after using "conda clean --packages". But still the issue persists.
Regards,
Deepak
According to this GitHub issue about the same problem (transaction also fails on automat), there are a few things that seem to get it working:
Cleaning. You've already tried conda clean --packages, so maybe you can ignore this one, but the thread also suggests conda clean --all. Personally, I think that's a bit blunt. The users who it worked for may have only needed --packages.
Update Conda. Many seem to get around this by updating Conda, conda update -n base conda.
Update Anaconda. Some said it worked to run conda update anaconda.
Freeze installed packages. Some users noticed that it only happens when planned transactions include updating other packages. One can prevent other packages from updating by using conda install --freeze-installed ecos.
Issue with latest Automat. One user reports the issue is specific to the recent 0.7.0 version of Automat. They report having a successful transaction by explicitly requesting the previous Automat version, e.g., conda install ecos automat=0.6.*
Recommendation
I would try (2) first.
Something I find strange in all this is that everyone reporting this is on Windows, but Conda attempts to install the noarch version (as indicated by the py_1 in the tarball). Nothing particularly wrong with that, but on OSX, Conda specifically tries to install the osx-64 version. Hence, I would attempt to explicitly install the win-64 version of 0.7.0 and see if that works. That is,
conda install conda-forge/win-64::automat
If that doesn't work, I suppose I would try (4) or (5) next.

Geospatial Conda Environment Setup in Python

I just started a new job and I have to set up my geospatial environment in Windows (I was a mac user before). I am having trouble navigating around geopandas bug #830. Based on the comments for the bug, it looks like if I can downgrade pyproj to version 1.9.4 it will fix the issue. BUT, I cannot get 1.9.4 installed for one reason or another. I have tried the following without success:
conda install -c conda-forge pyproj==1.9.4
When I try this, it gets hung up in the "Solving Environment" stage.
I then tried this:
pip install pyproj==1.9.4
but, I get this error:
Collecting pyproj-1.9.4
Could not find a version that satisfies the requirement pyproj-1.9.4 (from
versions: )
No matching distribution found for pyproj-1.9.4
So, I tried downloading the tar file and doing the following:
pip install "C:\Users\myname\Downloads\pyproj-1.9.4.tar"
but got this error:
Could not install packages due to an EnvironmentError: [Errno 2] No such
file or directory: 'C:\Users\myname\Downloads\pyproj-1.9.4.tar'
I have actually done more than this (it has been a long 8 hours), but I am hoping that somebody smarter than I can put me out of my misery :-) I am using conda version 4.5.11 and python 3.5.6.
Thanks in advance for any help.

Categories