I have recently installed Spyder 2 on my MacBook. Then, since I couldn't import the sklearn library, i decided to also download Anaconda from their Website. Now, Anaconda comes with a Spyder environment itself, on which I can import sklearn, however the IDE is laggy. Is there a way to use the conda sklearn library on my separately downloaded Spyder (which runs much smoother)? Both Spyders are running Python 3.9.5 and I'm using MacOs 10.15.7
I tried setting a path via the PYTHONPATH Manager, but Spyder 2 forbids setting a path to 'site-packages' and after copying sklearn into another folder and setting a path there, import failed:
ModuleNotFoundError: No module named 'joblib'
I also installed sklearn via pip on the terminal, but I run into the same kind of problems if I try to import sklearn in my seperate Spyder 2('no module named sklearn found' or I can't set a path there or some module is missing).
And if I try to run
pip install scikit-learn
in the IPython console directly, I get
/Applications/Spyder 2.app/Contents/MacOS/python: No module named pip
while if I try
conda install scikit-learn
in the IPython console I get
ValueError: The python kernel does not appear to be a conda environment. Please use ``%pip install`` instead.
So I seem to be running in circles...
conda and pip are executables and not to be run from the IPython console, but from a command shell.
Don't mix conda and pip installations if you don't have to. Only install scikit-learn with conda.
Before you can use any installation, you have to activate the base environment first with conda activate.
There is no shame in reading the documentation first, e.g. https://docs.anaconda.com/anaconda/user-guide/getting-started/
Update update: json_lines is not supported by python versions < 3 - my issue had pretty much nothing to do with environments. I am now using 3.9.1 and all is gucci.
Update: After using which python in my jupyter notebook and in my Terminal, I see that they are both using the same environment. As such I am still at a loss as to why my notebook cannot find json_lines.
I have two python environments on my computer, a default one and one I have for running my jupyter notebook on. I am trying to install the library, json_lines to the latter environment. I am not used the Anaconda environment manager.
On my Mac's Terminal I used the general pip install command pip install json-lines, but when I try to execute the following line of Python import json_lines in my notebook, I still receive the following error ImportError: No module named json_lines.
As I suspect I am not installing to the correct environment, I tried installing the library from inside my notebook with the following, import sys; !{sys.executable} -m pip install jsonlines.
However, this has not changed my dilemma.
Is there some way I can specify from my Terminal which environment to install to? or is it likely I am encountering a different issue to what I suspect?
The package for json_lines in pip in json-lines. Hence you could install it as:
$ pip install json-lines
It may be appropriate to use an isolated python environment for your particular project if you want to use particular conda libraries but without the whole package. In this instance, you would be able to use virtualenv. This will allow you to create an isolated python environment.
$ pip3 install virtualenv
You can call virtualenv to create a virtual python environment with the working name e.g. myvenv.
$ virtualenv myvenv
From here, you can set your terminal to use this python version. If you are on *nix:
$ which python
/usr/bin/python
$ source myvenv/bin/activate
(myvenv)$ which python
/.../myvenv/bin/python
This article can help you out.
https://janakiev.com/blog/jupyter-virtual-envs/
You need to create a virtualenv which will be used by your notebooks.
I successfully installed pytorch via conda:
conda install pytorch-cpu torchvision-cpu -c pytorch
I also successfully installed pytorch via pip:
pip3 install https://download.pytorch.org/whl/cpu/torch-1.0.1-cp36-cp36m-win_amd64.whl
pip3 install torchvision
But, it only works in a jupyter notebook. Whenever I try to execute a script from the console, I get the error message:
No module named "torch"
Try to install PyTorch using pip:
First create a Conda environment using:
conda create -n env_pytorch python=3.6
Activate the environment using:
conda activate env_pytorch
Now install PyTorch using pip:
pip install torchvision
Note: This will install both torch and torchvision.
Now go to Python shell and import using the command:
import torch
import torchvision
I installed on my macos by the official command:
conda install pytorch torchvision -c pytorch
but when I follow the official verification I get the same problem like yours.
Then I create a conda virtual environment:
conda create --name learnpytorch python=3.5
and install pytorch inside the environment:
conda install pytorch torchvision -c pytorch
run the verification, it works.
Hope these could help you.
If you are using Anaconda Prompt, there is a simpler way to solve this.
conda install -c pytorch pytorch
You need to add this at the very top of your program
import torch
If this is not a problem execute this program on both Jupiter and command line and pretty much you will understand if you have a mismatch.
import sys
print(sys.executable)
I had the same problem right after installing pytorch from the console, without closing it and restarting it.
By restarting the console and re-entering my env, I solved the problem
Make sure that NumPy and Scipy libraries are installed before installing the torch library that worked for me at least on windows.
Install NumPy: pip install numpy
Install Scipy: pip install scipy
Go to pytorch.org and select your needs and copy the address
Paste the address and download
Usually if the torch/tensorflow has been successfully installed, you still cannot import those libraries, the reason is that the python environment you try to import is not the python environment you installed.
For example, if you have installed the torch/tensorflow using python='/usr/bin/python', then you cannot import them to python='/home/usrname/.../bin/python'.
The solution is simple thus, just change the python and import again.
Switch to python3 on the notebook
Welcome to SO,
please create a seperate conda environment
activate this environment conda activate myenv and than install pytorch in it.
Besides you can check which python you are currently using by which python
I had the same problem after following the official installation guide in here. I realized that it was my stupid Atom built-in terminal.
Inside the atom terminal, which python returned /usr/bin/python, although it showed the mark of (conda_env)$.
I fixed it by opening a new terminal and activating the (conda_env), and it worked. Verified and which python yields /Users/my_usr/anaconda3/envs/conda_env/bin/python
The procedure I used is specific to Windows 10 PyTorch installation on anaconda.
Create a conda virtual environment using: conda create -n torch_env
Activate virtual environment using: conda activate torch_env
When I installed, this was my current config: conda install pytorch torchvision torchaudio cudatoolkit=10.2 -c pytorch.
Please find correct configuration according to your system settings from pytorch website directly: https://pytorch.org/get-started/locally/
Run python with import torch command. It should definitely work!
If you are using conda, it's possible that your console is using a different version of python, and the packages you installed using conda are not installed on this version. In my case, I installed a 3.9 version by downloading from the website, and conda installed a 3.8 version. And all the packages only installed for 3.8. Deleting the 3.9 version did the trick for me.
I'm using Jupyter Notebook launching from Anaconda Navigator 2.3.2 (Windows 10) to investigate pyTorch in a new Environment created in Navigator. Before launching I added pyTorch via a Command Prompt with the new Environment activated using the following which I got from pytorch.org:
conda install pytorch torchvision torchaudio cpuonly -c pytorch
I then ran into the No module named "torch" issue and spent many hours looking into this. I was eventually able to fix this issue looking at the results of this:
import sys
print(sys.path)
For me, this showed that the path to site-packages for my kernal (aka Environment) was missing. So I edited the kernal's kernal.json file found in:
<DRIVE_LETTER>:\Users\<USER_NAME>\AppData\Roaming\jupyter\kernels\<KERNAL_NAME>
To include an env section, which adds to PYTHONPATH like:
{
"argv": [
"<ANACONDA_INSTALL_DIR>\\envs\\<KERNAL_NAME>\\python.exe",
"-m",
"ipykernel_launcher",
"-f",
"{connection_file}"
],
"env": {
"PYTHONPATH": "..\\..\\..\\Users\\<USER_NAME>\\<ANACONDA_INSTALL_DIR_NAME>\\envs\\<KERNAL_NAME>\\Lib\\site-packages"
},
"display_name": "<KERNAL_NAME>",
"language": "python",
"metadata": {
"debugger": true
}
}
Please note that in my case I had to go back up 3 directories to the root of the drive, hence, the ..\\..\\..\\ at the start of the PYTHONPATH entry. You might need to change that. Also if you try to use a full path, to your Environment's site-packages, then it will prepend the current contents of PYTHONPATH to it instead of adding it as a separate entity.
I am struggling the above answer and it does not work in my case.
That is because I install the porch under window COMMAND PROMPT.
Installed under the Anaconda environment command prompt. To do that, type "anaconda" and select the ANACONDA COMMAND PROMPT (this is very important for me to fix my mistake)
Do the same command from: https://pytorch.org/get-started/locally/
Check SDK install. you also install the sdk in your environment.
You can install the SDK using navigator.
first, change tab to Environments,
second, push play button of your environment name.
Third, then install SDK.
If you are using windows and you have no CUDA, then go with the following command.
pip install torch==1.7.0+cpu torchvision==0.8.1+cpu torchaudio===0.7.0 -f https://download.pytorch.org/whl/torch_stable.html
You can visit its official site for more explanation.
Pytorch Official site
If you are in the console, and importing a function that uses torch, you may need to add import torch within the function to allow for the correct scope. Because if you are importing the function, and there is no import statement at the top of the file, it won't work. Alternatively, make sure import torch is at the top of the module with the function you are trying to use, and within console, call the function using: your_module.function_that_references_torch()
Using Conda on win 10 running script from vs code terminal as:
$ script.py
Generates error:
ModuleNotFoundError: No module named 'torch'
The system goes outside the environment to execute call python.
This works:
$ python script.py
I tried to fixed the problem both in my laptop and computer, and it was fixed in different ways. You can try.
Laptop(Nvidia GTX 950M)
I fixed the problem by typing this under the environment that you install pytorch.
$ conda install pytorch torchvision cudatoolkit=10.0 -c pytorch
Remember to change the version(10.0) of you cuda
Computer(No GPU)
$ conda update -n base -c defaults conda
Most of the answers to this question are unsatisfying in that they explain how to create and activate a conda environment. The reason for the error is however not explained.
In my case, I had a conda environment set up, but the torch module was still not found, even if I installed it.
The reason for the error is that python v2 was the main interpreter, not python3.
You can test that by running python --version
Then follow the instructions from above to install the conda environment with the correct python version, e.g.
conda create -n venv python=3.9
I had an issue related to the path. Basically if I ran python with the path from which python, import torch works, if I just run python, it doesn't work.
This solution from #shoemakerdr on GitHub worked for me:
In your .bashrc, before the Conda initialize code, put unset CONDA_SHLVL
Create the environment:
conda create -n env_pytorch python=3.6
Install your modules. For example:
conda install pytorch torchvision cudatoolkit=10.2 -c pytorch
Next time you want to use pytorch:
conda activate env_pytorch
and when finished:
conda deactivate
I am trying to import Keras lib code to execute CRF using the import command below but an error raises as titled. Please share the solution for this.
The command used to execute is
from keras_contrib.layers import CRF
Traceback (most recent call last):
File "", line 1, in
from keras_contrib.layers import CRF
ImportError: No module named 'keras_contrib'
A simple
(sudo) pip install git+https://www.github.com/keras-team/keras-contrib.git
as mentioned in the installation instructions did the trick for me.
This error means that Python is unable to find the module in one of the directories defined by Python path. The module is either not installed or is installed in another directory.
If not installed, then see https://github.com/keras-team/keras-contrib for installation instructions.
If installed but not found, you will most likely need to add the directory where it is installed to your Python path. You can find out what your current Python path is by inspecting the variable sys.path (such as python -c 'import sys; print sys.path'). You may need to add another directory to your path by setting the environment variable PYTHONPATH before running your script, but there are other options. See for example PYTHONPATH vs. sys.path for some insight.
After struggling for a while, I was so willing to make myself clear of this issue, so I searched for a while, and just figured out and tested.
When you create a new conda env by specifying the python version, it will use the conda_root_python version. And if you didn't install the pip package, and try to use pip under your created conda env, it will only run the conda_root_pip and install the package in the root site_packages.
I know three ways to install python packages only in your created conda env.
For a better explanation, we create a conda env with same python version of conda root environment.
conda create -n myenv python
I. One of the officials advise, install package with conda command for specified conda environment,
conda install -n myenv tensorflow
II. Another one of official advise, get into your specified environment and run conda install
source activate myenv
conda install tensorflow
in above two ways you don't need to install extra packages like pip and other pip related packages.
III. For people who really want to pip, just because get used of that.
install pip package(just as above two ways did).
conda install -n myenv pip
or
source active myenv
conda install pip
then comes the pip install when you are in your environment
pip install tensorflow
--------new edit above 15.April.2018--------------
Just to make it more clear.
If you are working under anaconda environment, you should also install all the modules and IDE you need in that environment.
Here I just put one example of anaconda env flows:
conda create --name=my_conda_env python=2.7 #create an environment
activate my_conda_env #get into that env
pip install numpy #install packages you need
...
pip install keras_contrib
pip install spyder #install IDE
Getting Started with conda
---------
Try install in root
activate root
pip install keras_conrib
go back to your tensorflow
start your spyder and try again
Maybe this is your issue
Module installed on Conda, but gives error on importing in Spyder (Python IDE)
----------------- above new answer
It seems you are under conda environment, env-name is "tensorflow", so try to start python and try import again. To make it clear
make sure you have (tensorflow) in front of C:\Users>
type python to start python
import keras_contrib to see if you have keras_contrib in anaconda env (tensorflow) due your comment, it should be
from keras_conrib.layers import CRF (crf or CRF? just try)
If you installed keras_contrib in env "tensorflow", should also start python and do your jobs in the same env, for a new env, you have to install it again.
Here is something for newbie just like me after playing with python for a while and still not familiar with anaconda, I hope you didn't come up with that. As follows:
I used to think in my anaconda env is already in python(actually not yet), so I just type
from keras_contrib.layers import CRF when I saw (tensorflow)C:/Users> which is actually wrong
The right way as described up is get into python(step 2.) or ipython or jupyter just for test if you get the package.
--------------------- below is old answer
I think you confused keras with keras_contrib.
They are two different modules.
try pip install keras_contrib or use other ways to install keras_contrib.
If you are trying to install the tensorflow-keras version or even the keras version using git cloning and setup.py installing and getting the above error then you might want to add the path of the keras-contrib folder to system path using -
import sys
sys.path.append('<remaining_path>/keras_contrib')
Simply run:
conda install git+https://www.github.com/keras-team/keras-contrib.git
If you use Tensorflow, you may get over this error by replacing
from keras_contrib.layers import CRF
with
from tensorflow_addons.layers import CRF
If you're still interested in Keras itself, use the following line in Jupyter
!pip install git+https://www.github.com/keras-team/keras-contrib.git
Just note that you may face other errors while using seperate Keras, so I suggest that you use Keras that is supported in Tensorflow.
I am using anaconda 4.4.0 with Python 3.6.2. First, I pip installed Keras, it shows on pip list and conda list and also in environment>root>packages in Anaconda. But when I use import keras ,in Anaconda or in Terminal, I get
Traceback (most recent call last):
...
ModuleNotFoundError: No module named 'keras'
I tried installing Keras with anaconda also, and I get the same ModuleNotFoundError.
I have also tried uninstalling it, then download the master branch from github and install using python setup.py install. Again the package is in the lists but I cannot import it.
UPDATE:
I have uninstalled packages several times and installed using Keras package in pypi, Now I am able to import the packages in the python in terminal. But still I cannot import in jupyter notebook.
It may worth mentioning that I am working with MacOS Sierra 10.
If you are able to import in shell but not in the notebook, according to gnestor's answer to this question, your python may use different executables. Run:
import sys
sys.executable
in shell and in notebook. If the directories are different then you must change the kernelspec of the notebook. This might have happened by installing Tensorflow or other packages that change the environment and kernelspec. You can find the kernelspec directory with this command:
from jupyter_core.paths import jupyter_data_dir
print(jupyter_data_dir())
In that directory you will find a JSON file. Open it and change the path to your working python directory. (working python directory in which python)
use python -m pip install keras
Then, use python shell to check for installation.
try this code:
conda install -c deeplearn keras
Basically, the full answer you can find here:
Install Python package: "Package missing in current win-64 channels"
However, it seems to me you are using different python in your terminal.
Check this command in the terminal:
which python
It should return something like this:
/Users/***/anaconda3/bin/python
Try running:
conda install jupyter
conda install tensorflow
pip install Keras
with your conda environment activated. Don't ask me why - Anaconda's behavior baffles me. (I've created a .yml script with these yet I still seem to need to do this step)