Fatal Error when launching scrapyd in terminal [closed] - python

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about programming within the scope defined in the help center.
Closed 7 years ago.
Improve this question
I just installed scrapyd on Ubuntu 14.04 and after the installation, I simply typed "scrapyd" into the command line and got:
Failed to load application: No module named txweb
I used both the general and Ubuntu specific installations and neither seem to work. Just for some background, I decided to use scrapyd after having created a project that ran multiple spiders but was not able to pipeline the scraped data into two different tables. I looked at some other SO posts like this one, but they seem to be addressing older versions of scrapyd which probably won't be relevant anymore.
Can someone show me how to get started with scrapyd, because the information provided in the docs doesn't seem to be working for me, thanks.

although the docs has apt-get ... pip is the better way to install scrapy (Never failed for me)
sudo pip install scrapyd works for me and then scrapyd doesn't give any errors.
When you install with apt-get - twisted may not be getting installed, but pip takes care of that.
Try uninstalling your apt-get scrapyd first, and then use pip to install it
sudo apt-get purge scrapyd
sudo pip install scrapyd
-------------- UPDATE ------------
Answering your next question in the comment ...
If you want to run scrapyd-deploy you need to also install the package scrapy-client which is not installed along with scrapy. This is mentioned in the docs - http://scrapyd.readthedocs.org/en/latest/deploy.html
You can install it using sudo pip install scrapyd-client

Related

Best way to Install Pip packages(Ubuntu/Linux) [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 9 months ago.
Improve this question
I was wondering since there are so many optinos to install a python package which one is be best and most convenient. should I install packages with sudo and pip3 commands,
E.g
sudo pip3 install <package>
only using pip3
E.g
pip3 install <package>
or using apt
sudo apt install <python-package>
I was wondering which is the go-to and will be most convenient in the future. Mostly wondering what is the difference between Sudo pip3 and pip3 what difference does it make and which one I should use.
Don't use sudo with pip. There is a chance you'll overwrite system-installed packages, and mess up your OS.
sudo apt install <python-package> is pretty safe, but may result in outdated packages, and will definitely not include all packages you may want to install.
pip3 install <package> will install packages for just the current user (thus, not system-wide; if you're the only user, you're fine), and is what I would recommend.
Going further, virtual environment or use of Conda (an "extended" virtual environment manager) are potentially even safer, at the cost of a little more work to set up, and a bit more disk space (usually, the latter is insignificant).
You will have to read up on the use of virtual environment or Conda. That topic is too long for a standard answer here.
I would suggest as first step reading package documentation, as it often contains information regarding how to install it. Few examples regarding popular packages
click suggests pip install click
jinja2 suggests pip install Jinja2
requests suggests python -m pip install requests
Before that check to what version pertains python in your machine (by checking output of python --version), if it is Python 2 and you want to install packages to Python 3, then you need to use pip3 and python3 rather than pip and python, if it is Python 3 you might use command as they are.

Ansible is not installing via PIP [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 1 year ago.
Improve this question
I was following the tutorial on Ansible docs but was unable to finish it:
$ python -m pip install --user ansible
Returns an error:
/usr/bin/python: No module named pip
While another guide installed it by using python-pip3 and then after running pip3 install --user ansible it was ready to go.
It finishes installation successfully, yet ansible is still not available:
-bash: /usr/bin/ansible: No such file or directory
I have never worked with Python or PIP in the past and I don't understand what could go wrong in the process to start debugging.
You should check your python version in the terminal with
$ which python
command and then this returns a path that contains python(probably this will return a path because almost all of Linux distro contains python). After that result, you could type
$ curl https://bootstrap.pypa.io/get-pip.py
in the terminal, and then type
$ python get-pip.py
pip will be installed after these commands.
I have not found a solution to this but instead I went with the CentOS Epel repository also described in the Ansible docs and it works this way.
sudo yum install epel-release
sudo yum install ansible
Edit: Ok, so all I had to do is to add the following to .bashrc file.
export PATH="$HOME/.local/bin:$PATH"
Fixed.

"No module named lxml" on AWS [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 1 year ago.
Improve this question
I'm trying to run my discordbot.py file on the Amazon EC2 server using MobaXTerm
I've tried every type of installion like:
sudo yum install python-lxml
sudo yum install libxml2-devel libxslt-devel python-devel
sudo yuminstall libxml2-dev libxslt-dev python-dev
pip install lxml
etc.
It always tells me stuff like:
Package python-lxml-3.2.1-4.amzn2.0.2.x86_64 already installed and latest version
Package gcc-7.3.1-12.amzn2.x86_64 already installed and latest version
Package libxml2-devel-2.9.1-6.amzn2.5.1.x86_64 already installed and latest version
Package libxslt-devel-1.1.28-6.amzn2.x86_64 already installed and latest version
Package python-devel-2.7.18-1.amzn2.0.3.x86_64 already installed and latest version
Nothing to do
Yet when I want to run my discord bot, it gives me:
import lxml.html
ModuleNotFoundError: No module named lxml
I don't know what to do from that point on.
Based on the comments.
The solution was to use pip3 install lxml, rather then pip install lxml. The reason is that the former command uses Python 2, not Python 3 required by the bot.

Can't download Django [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 6 years ago.
Improve this question
So I have Python on my new Macbook Air and now I'm trying to download Django and having no luck. I've tried "wget" and the link from the Django site, then I downloaded it and tried "python setup.py install". In both cases I get invalid syntax. I have Python 2.712. I'd really appreciate any help!!
Thanks, Tom
The easiest way to install django is probably to use pip. You should already have it installed since you're running a Python 2.7 version greater than 2.7.9.
The latest official docs read:
Installing an official release with pip
This is the recommended way to install Django.
Install pip. The easiest is to use the standalone pip installer. If your distribution already has pip installed, you might need to update it if it’s outdated. If it’s outdated, you’ll know because installation won’t work.
Take a look at virtualenv and virtualenvwrapper. These tools provide isolated Python environments, which are more practical than installing packages systemwide. They also allow installing packages without administrator privileges. The contributing tutorial walks through how to create a virtualenv on Python 3.
After you’ve created and activated a virtual environment, enter the command pip install Django at the shell prompt.
The main reason for install django is that the django version is not match your python. From the notice of the Django official website and your python version, i think FOR python 2.7 the best django version is 1.8.X.
Here is the download link:
https://www.djangoproject.com/download/1.8.17/tarball/
You can download this version, and try the installation again.
Please see the official docs as this link.
https://docs.djangoproject.com/en/1.8/topics/install/#installing-official-release
With MacOSX, you have to download pip installer, then you can download very easily Django from pip.
I put two possibilities, depending to Python2 or Python3 :
# if pip not installed
$ sudo easy_install pip
# show current pip version
$ pip --version
# upgrade pip
$ sudo pip install --upgrade pip
Then you have to download Django :
# Django version for Python2
$ pip install Django
or
# Django version for Python3
$ pip3 install Django
You can check the Django version :
python -m django --version

apt-get install unable to locate package on ubuntu 12.04 [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 8 years ago.
Improve this question
I'm trying to install matplotlib on my ubuntu 12.04 system with python3. I've read that this package should be available in the package manager, but when I type
sudo apt-get install python3-matplotlib
I get
E: Unable to locate package python3-matplotlib
I've tried
sudo apt-get update
sudo apt-get upgrade
and I still get the error. I know this is a simple problem, but I can't figure it out.
Because the package does not exist, see:
http://packages.ubuntu.com/search?keywords=matplotlib&searchon=names&suite=precise&section=all
If you need matplotlib + python3 on 12.04 you will probably have to install it from source.
As tcaswell pointed out, it doesn't seem to be included in the official Ubuntu repos. You could try to find an external repo for it, but I think you'll be better off installing the version from PyPI.
pip install matplotlib
Most people prefer to install python dependencies using a tool like pip, which defaults to the PyPI repo for downloads.
You could also install from source but then upgrading can become tricky. On the other hand for most packages PyPI will receive updates well before they work their way down to a distro's repo.

Categories