How to autoload python packages - python

I'm currently learning Python and using spyder 3 as editor.
There are several python packages that I use regularly and, to avoid including them in each new script, I put a list of imports in a script file called autoload.py and hoped that by calling autoload.py the packages in question are automatically loaded. Unfortunately this does not work.
To illustrate, the file autoload.py contains:
import pandas as pd
import os
import matplotlib.pyplot as plt
from functools import reduce
import collections as clct
import numpy as np
import platform
Your help will be appreciated.

Simple, autoload.py contains:
import pandas as pd
import os
import matplotlib.pyplot as plt
from functools import reduce
import collections as clct
import numpy as np
import platform
Your file.py contains:
from autoload import *
file.py load autoload.py content, but surely your IDE throw syntax error before running code. If you try to run, works perfectly. I have tested it in PyCharm and it works.
Anyway, I have to say you that is very bad practice.
Regards.

This worked for me in Spyder 3.1.4(Python 3.6):
autoload.py
import sys
import easygui
test.py
import autoload
print('test')
print(easygui.msgbox('Hello'))
sys.exit()
Like others have mentioned, this is probably not a good approach.

Related

Python3.8 Import Error No module name tqdm found

I'm trying to run this python project on my linux machine. I did setup everything according to the requirement but when I try to run the project with the ./generate.sh executable file I got the following error.
Import Error: No module name tqdm found.
Here are the imports exists in file.
import os.path as path
import ast
from glob import glob
import signal
import imp
import logging
import time
import numpy as np
import socket
import tqdm
import sys
import click
import tensorflow as tf
from tensorflow.python.client import timeline
I check with pip3 show tqdm command it shows me the package detail. I also try to uninstall and install again the project but got no luck.
If i remove the tqdm import from the file then it shows me this error.
File "./run.py", line 16, in <module>
import click
ImportError: No module named click
Can someone guide me what I'm doing wrong here?
it seems you are importing it wrong, from tqdm docs:
from tqdm import tqdm
I've checked it for both python2 and 3 and this is the way to use it.
The project you are trying to use at least 3 years old, so maybe things have changed since then, so if it wont work for you even with proper import statement you can simply remove it.
Every loop working with tqdm will work without it as well.
For example:
from tqdm import tqdm
for i in tqdm(range(10000)):
pass
is the same as:
for i in range(10000)):
pass

Cannot import utils.programs but import utils successfully - python3 import error

I am trying to implement the code in https://github.com/kexinyi/ns-vqa.
However, when I try the command, python tools/preprocess_questions.py \ ... in the section of "Getting started". I see a message No module named 'utils.programs'.
Then I install utils and which makes import utils work, but import utils.programs does not work.
Does anyone have any idea to solve it?
import os
import argparse
import json
import h5py
import numpy as np
import utils.programs as program_utils # this one cannot be imported
import utils.preprocess as preprocess_utils
import utils.utils as utils
Solution:
Add the below lines at the beginning of preprocess_questions.py file.
import sys
sys.path.insert(0, "..")
This should solve your problem.
Explanation:
It is failing because preprocess_questions.py don't know about the path of utils.programs to import. With the above lines added to the path using .., the required file will be imported.
For more on this refer how importing works in python.

ModuleNotFoundError: No module named 'modeling'

I'm very new to deep learning and python and I'm trying to recreate the project at https://github.com/Nagakiran1/Extending-Google-BERT-as-Question-and-Answering-model-and-Chatbot
As I saw that in the project there is a file named Bert_QuestionAnswer.ipynb and with data.txt are the only difference I see from the original Bert repository, I just simply loaded it in my google drive and opened it as a notebook to see it in use.
When I run the first portion dough I get the ModuleNotFoundError: No module named 'modeling'errror.
What library is it part of?
For somoebody this was the problem :
It looks like it's trying to import from the github repo source rather
than the pip package.
If you are running this in a directory that contains the BERT github
repo, try running it elsewhere.
As always many thanks for the help.
This is the code of the file that throws me the error :
from __future__ import absolute_import
from __future__ import division
from __future__ import print_function
from IPython.core.debugger import set_trace
import collections
import json
import math
import os
import random
import modeling
import optimization
import tokenization
import six
import os
import tensorflow as tf
import logging
logging.getLogger('tensorflow').disabled = True
os.environ['TF_CPP_MIN_LOG_LEVEL'] = '3'
import warnings
warnings.filterwarnings("ignore")
import time
from pandas import Series
from nltk.tokenize import sent_tokenize
import gensim.downloader as api
from gensim.parsing.preprocessing import remove_stopwords
word_vectors = api.load("glove-wiki-gigaword-100") # load pre-trained word-vectors from gensim-data
You need to tell python where this module is:
import sys
sys.path.append("/path/to/your/bert/repo")
Because python will search in his system folders and in the current working directory. If you don't run it in the repo, python doesn't find this module.

Segmentation fault when importing libraries in Python

I am trying to import the following libraries in python:
import os, sys, random, glob, argparse, math, gc
import cv2
import dlib
import imutils
from imutils import face_utils
import matplotlib
import matplotlib.pyplot as plt
from skimage.feature import hog
from skimage import data, exposure
import sklearn
from sklearn import svm, metrics
import numpy as np
import pandas as pd
from bcolz import carray
from tqdm import tqdm
from time import sleep
import datetime as dt
All these libraries are installed in a conda environment and working when I import them in a jupyter notebook.
However, when I try to import them in the terminal or using a script, as soon as I execute:
import matplotlib.pyplot as plt
There is a:
Segmentation Fault(core dumped)
I wonder why it works in jupyter notebook but not in terminal
Because anaconda is a virual envirounment and it works on the jupyter-notebook but not in your OS command line. If you want to use it on the command line, it is recommended to install python, pip and then the packages that you need (all on your command line).
I personally recommend to install pycharm IDE to test your code locally. It is really easy to install and it tries to recognize your python installation. There you can easily add all the packages you need in configuration and import them in the code.
Here is how to add packages (e.g.numpy) in pycharm
Select your Project in Pycharm navigation side
File > Settings ( Ctrl + Alt + s )
Project
Project Interpreter
Plus button
Search for Numpy
Install Package

Python Packaging on Linux with many Imports using disutils' setup.py

I want to have my python program installed on linux computers (and later windows if someone can help me with that). Ideally this would work on anyone's computer who has python installed, but not all the required modules. I am thinking of this like a C binary/executable after running gcc / make commands.
The hard part is that I don't understand how to handle all the imports required. I keep failing when using py2exe or similiar things because I am using 'GDAL'. So here is what I want to put in my setup.py, but I am so confused. Any help greatly appreciated.
setup.py:
from disutils.core import setup
setup(
name='gui',
version='1.0',
py_modules=['gui'],
install_requires=[],
)
My main files is "gui.py". When I run ipython and then run gui.py my program executes perfectly.
Here are the import statements from the gui.py and the files it includes for reference:
gui.py:
#!/usr/bin/env python
from Tkinter import *
import tkFileDialog
from scipy import *
import spleem_image_class as sic
import spleem_image_display_class as sidc
import matplotlib.pyplot as plt
// code ...
spleem_image_class.py:
# -*- coding: iso-8859-15 -*-
from osgeo import gdal
import scipy
import scipy.interpolate
import itertools
from scipy import ndimage
from scipy.ndimage import morphology
from scipy import math
from scipy import *
import matplotlib.pyplot as plt
from scipy import linalg
// code ...
spleem_image_display_class.py
#!/usr/bin/env python
# -*- coding: iso-8559-15 -*-
import matplotlib.pyplot as plt
import matplotlib.colors
import matplotlib.cm as cm
import colorsys
import scipy.optimize as optimize
from scipy import *
import scipy
import numpy
import sys
import itertools
import spleem_image_class as SI
import pickle
// code ...
It looks like in your setup() you need something like this: packages=['distutils', 'distutils.command'], according to the distutils documentation.

Categories