We Keep Coding

convert python script and its dependent scripts to exe

I have these python scripts which are dependent on each other --
py_scripts\format py_scripts\plugins py_scripts\utils py_scripts_main_.py py_scripts_pycache_ py_scripts\format\bit.py py_scripts\format\cmd.py py_scripts\format\ctr.py py_scripts\format\fnt.py py_scripts\format\hmp.py py_scripts\format\lmp.py py_scripts\format\mef.py py_scripts\format\qvm py_scripts\format\tex.py py_scripts\format\tga.py py_scripts\format\thm.py py_scripts\format\tlm.py py_scripts\format\tmm.py py_scripts\format\wav.py py_scripts\format_pycache_ py_scripts\format\qvm\op5.py py_scripts\format\qvm\op7.py py_scripts\format\qvm\ops.py py_scripts\format\qvm_init_.py py_scripts\format\qvm_pycache_ py_scripts\format\qvm_pycache_\op5.cpython-36.pyc py_scripts\format\qvm_pycache_\op7.cpython-36.pyc py_scripts\format\qvm_pycache_\ops.cpython-36.pyc py_scripts\format\qvm_pycache__init_.cpython-36.pyc py_scripts\format_pycache_\bit.cpython-36.pyc py_scripts\format_pycache_\cmd.cpython-36.pyc py_scripts\format_pycache_\ctr.cpython-36.pyc py_scripts\format_pycache_\fnt.cpython-36.pyc py_scripts\format_pycache_\hmp.cpython-36.pyc py_scripts\format_pycache_\lmp.cpython-36.pyc py_scripts\format_pycache_\mef.cpython-36.pyc py_scripts\format_pycache_\tex.cpython-36.pyc py_scripts\format_pycache_\tga.cpython-36.pyc py_scripts\format_pycache_\thm.cpython-36.pyc py_scripts\format_pycache_\tlm.cpython-36.pyc py_scripts\format_pycache_\tmm.cpython-36.pyc py_scripts\format_pycache_\wav.cpython-36.pyc py_scripts\plugins\bit py_scripts\plugins\cmd py_scripts\plugins\filesys py_scripts\plugins\fnt py_scripts\plugins\hmp py_scripts\plugins\ilff py_scripts\plugins\level py_scripts\plugins\lmp py_scripts\plugins\mef py_scripts\plugins\qvm py_scripts\plugins\tex py_scripts\plugins\thm py_scripts\plugins\tlm py_scripts\plugins\tmm py_scripts\plugins\wav py_scripts\plugins\bit\convert.py py_scripts\plugins\bit_init_.py py_scripts\plugins\bit_pycache_ py_scripts\plugins\bit_pycache_\convert.cpython-36.pyc py_scripts\plugins\bit_pycache__init_.cpython-36.pyc py_scripts\plugins\cmd\check.py py_scripts\plugins\cmd_init_.py py_scripts\plugins\cmd_pycache_ py_scripts\plugins\cmd_pycache_\check.cpython-36.pyc py_scripts\plugins\cmd_pycache__init_.cpython-36.pyc py_scripts\plugins\filesys\compfiles.py py_scripts\plugins\filesys\copyfiles.py py_scripts\plugins\filesys\countexts.py py_scripts\plugins\filesys\listfiles.py py_scripts\plugins\filesys\treefiles.py py_scripts\plugins\filesys_init_.py py_scripts\plugins\filesys_pycache_ py_scripts\plugins\filesys_pycache_\compfiles.cpython-36.pyc py_scripts\plugins\filesys_pycache_\copyfiles.cpython-36.pyc py_scripts\plugins\filesys_pycache_\countexts.cpython-36.pyc py_scripts\plugins\filesys_pycache_\listfiles.cpython-36.pyc py_scripts\plugins\filesys_pycache_\treefiles.cpython-36.pyc py_scripts\plugins\filesys_pycache__init_.cpython-36.pyc py_scripts\plugins\fnt\check.py py_scripts\plugins\fnt_init_.py py_scripts\plugins\fnt_pycache_ py_scripts\plugins\fnt_pycache_\check.cpython-36.pyc py_scripts\plugins\fnt_pycache__init_.cpython-36.pyc py_scripts\plugins\hmp\convert.py py_scripts\plugins\hmp_init_.py py_scripts\plugins\hmp_pycache_ py_scripts\plugins\hmp_pycache_\convert.cpython-36.pyc py_scripts\plugins\hmp_pycache__init_.cpython-36.pyc py_scripts\plugins\ilff\chunkset.py py_scripts\plugins\ilff\chunksizegcd.py py_scripts\plugins\ilff\chunksizeset.py py_scripts\plugins\ilff_init_.py py_scripts\plugins\ilff_pycache_ py_scripts\plugins\ilff_pycache_\chunkset.cpython-36.pyc py_scripts\plugins\ilff_pycache_\chunksizegcd.cpython-36.pyc py_scripts\plugins\ilff_pycache_\chunksizeset.cpython-36.pyc py_scripts\plugins\ilff_pycache__init_.cpython-36.pyc py_scripts\plugins\level\terrain.py py_scripts\plugins\level_init_.py py_scripts\plugins\level_pycache_ py_scripts\plugins\level_pycache_\terrain.cpython-36.pyc py_scripts\plugins\level_pycache__init_.cpython-36.pyc py_scripts\plugins\lmp\convert.py py_scripts\plugins\lmp_init_.py py_scripts\plugins\lmp_pycache_ py_scripts\plugins\lmp_pycache_\convert.cpython-36.pyc py_scripts\plugins\lmp_pycache__init_.cpython-36.pyc py_scripts\plugins\mef\check.py py_scripts\plugins\mef_init_.py py_scripts\plugins\mef_pycache_ py_scripts\plugins\mef_pycache_\check.cpython-36.pyc py_scripts\plugins\mef_pycache__init_.cpython-36.pyc py_scripts\plugins\qvm\ast.py py_scripts\plugins\qvm\convert.py py_scripts\plugins\qvm\decompile.py py_scripts\plugins\qvm\obj.py py_scripts\plugins\qvm\objects.py py_scripts\plugins\qvm\qsc.py py_scripts\plugins\qvm\terrain.py py_scripts\plugins\qvm_init_.py py_scripts\plugins\qvm_pycache_ py_scripts\plugins\qvm_pycache_\ast.cpython-36.pyc py_scripts\plugins\qvm_pycache_\convert.cpython-36.pyc py_scripts\plugins\qvm_pycache_\decompile.cpython-36.pyc py_scripts\plugins\qvm_pycache_\obj.cpython-36.pyc py_scripts\plugins\qvm_pycache_\objects.cpython-36.pyc py_scripts\plugins\qvm_pycache_\qsc.cpython-36.pyc py_scripts\plugins\qvm_pycache_\terrain.cpython-36.pyc py_scripts\plugins\qvm_pycache__init_.cpython-36.pyc py_scripts\plugins\tex\convert.py py_scripts\plugins\tex_init_.py py_scripts\plugins\tex_pycache_ py_scripts\plugins\tex_pycache_\convert.cpython-36.pyc py_scripts\plugins\tex_pycache__init_.cpython-36.pyc py_scripts\plugins\thm\convert.py py_scripts\plugins\thm_init_.py py_scripts\plugins\thm_pycache_ py_scripts\plugins\thm_pycache_\convert.cpython-36.pyc py_scripts\plugins\thm_pycache__init_.cpython-36.pyc py_scripts\plugins\tlm\convert.py py_scripts\plugins\tlm_init_.py py_scripts\plugins\tlm_pycache_ py_scripts\plugins\tlm_pycache_\convert.cpython-36.pyc py_scripts\plugins\tlm_pycache__init_.cpython-36.pyc py_scripts\plugins\tmm\convert.py py_scripts\plugins\tmm_init_.py py_scripts\plugins\tmm_pycache_ py_scripts\plugins\tmm_pycache_\convert.cpython-36.pyc py_scripts\plugins\tmm_pycache__init_.cpython-36.pyc py_scripts\plugins\wav\convert.py py_scripts\plugins\wav_init_.py py_scripts\plugins\wav_pycache_ py_scripts\plugins\wav_pycache_\convert.cpython-36.pyc py_scripts\plugins\wav_pycache__init_.cpython-36.pyc py_scripts\utils\fs.py py_scripts\utils\ilff.py py_scripts\utils_pycache_ py_scripts\utils_pycache_\fs.cpython-36.pyc py_scripts\utils_pycache_\ilff.cpython-36.pyc py_scripts_pycache__main_.cpython-36.pyc
I want to compile all these to a single exe file that works well with parameters...
Can anyone please help me ?
Thanks
My research :
i downloaded 'pyinstaller' from command line using 'pip' , then i used 'cd' command to locate my scripts folder , then i used 'pyinstaller --onefile main.py' command from command line and then it converted it to .exe
But the exe located in now 'dist' directory is showing an error on running error message
error output at command line
About my python scripts :
my scripts are actually dependent on 2 more external libraries "numpy, pillow, lxml", the 'main.py' used other scripts to work well. Also i wanted to pack all the file ".py, .pyc etc..." to exe. My script works well with parameters and is responsible for converting files. I don't wanted others to use my script it contains very sensitive data.
After all these info can anyone please help me ?
Thanks again

You can use pyinstaller for creating a single exe file which would be executable.
https://datatofish.com/executable-pyinstaller/
I think this would be helpful.

Path issue to root directory

I am currently trying to run the coin_flip_traders_v1.0.py script from the Darwinex ZeroMQ Python library here -> https://github.com/darwinex/dwx-zeromq-connector/tree/master/v2.0.1/python
However, I am having some trouble with the path that it says at the top of the file to point to the root directory.
I have changed it to _path = '../../..' Which should take me to the project root. However I get the error:
File
"/Users/Al/Desktop/Trading/examples/template/strategies/base/DWX_ZMQ_Strategy.py",
line 20, in os.chdir(_path) NameError: name '_path' is not defined
I then changed the path for the DWX_ZMQ_Strategy.py to _path = '../../../..'
I then get the error:
File
"/Users/Al/Desktop/Trading/examples/template/strategies/base/DWX_ZMQ_Strategy.py",
line 24, in from api.DWX_ZeroMQ_Connector_v2_0_1_RC8 import
DWX_ZeroMQ_Connector ModuleNotFoundError: No module named 'api'
I am thinking that it has something to do with the way I am setting the path to the root directory, but not sure where I am going wrong.
If it helps, I am running python 3.6.8 and the command I am executing to run the script is exec(open("coin_flip_traders_v1.0.py").read())

The problem is not a ZeroMQ-related problem.
For diagnosing the rest, the successful file-system tree-navigation, start with using this:
print( "DEBUG: now uses this directory-tree {0:} node".format( os.getcwd ) )
...
os.chdir( anyMaskForRelativeOrAbsoluteTreeMOVE ) # no ~-"expansions"
...
print( "DEBUG: now uses this directory-tree {0:} node".format( os.getcwd ) )
Also kindly note, you must reach such a directory, where the API was installed, not the "root"-directory of the whole filesystem. Check where your DWX installation is actually located and direct the os.chdir()-move to reach that point.

Yocto failing to fetch URL not understood

I am building a Linux image using Yocto which requires the AWS CLI (Command Line INterface). I have added the meta-iot-cloud layer which contains the AWS CLI and SDKs etc., however there are so many other python module dependencies which I have to add one by one manually to my project
One of the dependencies is python3-six. I've located this online, both files python3-six_1.12.0.bb and python-six.inc and added them to meta-iot-cloud/recipes-devtools/python. The content of these files are shown below.
However I keep receiving this error during the bitbake compilation that I do not understand. I don't see this URL mentioned anywhere in the files, and don't know know why it's looking for it, and hence i've no idea how to solve this :
WARNING: Failed to fetch URL
https://pypi.python.org/packages/source/p/python3-six/python3-six-
1.12.0.tar.gz, attempting MIRRORS if available
ERROR: Fetcher failure: Fetch command failed with exit code 8, output:
https://files.pythonhosted.org/packages/source/p/python3-six/python3-six-
1.12.0.tar.gz:
2019-04-11 10:58:46 ERROR 404: Not Found.
ERROR: Function failed: Fetcher failure for URL:
'https://pypi.python.org/packages/source/p/python3-six/python3-six-
1.12.0.tar.gz'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/ubuntu/testYoctoBuild-
AWS_IoT/apiary-gateway/build-bbgw2/tmp/work/cortexa8hf-vfp-neon-poky-linux-
gnueabi/python3-six/1.12.0-r0/temp/log.do_fetch.4160
ERROR: Task 5800 (/home/ubuntu/testYoctoBuild-AWS_IoT/apiary-gateway/build-
bbgw2/../meta-iot-cloud/recipes-devtools/python/python3-six_1.12.0.bb,
do_fetch) failed with exit code '1'
python3-six_1.12.0.bb :
inherit setuptools3
require python-six.inc
python-six.inc :
SUMMARY = "Python 2 and 3 compatibility library"
HOMEPAGE = "https://pypi.python.org/pypi/six/"
SECTION = "devel/python"
LICENSE = "MIT"
LIC_FILES_CHKSUM = "file://LICENSE;md5=83e0f622bd5ac7d575dbd83d094d69b5"
SRC_URI[md5sum] = "9ae5d1feed8c0215f4ae4adcd9207fcb"
SRC_URI[sha256sum] =
"d16a0141ec1a18405cd4ce8b4613101da75da0e9a7aec5bdd4fa804d0e0eba73"
inherit pypi
RDEPENDS_${PN} = "${PYTHON_PN}-io"
BBCLASSEXTEND = "native nativesdk"

Integrate airbrake with Python

When I'm trying to integrate python logging with airbrake, I get following errors:
main.py
import pybrake
from config2.config import config
airbrake_handler = None
def filter_airbrake_msgs(notice):
if config.environment in ['production', 'staging']:
return notice
return None
def config_airbrake():
print(config.py_brake)
notifier = pybrake.Notifier(
project_id=config.py_brake.project_id,
project_key=config.py_brake.project_key
)
config_airbrake()
ENV=development python3 main.py
Error :
ERROR pybrake get_git_revision failed: [Errno 2] No such file or directory: '/user/xxx/xxx/xxx/.git/HEAD'

That looks like a log message coming from https://github.com/airbrake/pybrake/blob/master/pybrake/git.py#L12. I see why it is confusing but it is actually harmless and you can ignore it. I've created an issue to remove that log message. And feel free to use Github issues for such questions in future.
Overall pybrake checks if directory stored in context.rootDirectory contains a Git folder. If there is a git folder there it tries to extract some info like git revision, checkout date etc. Otherwise it logs the first error.

Download error on (…) hostname <proxy> doesn't match either of '*.c.ssl.fastly.net', (…) when running buildout behind proxy

I'm trying to build a project which uses Buildout and I'm behind a proxy but there's a problem with hostname verification. I couldn't find the root of the problem as passing multiple -v options to buildout command seems to not increase verbosity in this case. I couldn't find any information on buildout's interaction with proxies neither at http://www.buildout.org/en/latest/docs/index.html (which is version 1.2.1!?) nor at https://pypi.python.org/pypi/zc.buildout/2.2.1
pdobrogost#host:~/projects/projectx/projectx_buildout$ python bootstrap.py -c buildout-devel.cfg
Downloading http://pypi.python.org/packages/2.7/s/setuptools/setuptools-0.6c11-py2.7.egg
Getting distribution for 'setuptools'.
/opt/python/2.7/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'src_root'
warnings.warn(msg)
Got setuptools 5.7.
Getting distribution for 'zc.buildout==1.4.3'.
Got zc.buildout 1.4.3.
pdobrogost#host:~/projects/projectx/projectx_buildout$ ./bin/buildout -vNc buildout-devel.cfg custom:cvsuser=pdobrogost
Installing 'mr.developer'.
We have no distributions for mr.developer that satisfies 'mr.developer'.
Download error on http://pypi.python.org/simple/mr.developer/: hostname 'proxy.site.local' doesn't match either of '*.c.ssl.fastly.net', 'c.ssl.fastly.net', '*.target.com', '*.vhx.tv', '*.snappytv.com', '*.atlassian.net', 'secure.lessthan3.com', '*.atlassian.com', 'a.sellpoint.net', 'cdn.upthere.com', '*.tissuu.com', '*.issuu.com', '*.kekofan.com', '*.python.org', '*.theverge.com', '*.sbnation.com', '*.polygon.com', '*.twobrightlights.com', '*.2brightlights.info', '*.vox.com', 'staging-cdn.upthere.com', '*.zeebox.com', '*.beamly.com', '*.aticpan.org', 'stream.svc.7digital.net', 'stream-test.svc.7digital.net', '*.articulate.com', 's.t.st', 'vid.thestreet.com', '*.planet-labs.com', '*.url2png.com', 'turn.com', 'www.turn.com', 'rivergathering.org', 'social.icfglobal2014-europe.org', '*.innogamescdn.com', '*.pathable.com', '*.staging.pathable.com', '*.kickstarter.com', 'sparkingchange.org', 'www.swedavia.se', 'www.swedavia.com', 'js-agent.newrelic.com', '*.fastly-streams.com', 'cdn.brandisty.com', 'fastly.hightailcdn.com', '*.fl.yelpcdn.com', '*.feedmagnet.com', 'api.contentbody.com', '*.acquia.com', '*.swarmapp.com', '*.pypa.io', 'pypa.io', 'static.qbranch.se', '*.krxd.net', '*.room.co', '*.metrological.com', 'room.co', 'cdn.evbuc.com', 'cdn.adagility.com', '*.bandpage.com', '*.ibmserviceengage.com', '*.quirky.com', '*.veez.co', '*.x.io', '*.otoycdn.net', '*.scribd.com', 'www.dwin1.com', 'api.imgur-ysports.com', 'i.imgur-ysports.com', '*.fxcm.co.jp', 'listora.com', '*.listora.com', 'blendle.nl', '*.blendle.nl', '*.modeanalytics.com', 'modeanalytics.com', 'krux.com', '*.krux.com', '*.udemy.com', '*.1stdibs.com', 'api.keep.com', 'www.piriform.com', '*.ustream.tv', 'www.zimbio.com', 'm.zimbio.com', 'www.stylebistro.com', 'm.stylebistro.com', 'm.lonny.com', 'www.lonny.com', 'assets.trabiancdn.com', '*.socialchorus.com', '*.heritagestatic.com', '*.theoutbound.com', 'img.rakuten.com', 'images.rakuten.com', 'img1.r10.io', 'ast1.r10.io', 'scribd.com' -- Some packages may not be found!
Couldn't find index page for 'mr.developer' (maybe misspelled?)
Download error on http://pypi.python.org/simple/: hostname 'proxy.site.local' doesn't match either of '*.c.ssl.fastly.net', 'c.ssl.fastly.net', '*.target.com', '*.vhx.tv', '*.snappytv.com', '*.atlassian.net', 'secure.lessthan3.com', '*.atlassian.com', 'a.sellpoint.net', 'cdn.upthere.com', '*.tissuu.com', '*.issuu.com', '*.kekofan.com', '*.python.org', '*.theverge.com', '*.sbnation.com', '*.polygon.com', '*.twobrightlights.com', '*.2brightlights.info', '*.vox.com', 'staging-cdn.upthere.com', '*.zeebox.com', '*.beamly.com', '*.aticpan.org', 'stream.svc.7digital.net', 'stream-test.svc.7digital.net', '*.articulate.com', 's.t.st', 'vid.thestreet.com', '*.planet-labs.com', '*.url2png.com', 'turn.com', 'www.turn.com', 'rivergathering.org', 'social.icfglobal2014-europe.org', '*.innogamescdn.com', '*.pathable.com', '*.staging.pathable.com', '*.kickstarter.com', 'sparkingchange.org', 'www.swedavia.se', 'www.swedavia.com', 'js-agent.newrelic.com', '*.fastly-streams.com', 'cdn.brandisty.com', 'fastly.hightailcdn.com', '*.fl.yelpcdn.com', '*.feedmagnet.com', 'api.contentbody.com', '*.acquia.com', '*.swarmapp.com', '*.pypa.io', 'pypa.io', 'static.qbranch.se', '*.krxd.net', '*.room.co', '*.metrological.com', 'room.co', 'cdn.evbuc.com', 'cdn.adagility.com', '*.bandpage.com', '*.ibmserviceengage.com', '*.quirky.com', '*.veez.co', '*.x.io', '*.otoycdn.net', '*.scribd.com', 'www.dwin1.com', 'api.imgur-ysports.com', 'i.imgur-ysports.com', '*.fxcm.co.jp', 'listora.com', '*.listora.com', 'blendle.nl', '*.blendle.nl', '*.modeanalytics.com', 'modeanalytics.com', 'krux.com', '*.krux.com', '*.udemy.com', '*.1stdibs.com', 'api.keep.com', 'www.piriform.com', '*.ustream.tv', 'www.zimbio.com', 'm.zimbio.com', 'www.stylebistro.com', 'm.stylebistro.com', 'm.lonny.com', 'www.lonny.com', 'assets.trabiancdn.com', '*.socialchorus.com', '*.heritagestatic.com', '*.theoutbound.com', 'img.rakuten.com', 'images.rakuten.com', 'img1.r10.io', 'ast1.r10.io', 'scribd.com' -- Some packages may not be found!
Getting distribution for 'mr.developer'.
While:
Installing.
Loading extensions.
Getting distribution for 'mr.developer'.
Error: Couldn't find a distribution for 'mr.developer'.
I have proxies set as following:
pdobrogost#host:~/projects/projectx/projectx_buildout$ env | grep proxy
http_proxy=http://proxy.site.local:8080
https_proxy=http://proxy.site.local:8080
no_proxy=localhost,127.0.0.1,.site.local,192.168.*
Also, buildout-devel.cfg extends buildout.cfg where the following versions are specified:
[versions]
zc.buildout = 1.4.3
zc.recipe.egg = 1.2.2
For comparision, with wget I get this:
pdobrogost#host:~/projects/projectx/projectx_buildout$ wget http://pypi.python.org/simple/mr.developer
--2014-09-05 10:56:20-- http://pypi.python.org/simple/mr.developer
Resolving proxy.site.local... 192.168.10.132
Connecting to proxy.site.local|192.168.10.132|:8080... connected.
Proxy request sent, awaiting response... 301 Moved Permanently
Location: https://pypi.python.org/simple/mr.developer [following]
--2014-09-05 10:56:20-- https://pypi.python.org/simple/mr.developer
Connecting to proxy.site.local|192.168.10.132|:8080... connected.
ERROR: certificate common name “*.c.ssl.fastly.net” doesn’t match requested host name “pypi.python.org”.
To connect to pypi.python.org insecurely, use ‘--no-check-certificate’.

Not sure if this is directly related, but your post came up when trying to find an answer to my problem. It looks like there may be an issue with some versions of Python (3.4 in my case) where it could not install dependencies behind a proxy. It looks like it's related to this: (https://github.com/shazow/urllib3/pull/385) It looks like the buildout script may be running into the same issue?
For a work-around in my case where I'm only using pip, I was able to install each dependency manually. So keep trying to install the main package with pip, then when it fails saying it can't find a package, pip install that package and try again.

You can try using http, by selecting different mirror that supports http as outlined in this guide -- http://jacobian.org/writing/when-pypi-goes-down/
For buildout, you will need to add the following as global declaration
[global]
index-url = http://pypi.python.org/simple
The main problem, however that pypi.python.org is now set up to serve https only and will still redirect you to https site even if your using http, so the only real solution is to create a mirror somewhere outside and serve pypi content via http.