I am trying to find/work out the code needed to get a table of sales data to regenerate at the beginning of each sales day using googlesheets and python3. I've been combing the web and youtube but not had any luck yet. Any advice would be really appreciated :)
Related
I am going to make a simple website that displays data from a script I made with Beautiful Soup. I already have a working Python code that scrapes the data I need.
What I do not know how to do is drop this Python code into a website that scrapes data on a daily basis and displays it nicely. I am scraping daily stock prices and I want my site to store each day's price in a database and plot everything to date on a simple line graph and an accompanying table.
What keywords do I use in researching this? I've started to look into Django vs Flask. Am I on the right path?
I'm trying to scrape data from this webpage and I have only used pandas once for scraping. I want to get the 7 Day High/ Low values. It is on the bottom of the page. What code should I write, and which modules should I use? Thanks for your time! This would help me so much!
https://coinmarketcap.com/currencies/bitcoin/historical-data/
Why not use pandas again and come back when you run into problems.
I have a dataset of 110,003 churches in the US. The dataset includes the name of the church together with other details. I need to populate a column with the date of opening. This requires Googling each church to find its date of opening and populating each row. I am posting an example dataset with 10,000 cases. Please help!
https://docs.google.com/spreadsheets/d/1B1db58lmP5nK1ZeJPEJTuYnPjGTxfu_74RG1IELLsP0/edit?usp=sharing
I have tried using import.io and scrapy but they don't seem to work for me as well as I would appreciate if you recommend a better tool.
I have a project I’m exploring where I want to scrape the real estate broker websites in my country (30-40 websites of listings) and keep the information about each property in a database.
I have experimented a bit with scraping in python using both BeautifulSoup and Scrapy.
What I would Ideally like to achieve is a daily updated database that will find new properties and remove properties when they are sold.
Any pointers as to how to achieve this?
I am relatively new to programming and open to learning different languages and resources if python isn’t suitable.
Sorry if this forum isn’t intended for this kind of vague question :-)
Build a scraper and schedule a daily run. You can use scrapy and the daily run will update the database daily.
I'm a beginner to Django and am currently building a site that displays stock prices. To do that, I need to download (or update) the stock prices once a day. I know that I can retrieve stock prices using Pandas. However, I would like my site to do it once everyday at a specific time, instead of retrieving data every time a visitor visits the view. I'm a bit stuck here and did a lot of Google searches. Can someone please point me to a link that I can read up on?
EDIT: I'm currently making this site on my own computer so I haven't uploaded my files yet.
If you are using a Linux box (like Debian[0]), and have cron[1] up and running:
Create a Shell Script to call a program you will write to get the data using Pandas.
Use crontab -l to edit your crontab file and add you script to execute at any time you need.
[0] https://www.debian.org/
[1] http://linux.die.net/man/1/crontab