Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 8 years ago.
Improve this question
I'm a CS student interning at a company that needs a web app made to make looking at data much easier for the end user. I'm very new to web dev. I have experimented a little bit with HTML and CSS but I have never touched Javascript.
Anyway, my company has a web API that I have access to that returns a bunch of data points in JSON format. Upon doing some research online it seems that utilizing something like Django, Node.js, or Rails would be the best option to parse these JSON strings and return the data that I am interested in. Django seems like the best alternative because the documentation seems very good, and I know Python relatively well so the learning curve will not be too bad.
Do you guys think I have roughly the right idea so far? Would using Django to parse hundreds of JSON format strings be a good idea, and then export the data I have to HTML in some way and construct the web app?
Thank you!
I <3 Django.
But in my opinion, Django is best suited to making objects out of data in a database. It does this using and MVC-ish structure and an Object Relational Model (ORM). I'll make some assumptions from your question:
your data isn't in a DB, but is a bunch of JSON strings
you're more interested in displaying, rather than manipulating this data
If those are true, I would think you would want front-end focused system using Javascript. That's the best at handling JSON, after all. Django or Rails would be overkill for parsing strings.
Look at Angular or Ember, et. al.
Node.js is great for requesting remote JSON data and real-time streaming. Pair it with socket.io and real-time data just get more fun.
Take a look at D3.js, which use SVG to generate stunning, customized data visualizations or for simple visualizations, Google Charts API is really simple to begin with.
Related
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 5 days ago.
Improve this question
I am a sort of experienced python programmer. I will quickly describe my situation. For a hobby programming was always nice. I then started working at a company that did lots of manual excel processing. One day I mentioned that I could probably automate this with python.
Things led to another and now there is python doing the excel work multiple times a day running from an Intel NUC i deployed as a small server. It has been some work figuring everything out but the money has been good as well, no complaints.
They are quite happy with me and have lots of different plans.
They want me to design a website where the employees can fill out a form daily and the data can be used elsewhere. However, I've done some html and css programming in highschool, but I know there needs to be a back-end to at least save the data that gets filled.
I dont know where to start. I know SQL is the #1 language in data processing and PHP in handling the back-end. But I already know python which also can do back-end operations.
I have two direct questions but also looking for advice on the whole situation. Feel free to just point anything out; I will read every comment.
My questions:
Could I run the webserver from my Intel NUC? Or is this generally seen as bad practice? Also, is it true that I would only need the domain if I run the webserver myself?
Is it worth it to learn SQL and PHP or should I stick to python?
I have tried looking online but found countless of resources. I would like to create a large database with lots of data I can use anytime. I think SQL is good for this but not looking to waste time.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 3 years ago.
Improve this question
I have to develop an API to manage data between my Database in PostGreSQL and my website in Django.
I'm actually looking for the best way to manage and transfer this data, what I actually found on different topics / sites is the Django Rest Framework to develop a Rest API in Django, here I would use a JavaScript framework for the front like React, Angular or VueJS (any tips about which one to choose ? ).
I was wondering if there was other solutions that would be interesting ? I've been searching about FTP or things like this.
Thanks,
Lucas
Like you said you need to send and retrieve information like name, contact, login detail etc related to user and their subscriptions.
In this case you don't have to think about FTP. It isn't related here. FTP is something that you'll use to transfer files without django.
With django you will have to use DRF (django rest framework) or use GraphQL along.
There is a package well known to use GraphQl called graphene
For front end part you can use anything according to your requirement and skillset.
Hope this helps.
Cheers
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 7 years ago.
Improve this question
Recently I have been assigned a project at my college, which is a news aggregator. I found Flipboard to be a very interesting and viral app for news aggregation. To achieve this, I am building a web crawler, that will crawl the websites, to fetch recent news and posts. I was going through a post on Gizmod
Is the scraper universal/generic, or are there customer scrapers for
certain sites?
Doll: It is mostly universal/generic. However, we can
limit the amount of content displayed on a site-specific basis. We
already try to do this with some sites that publish extremely
abbreviated RSS feeds- even though we aren't using RSS directly, we
attempt to achieve display parity with their feed.
I am quite familiar with the process of fetching data from a single website. But not sure how could I fetch the data from multiple websites and blogs, all with a completely different structure.
I am currently using Python 2.7, urllib2 and BeautifulSoup for crawling a single website.
Question:
I want to know, how could I achieve the objective of fetching data from thousands of websites via just one generic crawler?
I recommend creating one big Spider class, then subclassing for individual sites. I wrote a short answer to a similar question here on stackoverflow.
I have done something similar, although having a basic knowledge of python and google-fu taught me how to make a script that the more advanced users would scoff at. But hey, it works for my use, and doesn't leave too much footprint.
I made several functions that used 'request' to fetch the sites and used 'beautifulsoup' to parse the individual sites based on the structure I reverse-engineered from the sites by using the inspector in Chrome.
When the script is run, it runs all of the functions, thus fetching the info I want.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 7 years ago.
Improve this question
I'm diving into Django to create a webapp.
The thing is, I'm not sure if my app is too simple for what Django offers.
My app will download the latest CPI figures and convert your (monetary) dataset into inflation-adjusted figures, going way back in decades. The user pastes their data in via a textbox. It certainly won't need SQL.
I may want to expand the project with more features in future.
Is it advisable to go with a more lightweight framework for something as simple as I've described?
Every framework has its pros and cons. There are many different frameworks. Personally I prefer Flask but it is all personal preference. Here are some articles that help describe the differences:
https://www.airpair.com/python/posts/django-flask-pyramid
https://www.reddit.com/r/Python/comments/1yr8v5/django_vs_flask/
https://www.hakkalabs.co/articles/django-and-flask
A webapp like the one you describe sounds like most of the work can happen on the client side, without sending the data back to server. From what it sounds like, you simply need to make a few calculations and present the data in a new way.
For this I don't recommend Django, which is ideal for serving pages and managing relational DB content, but not really useful for client side work.
I'd recommend AngularJS
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 8 years ago.
Improve this question
I need to create a website using python but without Django or any other framework, since the website I need to create ts very custom (at the back-end level specially) like having a dashboard after login and stuff like that.
I want to know what are the best practices and/or tutorials that can help me in such a situation.
I began to work with Django 3 months ago in a company. In my opinion this framework is very useful because you avoid to write a lot of HTML code and came with a lot of tools to automate the creation of many parts of the web and the database. Django allows you to use different databases.
I recommend you to visit Django Website and see the overview and the installation. The difficulties for the beginners are to understand the use of views,templates,urls... but in the web site you have a 6 steps tutorial that make a very good introduction, anyways you must get some more information like this Django Book but is almost the same than the tutorial but more extense.
I didn't work with Python until I began to use Django, and I have to say that now I love the dynamism of Python, is fast and easy to understand.
I hope this can help you a little
Using a framework like Django will start you right into developing your application. They you intend to work will cost you years of work to create your own web application infrastructure without getting anything useful.
The strength of Python is the availability of countless modules, packages and frameworks to build upon. Without there you will be getting nowhere.