Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
I just started developing a Google web app, may I know what is the best way of storing data? Is it by using scriptDB, spreadsheets or JDBC?
You can take the hard work out of working with data storage by using this library:
http://www.harryonline.net/scripts/objdb-storing-data-with-google-apps-script/482
Using this library, you can work both with spreadsheets and JDBC databases, and easily switch if you later change your mind.
If you want to modify the data directly, then you can save data in spreadsheet and build apps based on spreadsheet data. If you store data in ScriptDB, you can not edit data easily. It all depends on your requirements.
Related
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 1 year ago.
Improve this question
Welcome, all
I would like to create a small web application, which needs to scrape data from another website and save the results to a database.
So, currently, I have Laravel 8 installed on my local windows machine, and I made a connection to the database, where I have "items" in the table that I need to save the data in
And the data may be changed from another website so I need this change in the database as well,
and need to scrape many items from another website so I need to know id or something else to distinguish one item from another
Now, the question is, what is the best way to do this? I've tried some tutorials but I haven't.
You can use a package Goutte or domcrawler, first you need to do a request of a url for that you can use GuzzleHttp or get the portion of html content and filter it and then save all this data on a table of your database.
You can read more information about those libraries.
Another library that is more customizable is domcrawler Dom_Crawler,
Goutte
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 4 years ago.
Improve this question
I'm building an application with the instant messaging functionality.
The application will allow the users to send files/images as well as normal text messages.
I decided to take the approach with storing the files on the filesystem and write only the file paths to the database. There will be no updates to the files (only insertions and deletions).
Which database would be the best for storing a large amount of file paths, that would be easy to query for a certain user files?
I would go with MongoDB. My experience is that a document based approach using a single Messages collection would be best. Each message document then contains all of the file paths. This eliminates joins and better supports potential future functional requirements changes.
MongoDB also provides great ways to deal with old messages such as TTL indexes.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 4 years ago.
Improve this question
Lets assume we have a web app which allows users to create and modify some dynamic structure (say, graph of some kind) and we don't want save changes permanently until the user clicks 'save' button. What is the best way to store and modify that dynamic structure?
Is it a good idea to use a plain JSON file on the front end, which we can modify according to user actions and then send to the server to update the database when user decides to save their structure? Or should we communicate with the server every time user makes some change, even if he can later decide to discard this change?
Is there a 'standard approach'?
You can use Locale Storage for this task. It's allow save data on client side.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 8 years ago.
Improve this question
I have CSV File's With Different Columns With Few Common Columns, We Are Currently Using Excel To Remove Unwanted Rows Clean The Data, and Generate Reports, I Am Thinking Of Using Elasticsearch As A Solution For Data Storage, Transformation, Load And Reporting.
Is Elasticsearch A Good Choice For This Use Case ?
Elastic Search is, as the name indicated, using to quick search. It is build upon Lucene and similar to another Apache project, Solr...
If you want to query the raw data or do some simple aggregation upon it. It is fine and you can also use Kibana to come up with some fancy GUI so your audience can interact with the data and you can even come up with some dashboard to demonstrate some basic staff. However, it is not a replacement of a data base.
If you want to update or join.. you had better use some data base ... sql + mongo or hive for big data.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 2 years ago.
Improve this question
I am currently invested in a project to implement marine charts and maps into our custom Google Maps application. However, I am quite unsure of how to actually go about doing this. I would like to use the NOAA ENC data from here:
http://www.charts.noaa.gov/ENCs/ENCs.shtml
What I would like to do is use this data to display the charts on Google Maps. Does anyone have any ideas/tips/insight on how to do this?
Apparently there is an open-source reader which plugs into common utility (ogr2ogr) which allows you to convert the data into shapefile format:
http://home.gdal.org/projects/s57/
Once you get the data into shapefile format, then turning it into tiles is a well-understood problem. Here is one blog posting of one way someone did it:
http://jongyulin.com/2009/05/getting-started-with-map-tiling-mapnik-and-shapefiles/ https://web.archive.org/web/20150523144053/http://jongyulin.com:80/2009/05/getting-started-with-map-tiling-mapnik-and-shapefiles/