Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 1 year ago.
Improve this question
Welcome, all
I would like to create a small web application, which needs to scrape data from another website and save the results to a database.
So, currently, I have Laravel 8 installed on my local windows machine, and I made a connection to the database, where I have "items" in the table that I need to save the data in
And the data may be changed from another website so I need this change in the database as well,
and need to scrape many items from another website so I need to know id or something else to distinguish one item from another
Now, the question is, what is the best way to do this? I've tried some tutorials but I haven't.
You can use a package Goutte or domcrawler, first you need to do a request of a url for that you can use GuzzleHttp or get the portion of html content and filter it and then save all this data on a table of your database.
You can read more information about those libraries.
Another library that is more customizable is domcrawler Dom_Crawler,
Goutte
Related
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 4 years ago.
Improve this question
I have a MySQL db that is supposed to store shift details like start time, employee, breaks, nr. of items processed etc. to then analyze this data with MS PowerBI.
The employees are supposed to enter the data themselves after their shift and be separated from the data (not see or change it afterwards).
How should I set up the form the employees enter their data into? Should I make a website with a form on it or should I make a diy program that connects to the db?
I am quite new to all of this so I’m trying to find the best way to complete this.
Thank you very much in advance!
You already have a best guess. Yes, create a website which allows the employee to enter the details, grab the info with a back end application (php/java/kotlin/nodejs/python ... e.t.c), and do not develop a page that retrieve data to the website for the employees.
Afterwards, you can export your data to your desired application (you might need to develop something for smooth data transfer as well)
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 5 years ago.
Improve this question
I am currently working on a project and the end goal is for someone to put in the part specification and then the part number and data comes out. I need help to get my html page to search my excel spreadsheet with the specifications and then spit out the part number and price and data. Here's where my inspiration is coming from http://www.lesker.com/newweb/flanges/nipple_builder.cfm
If anyone can help me with a code to search my spreadsheet I would greatly appreciate it, I'm a bit of a novice
You definitely need a dynamic approach to handle this goal. You can not get HTML to Excel work together and the best alternative is to use PHP+MySQL, upload your database to your web server and query it using php. You will have great difficulties if you use only HTML when it comes to update your items in the list.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 4 years ago.
Improve this question
Lets assume we have a web app which allows users to create and modify some dynamic structure (say, graph of some kind) and we don't want save changes permanently until the user clicks 'save' button. What is the best way to store and modify that dynamic structure?
Is it a good idea to use a plain JSON file on the front end, which we can modify according to user actions and then send to the server to update the database when user decides to save their structure? Or should we communicate with the server every time user makes some change, even if he can later decide to discard this change?
Is there a 'standard approach'?
You can use Locale Storage for this task. It's allow save data on client side.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 8 years ago.
Improve this question
I am trying to make a blog using nodejs and mongodb. I want to store all my blog contents in mongodb and load it from there. What would be the best way to do so?
I was wondering how wordpress stores the blog content and displays them in a proper formatted way.
Do I need to bisect the blog contents and then make a html structure out of the contents and save the entire thing in the database or is there any other way to keep the texts formatted and make html structure after fetching the contents?
Don't be hating for a noob question. :)
You can see how WordPress does this by looking at the source of wp_update_post(). Essentially, it escapes all special characters, runs wp_slash(), and saves the post data in a longtext database field.
Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 8 years ago.
Improve this question
I have CSV File's With Different Columns With Few Common Columns, We Are Currently Using Excel To Remove Unwanted Rows Clean The Data, and Generate Reports, I Am Thinking Of Using Elasticsearch As A Solution For Data Storage, Transformation, Load And Reporting.
Is Elasticsearch A Good Choice For This Use Case ?
Elastic Search is, as the name indicated, using to quick search. It is build upon Lucene and similar to another Apache project, Solr...
If you want to query the raw data or do some simple aggregation upon it. It is fine and you can also use Kibana to come up with some fancy GUI so your audience can interact with the data and you can even come up with some dashboard to demonstrate some basic staff. However, it is not a replacement of a data base.
If you want to update or join.. you had better use some data base ... sql + mongo or hive for big data.