importing csv into QGIS - csv

So I am trying to transfer OSM data contained in a CSV document with OSM_way_id, OSM_start_node, OSM_end_node as columns, to QGIS. I want to represent this open street map data contained in the CSV as a map in QGIS. How do I do this? Please I need help.
Below is an example of the CSV when opened with Microsoft Excel. The CSV contains numerous rows and these columns:
Year
Month
Day
Hour
osm_way_id
osm_start_node
osm_end_node
speed_mph_mean
speed_mph_stddev
2020
03
08
18
8179128
1343922650
108500
9.599
2.439

Related

ArcGIS Pro 2.8.0: Convert XY data to shapefile

I've displayed my XY data on my basemap, but when I right-click the layer and select "data" it says "export table" instead of "export data" so I can't choose the feature class shapefile. My data are in a CSV format, my headers are within the 1-10 limit, the data are formatted as text, and tried uploading this thing a whole bunch of different ways and it still thinks its a table. What am I missing?
The data looks like this:
*Group.1 (2005 -> 2020), Group.2 (1 -> 47)
Group.1 Group.2 latitude longitude
1 2005 1 25.66644 -80.26327
2 2006 1 25.68155 -80.25509
3 2007 1 25.62914 -80.28869
4 2008 1 25.62917 -80.28873
5 2009 1 25.62925 -80.28862
6 2010 1 25.62921 -80.28866
Turns out I was using the wrong export option. All you have to do is right-click your displayed XY data > scroll to data > Export Features (not export table). Change the output location from your geodatabase to another folder of your choosing, change the Output name and ArcGIS Pro will autofill ".shp" at the end - click "OK" at the bottom right and POOF! Shapefile saved.
This video helped me get there:
https://www.youtube.com/watch?v=8vxfBK_afMw

CSV - How to represent multiple values in one cell

I have to export data to a CSV file, but I'm not sure if what I'm trying to do is possible. One specific column of the CSV file need to hold multiple values, and each one of these values must have a date specified. Example:
1.50 happened on the 31/01/2021
1.45 happened on the 28/02/2021
1.56 happened on the 31/03/2021
1.55 happened on the 30/04/2021
Can I do the following?
Place;Performance;Name
Berlin;"31/01/2021 1.50" "28/02/2021 1.45" "31/03/2021 1.56" "30/04/2021 1.55";Andrew
With the folowing you will get one cell in column 'Perfomance' with value:
"31/01/2021 1.50" "28/02/2021 1.45" "31/03/2021 1.56" "30/04/2021 1.55"
This will be interpreted as string/text.
You can try to desing specific output in Excel then save as CSV, and see with notepad how the csv looks like.

How to select dynamical every month different source folder in SSIS

Scenario : Actual i want to see that one when Sep 6 only data load for source folder sep6 and tomorrow SEP 7 then data load form SEP 7 folder only then day after tomorrow SEP 8 mean data load from sep8 folder only but how ?????
I would do this by populating a variable from a C# script task. You can generate date/time strings very easily in a script task. E.g.:
Dts.Variables["User::FirstThreeCharsOfMonthNameUpper"].Value = DateTime.Now.ToString("MMM").ToUpper();

Converting a JSON file of unknown structure to CSV using R

I am looking for a way to convert a rather big (3GB) json file to csv. I tried using R and this is the code that I used.
library("rjson")
data <- fromJSON(file="C:/POI data 30 Rows.json")
json_data <- as.data.frame(data)
write.csv(json_data, file='C:/POI data 30 Rows Exported.csv')
The example I am using is only a subset of the total data of about 30 rows. which I extracted using EMeditor and copied and pasted into a text file. The problem is however it only converts the first row of the data.
I am not an experienced programmer and have tried everything on youtube tutorials from php to excel and nothing seems to work. The problem is I have no Idea what the structure of the data is so I can not create a predetermined data frame and there is a number of missing values within the data.
Any advice would be greatly appreciated.

SSIS Design pattern for Multiple XLSB File sheets to multiple tables

There are xlsxb files and each of these consists of varying number of sheets (consists of upto 9 sheets) .All the sheets are of different structure.The requirement is to laoad a specific named sheet data into corresponding table.The specific named sheet may or may not appear in all the xlsb files.
Example:
1st xlsb file consists of 9 sheets(
sh1,sh2,...,sh9)
2nd xlsb file consists of 6 sheets(sh1,sh5,sh6,sh7,sh9,sh2)
3rd xlsb file consists of 3 sheets(sh5,sh7,sh9)
The idea is all sh9 to be colleted in on table called Table_sh9.All sh5 has to
be in Table_sh5
What SSIS design pattern can be followed for this.
To have this dynamic I recommend you do this with a script task. You can look into OpenXML and ClosedXML to read the data.
https://closedxml.codeplex.com/
I would read the header to determine what table you are loading to, then create a datareader from the input and feed that datareader to sqlbulkcopy.
I have a similar solution that automatically create the tables for me and I use the datastreams library -> https://www.csvreader.com/