Plotly: Downloading Data in Real Time - csv

Is it possible to stream/download CSV data files from a live Plotly chart using API access in real time? I am setting up a system that accepts data from various sensors and plots it online using Plotly with following requirements:
data has to be accessible from multiple locations/ multiple users
API level access to actual data (numbers in CSV or alike) in realtime (a few seconds lag is acceptable)
Would Plotly be the right tool for this? I couldn't find any resource on downloading data in real time through API level access on their site.
Thanks in advance!

Unfortunately, there is no API for collecting steam data through plotly - the streaming service is intended for displaying data and the data is not persisted.
If you are plotting data that you are collecting realtime, you should be able to aggregate it and save it to a database or CSV at the same time you stream to Plotly for display.

Related

Extracting quarry sites geographic data from OSM or Google Maps API

Does anyone know where or how I can get geographic data for quarry sites for Australian states or local governments? I have searched all over the data repositories hosted by the levels of government.
Now I resorted to extract this data from Openstreetmaps or Google maps API, but I can figure out how to achieve this after trying to check around. All the pointers doesn't seem to yield any data.
How can I get data and specifically quarry sites from OSM or Google Maps API?
Quarries are tagged in OSM as landuse=quarry. For retrieving specific data you can use Overpass API. Overpass API has a nice frontend called overpass turbo.
Here is an example query for retrieving all quarries in Australia:
[out:json][timeout:90];
// fetch area “Australia” to search in
{{geocodeArea:Australia}}->.searchArea;
// gather results
(
// query part for: “landuse=quarry”
node["landuse"="quarry"](area.searchArea);
way["landuse"="quarry"](area.searchArea);
relation["landuse"="quarry"](area.searchArea);
);
// print results
out body;
>;
out skel qt;
You can view the result here. There are also options for downloading raw data.
Constructing the query is as simple as opening overpass turbo, opening the wizard and typing "landuse=quarry" in Australia. Afterwards the timeout parameter has to be raised manually since the default timeout of 25 (seconds) is too low for querying such a huge country.
Note that the query language of Overpass API is quite powerful and there are many ways to enhance your query. Also note that it is possible to call Overpass API directly without the need of overpass turbo which is just a nice frontend.

google calendar sync specifications

I am working on a web application that among other things maintains its own calendar. I want to allow people with gmail accounts to subscribe to this calendar feed. Based on the research I made I can do it by outputting an iCalendar formatted file into a publicly accessible location and direct google calendar to subscribe to this location. What I am trying to find is some technical documentation about how google performs these requests for feed updates, so I can generate the csv files correctly and efficiently. For example what is the frequency of the requests, what is the format of those requests and so on. All I could find API documentation about how to pull information from google calendar. But this is not what I need. Basically I want to create the csv files on demand instead of maintaining them constantly, hence I need to be able to intercept google requests for calendar sync and handle them accordingly. Can somebody point me into the right direction?

How to upload data to web server through arduino gprs module

I have successfully worked out for 2 days and made a program for my arduino to reply me it's gps location coordinates to my mobile phone whenever I send a command to it through sms, but now I want to track it by gprs using 2g network so that I can track it 24x7,But I have no idea how to do this,I saw few tutorials that uses xively.com to graph the incoming data,but in this case my arduino will be transmitting gps coordinates ,so is there any easy way to store these values and directly locate them using google maps?Thanks in advance,please help me.
I would recommend that you send two strings to xively: one with your lattitude coordinates and one with your longitude. Then, I would recommend that you fetch that data using the google maps api.

google maps: How to create static images containing lots of GPS path points

I need to create images of GPS paths on top of google maps satellite information. The ultimate goal is to import those images in a report that is being created in an Excel program that is run through userforms & VBA.
I'm having trouble coming up with a way to automate the generation of these images. Preferably the user would not have to install additional software and there would be a way of automating this process using VBA. I would like to use the Static Google Maps API, but that is limited by the number of characters in an HTML request (2048 as I understand) and my path data is easily going to exceed that length.
Let's assume for now that I have a single KML file with my GPS path data.
Any thoughts on a way to convert large KML path files into static maps image files using VBA? I'm imagining VBA opening a local HTML file with a dynamic google map, uploading the KML file, and somehow capturing and saving a screenshot of the KML data loaded onto the dynamic google map.
FYI I'm locked into using the existing Excel/VBA forms-based program to generate these reports.
(new to this board and relatively new at programming so please let me know if my description is lacking. thanks)

Web-based conversion shp to json

I'm currently working on a school project that implements Google Maps overlayed with data stored in shapefiles and a xml file with a bitmap in it and the WGS coordinates where the image should be overlayed.
The web application that needs to be build requires that a user uploads these raw files, and the result should be visible in the Google Maps.
Is there any way to convert these shapefiles to .json, using PHP or javascript, and get the coordinates stored in the .xml file to get the WGS coordinates. This needs to be done web-based, so stand-alone tools and software won't be sufficient.
These coordinates and .json files than need to be stored in a database, and these records will be used to put on the Google Maps with the appropriate overlays on the resulted coordinates.
Thank you in advance.
All of the processing will need to be done on the server side. I was able to find a shapefile reader class written in php here,
http://www.phpclasses.org/package/1741-PHP-Read-vectorial-data-from-geographic-shape-files.html
It sounds like you have a pretty decent handle on how you need to go about solving the rest of the problem from there.
js-shapefiles-to-geojson script renders shapefiles and dbf files entirely on the client-side, in the browser.
repo: https://github.com/wavded/js-shapefile-to-geojson
demo: http://wavded.github.io/js-shapefile-to-geojson/