Is anyone else having issues with downloading batch prediction CSV files from Google Cloud's Vertex AI? [closed] - csv

Closed. This question is not about programming or software development. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 5 days ago.
Improve this question
I've migrated my ML model from AutoML to the new Vertex AI in Google Cloud. I'm doing batch prediction from a Cloud Storage bucket with the Batch prediction output format set to CSV, and the destination is another folder in a Google Cloud Storage bucket. The prediction results CSV files appear in the Cloud Storage bucket as expected. With prediction results generated by AutoML, clicking the "Download" button in the Cloud Storage bucket would download the CSV file (in Chrome). However, with prediction results generated by Vertex AI, clicking the "Download" button, OR opening the Object Details for each csv file and then selecting "Download" button, Chrome reads the csv as text and opens it in a new tab as text.
Right clicking on the download links and selecting "Save link as..." only allows for download of a text file.
There do not appear to be any obvious attributes in the URL which would cause it to render as text.
There are no options in Chrome settings to force these files to download, and there are no special restrictions for Google.com under Privacy and Security settings.
I have explicitly allowed pop-ups and use redirects for https://console.cloud.google.com in case that was preventing a download pop-up. Changing the overall setting for all sites to allow pop-ups and use redirects has no impact. There are no additional content settings governing CSV files or TXT files in Chrome.
I have also cleared cookies for cloud.google.com and console.cloud.google.com as well, with no effect.
I can confirm that CSV batch prediction results generated by AutoML and stored in the same Cloud Storage bucket still open a new tab and download, rather than opening as text. This suggests that there is something unique about the URLs for newly generated Vertex AI batch prediction results CSVs which is not retroactively true of AutoML batch prediction results. As a result, while it is tempting to blame Chrome for this, the problem appears to be an artifact of Vertex AI data handling, and not a new Chrome version.

Related

How to Open the Audit report file(.json)?

I am using Chrome Dev Tools. I use it to generate an audit report, then save it as a .json file. Then, how to reopen it in Chrome? I cannot find a way to open the .json file in Chrome.
Open-AudIT cleverly checks an association's system and stores the arrangements of the found gadgets.
An incredible revealing structure empowers data, for example, programming permitting, setup changes, non-approved gadgets, limit usage and equipment guarantee status to be removed and investigated.
Open-AudIT Enterprise accompanies extra highlights including Business Dashboards, Report sifting, Scheduled revelation, Scheduled Reports and Maps.

Is there a way to restore deleted chrome cache files? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 5 years ago.
Improve this question
Suppose the cache files have been deleted by pressing shift+ctrl+delete on chrome. the files starting with f_* are removed and the data_* files data_0, data_1... are reduced. So we can not use chrome cache viewer because the files are away. I tried with commercial and free undelete softwares (easeus, recuva, puran, activeundelete) they find the deleted f_ and data_ files but when i recover them and use with nirsoft google chrome cace viewer, i see corrupted results. I need both the urls and the files in the cache before delete operation. Is there any other way? DNS cache is not an option, computer has been reset. google my activity will not help because it only contains the visited urls (history), but the external urls visitied by the first url.
#benchpresser : -"yes you still have an opportunity get your cache files back. i did this before"(As you said chance of getting the files currupted is more but still if you use power data recocvery its the best option to find files with small size..dont use easeUS in this case then..and still you having the chance of getting the uincode of files you lost you can have a try in that way too.)
Requirements
1.Data recovery tool (Power-data recovery, EaseUS Data Recovery etc)
2.OS:- Windows
Step 1. Select the disk storage location where you want to recover from Google Chrome cache files and click "Scan".
Step 2.Data Recovery will start a scan first. After the scan completes, a deep scan will automatically launch in order to find more files.
Step 3. Choose the file(s) you want to recover by file types from the scanning results. Click "Recover" button to recover the selected files. Here you should save all the recovered files on a different drive or memory card in case of data recovery failure.
i hope this will help
You can't restore cleared cache, history or cookies if DNS cache has been cleared. Unfortunately, I believe you are out of luck.

Labeling internet traffic traces from .pcap file and saving in .csv format

I have internet traffic traces in form of .pcap file. I want to label the packets in those traces depending upon whether they belong to HTTP, FTP, DNS, P2P, SMTP, etc and save the results as .csv file. I have heard about the DPI tools called L7-filter and the likes but could not find how to work with them and also don't know if they could do this job of labeling. I want to use these labeled records in training machine-learning classifiers. Can anyone help me by providing solution in detail?
Please provide any alternative method (if useful).

Using a web browser read system time, display data and write configuration data from a USB Mass storage class

I've an embedded system which runs firmware and has USB mass storage with size 79kB. So when you plug in the device to any computer(MAC/Windows), it pops as a 79kB flash drive. The firmware creates files which has transaction records. The objective is to display these transactions (tables and simple graphs) to the user. I've narrowed down to a web browser. So the user (with MAC/Windows PC) can plug in the USB device mass storage and open an HTML file in the mass storage drive and view all the transactions in the form of tables and simple bar graphs. The tricky part comes here: the device(firmware) needs to update it's clock, and this time input has to be sourced from the MAC/Windows PC. How can this be achieved?
This is the minimum requirement. Further, through the web browser the user wants to write some configuration parameters for e.g. through a text box and a submit button in the HTML page.
NOTE: Here the device has USB mass storage type and the web browser approach were selected so that there is no prerequisites for the user.
Please suggest an alternative if this can be done using another approach for e.g. a different class of USB or some other application locally available on MAC/Windows desktop/laptop. For e.g. the application should run on both on Mac and Windows i.e. the code should be the same but can be built into separate packages one for Mac and the other (.exe) for Windows. Please suggest a platform for this that has same source but can be built for both mac and windows. Thanks!
As far as I know, there is no way a web browser could write to a file. If such a thing was possible, it would be a huge security issue.
You have to write a piece of native software to do all the tasks you name. That can be done in pretty much any programming language, and if you're developing embedded systems I reckon you must have some experience in programming.
I'm looking at doing something similar and have an idea, though you may be better equipped to run with it than I am. Have the define contain a directory called "SET_DATE" with files "YEAR15" through "YEAR99", "MON01" through "MON12", "DATE01" through "DATE31", "H00" through "H23", "M00" through "M59", "S00" through "S59", and "SET"; each such file should start at a different sector, though none of the sectors in question need to contain any data (they need not physically be stored anywhere). To set the date to July 4, 2020 at 12:34:56pm, read the following files in sequence:
SET_DATE/YEAR20
SET_DATE/MONTH07
SET_DATE/DATE04
SET_DATE/H12
SET_DATE/M34
SET_DATE/S56
SET_DATE/SET
The last access should cause the unit to set its clock. If a user might want to set the clock more than once, that could be accommodated by either having a bunch of essentially-identical directories under SET_DATE (so setting the date the first time would use SET_DATE/00/YEAR20, the second time SET_DATE/01/YEAR20, etc.) and/or having the drive unmount/remount itself if necessary to clear out any caching.
I would think it unwise to have directory fetches trigger actions, since Windows or an anti-virus tool might decide to pre-cache all the directories in a drive when it is mounted. I would not expect Windows or a browser to eagerly load files, however, so I would think one could have read accesses trigger actions.

HTML5 offline storage. File storage? Directories and filesystem API

For storing data offline WebApp can use:
session storage, "advanced version of cookies"
key/value based Web Storage (AKA local/global/offline/DOM storage)
sql-based Web SQL Database (deprecated) and Indexed Database API
FileReader and FileWriter API (requires user to select files each time the application loads)
But apparently there is no File Storage. Of course, there is a manifest-based caching, but it's just a cache and is not supposed to be used as a user data storage.
Does it mean that the user of WebApp is forced to use some sort of a cloud file storage?
Is there any way to save large files on user's local machine? Or maybe some way to select a local folder web application can use to store user data?
Edit. Security. HTML5 already has the ability to write big portions of data to user's local machine. I don't see any security issues if a browser will provide another, file-based abstraction to store data. It can be some virtual machine, virtual filesystem, whatever.
Hm, I think, it is possible to write JS filesystem and store it as a blob in SQL...
Similar questions.
Update:
Hm... recently I've found this and this. Maybe it is what I'm looking for... Yes, it is! See the answer below.
At last, I've found it! Here's the answer:
I’ll have the DOMFileSystem with a side of read/write access please wrote:
Eric Uhrhane of Google has been
working on the working draft of the
File API: Directories and System specification which defines a set of
APIs to create a sandboxed filesystem
where a web app can read and write
data to.
Wow! I'm so excited!
Why not use localStorage while the user is editing a document and the FileWriter API when they want to save it to disk? Most people are used to seeing a save dialog pop up when saving a document.
The only scenario I can think of that warrants userless access to the FileWriter API is an autosave feature, but autosaving to localStorage can be just as good.
There is a way to save relatively large files to a users hard drive if you are willing to use Flash. Look into Downloadify:
http://www.bitrepository.com/downloadify-client-side-file-generation.html
Downloadify allows you to send data to a SWF and have that SWF create a file on the users machine. My recommendation would be to store the data via one of the methods you listed, Webstorage, sqlite database, etc. Put all your assets, including the SWF in the manifest file so everything is cached locally to the browser. You can then pull information from your db or webstorage and use the SWF to create the files you need.
I'm not sure if you will be able to read these files back into your web application.
Another option to save data is by using link tags with the data URI scheme. However, I'm not sure if it is supported in all the major browsers at the moment.
For security reasons you can't write files to a user's local filesystem in case it gets used for nefarious purposes by evil people.
That's not likely to change, and that's a good thing.
The HTML5 FileSystem API started landing in Chrome 8 and is fairly complete as of now (Chrome 11).
There's a nice tutorial on it here: http://www.html5rocks.com/tutorials/file/filesystem/
http://fsojs.com wraps the FileSystem API effectively, if you want an easy solution
As mentioned by others here, the FileWriter and FileSystem APIs can be used to store files on a client's machine from the context of a browser tab/window.
However, there are several things pertaining to these APIs which you should be aware of:
Implementations of the APIs currently exist only in Chromium-based browsers (Chrome & Opera)
Both of the APIs were taken off of the W3C standards track on April 24, 2014, and as of now are proprietary
Removal of the (now proprietary) APIs from implementing browsers in the future is a possibility
A sandbox (a location on disk outside of which files can produce no effect) is used to store the files created with the APIs
A virtual file system (a directory structure which does not necessarily exist on disk in the same form that it does when accessed from within the browser) is used represent the files created with the APIs
IsolatedStorage, which hasn't been mentioned as of yet, also allows for file i/o from a tab/window context, but it is made available through solely through Silverlight and requires the use of managed code to access. It, like FileSystem, also exists in a sandbox and makes use of a virtual file system.
Given the high market penetration of both Chromium-based browsers and Silverlight (support for which, interestingly enough has been dropped by such browsers), you may find a solution which uses the first of the above approaches available on a client machine satisfactory.
BakedGoods, a Javascript library that establishes a uniform interface that can be used to conduct common storage operations in all native (including FileSystem), and some non-native (including IsolatedStorage) storage facilities, is an example of such a solution:
//Write file to first of either FileSystem or IsolatedStorage
bakedGoods.set({
data: [{key: "testFile", value: "Hello world!", dataFormat: "text/plain"}],
storageTypes: ["fileSystem", "silverlight"],
options: {fileSystem:{storageType: Window.PERSISTENT}},
complete: function(byStorageTypeStoredItemRangeDataObj, byStorageTypeErrorObj){}
});
Just for the sake of complete transparency, BakedGoods is maintained by this guy right here :) .