i used
from google.colab import drive
drive.mount('/content/drive')
But only my disk is loading
And the folder in which I have access is not loaded.
I want to upload a file from someone else's google drive to my colab and then use it.
How can I do that?
I have already tried posting the link but get
Mountpoint must be in a directory that exists
I need to upload a large file ( Sample File) to google colab. This file is located on a google drive account.
Consider these situation:
My google drive is approximately full, so I could not upload it to my drive
My connection speed is low and downloading this file and uploading it to google drive is a great challenge for me.
Also, I read some stackoverflow pages like: Import data into Google Colaboratory and these ones:
Download File from URL to Google Drive using Google Colab in Python , Get Started: 3 Ways to Load CSV files into Colab and 7 ways to load external data into Google Colab. But non of them was useful for my case. I also tried !wget command but it could not download a google drive link.
Assume you have a shared google drive link like this one:
Then share it with another person:
Now, go to your google drive and check Shared with me:
Add shortcut to drive: Now this file has been added to google drive and it is accessible in colab.
Finally, go to colab and run these commands:
from google.colab import drive
drive.mount('/content/drive')
import os
os.chdir("drive/My Drive/Weights/")
And file is there!
Need to call data folder but how to do it in colab. I tried it on spyder but not able to do in colab, already mounted google drive.
import torch
import cv2
from data import BaseTransform, VOC_CLASSES as labelmap
from ssd import build_ssd
import imageio
Image of google drive in collab
It will be better if I able to interect with whole Windows 1 folder?
You can connect to google colab using
from google.colab import drive
import os
drive.mount('/content/drive')
To call you can copy the path. You can get the path of the folder by right click --> copy path. You can use that path for reading/writing the files in that folder.
Thank you, I got the answer
I just did
cd /content/drive/Mypath
Normally I need to upload kaggle json file for using Kaggle dataset in google colab. And for this, we need to use this code.
!pip install kaggle
from google.colab import files
files.upload()
But, I want to upload the json file from google drive. Is it possible? What should I do about this?
!pip install kaggle
from google.colab import files
files.open('/content/drive/MyDrive/Colab Notebooks/json kaggle')
It gives me an error. and error msg is-
AttributeError Traceback (most recent call last)
<ipython-input-2-d57806ba75a7> in <module>()
1 get_ipython().system('pip install kaggle')
2 from google.colab import files
----> 3 files.open('/content/drive/MyDrive/Colab Notebooks/json kaggle')
4 #files.upload() #download and upload json file
AttributeError: module 'google.colab.files' has no attribute 'open'
Thank you.
There seem to be lots of ways to access a file on Google Drive from Colab but no simple way to save a file from Google Colab back to Google Drive.
For example, to access a Google Drive file from Colab, you can mount the Google Drive using
from google.colab import drive
drive.mount('/content/drive')
However, to save an output file you've generated in Colab on Google Drive the methods seem very complicated as in:
Upload File From Colab to Google Drive Folder
Once Google Drive is mounted, you can even view the drive files in the Table of Contents from Colab. Is there no simple way to save or copy a file created in Colab and visible in the Colab directory back to Google Drive?
Note: I don't want to save it to a local machine using something like
from google.colab import files
files.download('example.txt')
as the file is very large
After you have mounted the drive, you can just copy it there.
# mount it
from google.colab import drive
drive.mount('/content/drive')
# copy it there
!cp example.txt /content/drive/MyDrive
Other answers suggest how to copy a specific file, I would like to mention you can also copy the entire directory, which is useful when copying logs from callbacks from Colab to Drive:
from google.colab import drive
drive.mount('/content/drive')
In my case, the folder names were:
%cp -av "/content/logs/scalars/20201228-215414" "/content/drive/MyDrive/Colab Notebooks/logs/scalars/manual_add"
You can use shutil to copy/move files between colab and google drive
import shutil
shutil.copy("/content/file.doc", "/content/gdrive/file.doc")
When you are saving files, simply specify the Google Drive path for saving the file.
When using large files, Colab sometimes syncs the VM and Drive asynchronously. To force the sync, simply run:
from google.colab import drive
drive.flush_and_unmount()
in my case I use the common approach with the !cp command.
But sometimes, it didn't work in Colab because we didn't enter the right file path.
basic code: !cp source_filepath destination_filepath
implementation code:
!cp /content/myfolder/myitem.txt /content/gdrive/MyDrive/mydrivefolder/
in addition, to correctly enter the path, you can copy the path location from the table of contents on the left side by clicking the dot menu -> copy path.
Once you see the file in the Table of Contents of Colab on the left, simply drag that file into the "/content/drive/My Drive/" directory located on the same panel. Once the file is inside your "My Drive", you will be able to see it inside your Google Drive.
After you mount your drive...
from google.colab import drive
drive.mount('/content/drive')
...just prepend the full path, including the mounted path (/content/drive) to the file you want to write.
someList = []
with open('/content/drive/My Drive/data/file.txt', 'w', encoding='utf8') as output:
for line in someList:
output.write(line + '\n')
In this case we save it in a folder called data located in the root of your Google Drive.
You may often run into quota limits using the gdown library.
Access denied with the following error:
Too many users have viewed or downloaded this file recently. Please
try accessing the file again later. If the file you are trying to
access is particularly large or is shared with many people, it may
take up to 24 hours to be able to view or download the file. If you
still can't access a file after 24 hours, contact your domain
administrator.
You may still be able to access the file from the browser:
https://drive.google.com/uc?id=FILE_ID
No doubt gdown is faster but i copy my files using the command below and avoid quota limits
!cp /content/drive/MyDrive/Dataset/test1.zip /content/dataset