# \[COMPREHENSIVE GUIDE\]Move files/folders from one cloud to another|RCLONE|COLAB **URL:** \ **Category:** Tutorials & Methods\ **Tags:** freebies, tips-tricks\ **Created:** [May 21, 2021, 10:04am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603 "2021-05-21T10:04:10Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![chaku](https://onehack.st/user_avatar/onehack.st/chaku/32/87908_2.png) [@chaku](https://onehack.st/u/chaku)\ **Post date:** [May 21, 2021, 10:04am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/1 "2021-05-21T10:04:11Z")
Welcome to my first post on this website, Today I will teach you people how to make transfers from one drive to another, I am aware another guide exists on this website but it is far from comprehensive and that I what I will be trying to fix via this guide my covering a lot of cases as example. To make this total noob friendly it will start from scratch that i.e. Installing rclone in colab instance and but let that not fool you cuz it will end with some advanced experimental flags ![Rclone_wide_logo.svg](https://onehack.st/uploads/default/original/3X/c/d/cddf7b83355970dea9f61002f88f51200592ef3c.png) This is the table of contents for those looking for a quick solution **1.Installing rclone in colab instance** **2. Making config for google drive(my drive)** **3.Making config for google drive(team/shared drive)** **4.Making “shared with me” visible to rclone** **5.Making config for dropbox(using your own app id)** **6.Testing out the configs** **7.Making a test transfer to see if everything will go all right(–dry-run)** **8.Using rclone’s copy command to sync things up(–update)** **9.Speeding up the transfer using args** **10.Experimental flags for google drive and rclone** **1.Installing rclone in colab instance** To begin just go to [https://colab.research.google.com/](https://colab.research.google.com/) and open a new notebook ![Screen Shot 2021-05-21 at 1.24.33 AM](https://onehack.st/uploads/default/original/3X/b/c/bc0656fe515a9b33451e6f37eefdbc488ad82adf.png) or ![Screen Shot 2021-05-21 at 1.25.48 AM](https://onehack.st/uploads/default/original/3X/6/8/68f6ddc8c536dfe17d4d14738e4ced78af2d74d2.png) After that you will have to type the following snippet in the code box and hit the run button for run box `!wget https://beta.rclone.org/branch/fix-dropbox-batch-sync/v1.55.0-beta.5334.ac7acb9f0.fix-dropbox-batch-sync/rclone-v1.55.0-beta.5334.ac7acb9f0.fix-dropbox-batch-sync-linux-amd64.deb` ``` !apt install ./rclone-v1.55.0-beta.5334.ac7acb9f0.fix-dropbox-batch-sync-linux-amd64.deb ``` ![Screen Shot 2021-05-21 at 1.28.15 AM](https://onehack.st/uploads/default/optimized/3X/7/1/71e42b8a20d88aa3d9c9cc9cfaa62b9d107ff54d_2_690x35.png) What this will do is that it will download the debian package from one of the rclone’s repo branch where dropbox’s asynchronous mode was being tested(more on that later in this guide) and install it for you . We are now ready to make configs for our remotes. **Note:** If you are looking to transfer data from shared drive to shared drive, you will have to create two configs one for each shared drive and similarly if you are looking to transfer data from my drive to shared drive or vice versa you will need one remote configured with shared drive and one remote configured with my drive. Tho is almost obvious that you need both a source and destination to make transfers happen, I am just putting this out there so eliminate confusion. **2. Making config for google drive(my drive)** To begin making the configs paste the following snippet and run it `!rclone config` I will be walking you through the next steps using what I type when prompted marked with red bold, **Enter** here means I pressed the enter button No remotes found - make a new one n) New remote s) Set configuration password q) Quit config n/s/q\> **n** name\> **mydrive** > You can enter any name here, just make sure to remember it Type of storage to configure. Enter a string value. Press Enter for the default (“”). Choose a number from below, or type in your own value 1 / 1Fichier \ “fichier” 2 / Alias for an existing remote \ “alias” 3 / Amazon Drive \ “amazon cloud drive” 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Minio, and Tencent COS \ “s3” 5 / Backblaze B2 \ “b2” 6 / Box \ “box” 7 / Cache a remote \ “cache” 8 / Citrix Sharefile \ “sharefile” 9 / Compress a remote \ “compress” 10 / Dropbox \ “dropbox” 11 / Encrypt/Decrypt a remote \ “crypt” 12 / Enterprise File Fabric \ “filefabric” 13 / FTP Connection \ “ftp” 14 / Google Cloud Storage (this is not Google Drive) \ “google cloud storage” 15 / Google Drive \ “drive” 16 / Google Photos \ “google photos” 17 / Hadoop distributed file system \ “hdfs” 18 / Hubic \ “hubic” 19 / In memory object storage system. \ “memory” 20 / Jottacloud \ “jottacloud” 21 / Koofr \ “koofr” 22 / Local Disk \ “local” 23 / [Mail.ru](http://Mail.ru) Cloud \ “mailru” 24 / Mega \ “mega” 25 / Microsoft Azure Blob Storage \ “azureblob” 26 / Microsoft OneDrive \ “onedrive” 27 / OpenDrive \ “opendrive” 28 / OpenStack Swift (Rackspace Cloud Files, Memset Memstore, OVH) \ “swift” 29 / Pcloud \ “pcloud” 30 / [Put.io](http://Put.io) \ “putio” 31 / QingCloud Object Storage \ “qingstor” 32 / SSH/SFTP Connection \ “sftp” 33 / Sugarsync \ “sugarsync” 34 / Tardigrade Decentralized Cloud Storage \ “tardigrade” 35 / Transparently chunk/split large files \ “chunker” 36 / Union merges the contents of several upstream fs \ “union” 37 / Webdav \ “webdav” 38 / Yandex Disk \ “yandex” 39 / Zoho \ “zoho” 40 / http Connection \ “http” 41 / [premiumize.me](http://premiumize.me) \ “premiumizeme” 42 / seafile \ “seafile” Storage\> **15** \*\* See help for drive backend at: [https://rclone.org/drive/](https://rclone.org/drive/) \*\* Google Application Client Id Setting your own is recommended. See [https://rclone.org/drive/#making-your-own-client-id](https://rclone.org/drive/#making-your-own-client-id) for how to create your own. If you leave this blank, it will use an internal key which is low performance. Enter a string value. Press Enter for the default (“”). client\_id\> **Enter** OAuth Client Secret Leave blank normally. Enter a string value. Press Enter for the default (“”). client\_secret\> **Enter** Scope that rclone should use when requesting access from drive. Enter a string value. Press Enter for the default (“”). Choose a number from below, or type in your own value 1 / Full access all files, excluding Application Data Folder. \ “drive” 2 / Read-only access to file metadata and file contents. \ “drive.readonly” / Access to files created by rclone only. 3 | These are visible in the drive website. | File authorization is revoked when the user deauthorizes the app. \ “drive.file” / Allows read and write access to the Application Data folder. 4 | This is not visible in the drive website. \ “drive.appfolder” / Allows read-only access to file metadata but 5 | does not allow any access to read or download file content. \ “drive.metadata.readonly” scope\> **1** ID of the root folder Leave blank normally. Fill in to access “Computers” folders (see docs), or for rclone to use a non root folder as its starting point. Enter a string value. Press Enter for the default (“”). root\_folder\_id\> **Enter** Service Account Credentials JSON file path Leave blank normally. Needed only if you want use SA instead of interactive login. Leading `~` will be expanded in the file name as will environment variables such as `${RCLONE_CONFIG_DIR}`. Enter a string value. Press Enter for the default (“”). service\_account\_file\> **Enter** Edit advanced config? (y/n) y) Yes n) No (default) y/n\> **n** You will now be presented with a link, click on that, choose the account you want to access google drive of and then allow it to access, A code will be presented, copy it, close the tab, paste it in the box as shown and press enter Use auto config? - Say Y if not sure - Say N if you are working on a remote or headless machine y) Yes (default) n) No y/n\> **n** ![Screen Shot 2021-05-21 at 1.35.25 AM](https://onehack.st/uploads/default/optimized/3X/3/1/3102dadeaf6598663fd54b9d7f1bec3a67e7d462_2_690x25.png) ![Screen Shot 2021-05-21 at 1.35.36 AM](https://onehack.st/uploads/default/original/3X/9/0/900f6e5c463d45ee9e2b9cafc545a473d9d9a501.png) ![Screen Shot 2021-05-21 at 1.35.47 AM](https://onehack.st/uploads/default/original/3X/7/c/7cfe0ee6fc543fbe24829c952fb2d33d106f034f.png) ![Screen Shot 2021-05-21 at 1.36.11 AM](https://onehack.st/uploads/default/optimized/3X/7/8/785a8430078cfdb061ec7358b22f61ecb841e000_2_690x24.png) Configure this as a Shared Drive (Team Drive)? y) Yes n) No (default) y/n\> **Enter** [gdrive] type = drive scope = drive token = {“access\_token”:“HVkspMWBAWnQl6yCYO8Rci7czhG7”,“token\_type”:“Bearer”,“refresh\_token”:“1//06fFoxLSISJuoCgYIARAAGAYSNwF-L9IrVB0TKhw2KrCY-9j8z2TJQCUnzwFopYwN\_jkRomVfoESnkfeQ95Vgv32AWQ4EIdrKE6w”,“expiry”:“2021-05-21T08:55:36.76855263Z”} y) Yes this is OK (default) e) Edit this remote d) Delete this remote y/e/d\> **y** Current remotes: Name Type ==== ==== mydrive drive e) Edit existing remote n) New remote d) Delete remote r) Rename remote c) Copy remote s) Set configuration password q) Quit config e/n/d/r/c/s/q\> **q** **3.Making config for google drive(team/shared drive)** This is almost identical to making config for mydrive so I will be only covering the part which is different Follow the same steps as when making config for my drive till you are asked to configure this a shared drive Configure this as a Shared Drive (Team Drive)? y) Yes n) No (default) y/n\> **y** Fetching Shared Drive list… Choose a number from below, or type in your own value 1 / 1.Shareddrive1 \ “0AH7HM4K3zhx” 2 / 2.Shareddrive2 \ “0AKpPZPb-PKW” 3 / Shareddrive3 \ “0AM\_6yidF7ecNUk” Enter a Shared Drive ID\> **1** > Choose any shared drive you want, I am choosing one here [shared] type = drive scope = drive token = {“access\_token”:“y0RQLZLq-kNpPXmOpExAaWmFYSDKfOeH1HuSWop6QFxTGaXqDyUhKGkOx9PkdX5W\_ksNiVR1Ozk5ACeaQU-R-gl-sw6IUYmaIaGspyNFzIrRK1t2\_bqb86xcnxLlkXHHDn19QUmetA8V5mJC9xJ”,“token\_type”:“Bearer”,“refresh\_token”:“1//065HRUS41NAovCgYIARAAGAYSNwF-L9IramnrdfP2tK3pS6IQjHXf9hdxNAG6JP9xVX\_0A9xh9uqXjN6vqof2lRrbjEWDmjCnlvo”,“expiry”:“2021-05-21T09:16:03.693359275Z”} team\_drive = 0AH7HM4K3zhxdUk9PVA root\_folder\_id = y) Yes this is OK (default) e) Edit this remote d) Delete this remote y/e/d\> **y** Current remotes: Name Type ==== ==== shared drive e) Edit existing remote n) New remote d) Delete remote r) Rename remote c) Copy remote s) Set configuration password q) Quit config e/n/d/r/c/s/q\> **q** **4.Making “shared with me” visible to rclone** For this step all you need to do is to edit the advanced config, keep pressing enter till you get prompted for shared-with-me, type true/yes for it and then follow the usual instructions > This remote will be restricted to only the shared with me folder **5.Making config for dropbox(using your own app id)** So this step config can be made the easy way as well but that I wont cover because it has limitations and will require rclone to be installed on your local machine, instead we will do it little bit hard way Login to your dropbox and open developer app console from here [https://www.dropbox.com/developers/apps](https://www.dropbox.com/developers/apps) Click on create app ![Screen Shot 2021-05-21 at 2.10.40 PM](https://onehack.st/uploads/default/original/3X/e/e/eed2b7f28e363b19421754dae21f82895cdd221b.png) Fill it out like this and click on create app ![Screen Shot 2021-05-21 at 2.12.16 PM](https://onehack.st/uploads/default/original/3X/5/5/55d1b08192e04e71a548955fa5802dec05d9f299.png) Fill `Redirect URIs` as `http://localhost:53682/` and click on add ![Screen Shot 2021-05-21 at 2.16.49 PM](https://onehack.st/uploads/default/original/3X/f/5/f5de62b95750782a3db1b87e0552fca28abbaa82.png) Then go to the permissions page and change it to the following as shown and click on submit ![Screen Shot 2021-05-21 at 2.18.48 PM](https://onehack.st/uploads/default/original/3X/8/6/86bec77d32858445d33bcca3edd418fc556e85aa.png) Now go back to the settings page, click on reveal app secret and generate a token set to no expiry ![Screen Shot 2021-05-21 at 2.21.55 PM](https://onehack.st/uploads/default/original/3X/e/6/e6b9fac46d488fecf997824095df517b6db18d0f.png) We are ready to make the config, keep the app namem client secret and the token handy as you will need them in the next step Go to colab and use `!rclone config` and follow these steps No remotes found - make a new one n) New remote s) Set configuration password q) Quit config n/s/q\> **n** name\> **dropbox** Type of storage to configure. Enter a string value. Press Enter for the default (“”). Choose a number from below, or type in your own value 1 / 1Fichier \ “fichier” 2 / Alias for an existing remote \ “alias” 3 / Amazon Drive \ “amazon cloud drive” 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Minio, and Tencent COS \ “s3” 5 / Backblaze B2 \ “b2” 6 / Box \ “box” 7 / Cache a remote \ “cache” 8 / Citrix Sharefile \ “sharefile” 9 / Compress a remote \ “compress” 10 / Dropbox \ “dropbox” 11 / Encrypt/Decrypt a remote \ “crypt” 12 / Enterprise File Fabric \ “filefabric” 13 / FTP Connection \ “ftp” 14 / Google Cloud Storage (this is not Google Drive) \ “google cloud storage” 15 / Google Drive \ “drive” 16 / Google Photos \ “google photos” 17 / Hadoop distributed file system \ “hdfs” 18 / Hubic \ “hubic” 19 / In memory object storage system. \ “memory” 20 / Jottacloud \ “jottacloud” 21 / Koofr \ “koofr” 22 / Local Disk \ “local” 23 / [Mail.ru](http://Mail.ru) Cloud \ “mailru” 24 / Mega \ “mega” 25 / Microsoft Azure Blob Storage \ “azureblob” 26 / Microsoft OneDrive \ “onedrive” 27 / OpenDrive \ “opendrive” 28 / OpenStack Swift (Rackspace Cloud Files, Memset Memstore, OVH) \ “swift” 29 / Pcloud \ “pcloud” 30 / [Put.io](http://Put.io) \ “putio” 31 / QingCloud Object Storage \ “qingstor” 32 / SSH/SFTP Connection \ “sftp” 33 / Sugarsync \ “sugarsync” 34 / Tardigrade Decentralized Cloud Storage \ “tardigrade” 35 / Transparently chunk/split large files \ “chunker” 36 / Union merges the contents of several upstream fs \ “union” 37 / Webdav \ “webdav” 38 / Yandex Disk \ “yandex” 39 / Zoho \ “zoho” 40 / http Connection \ “http” 41 / [premiumize.me](http://premiumize.me) \ “premiumizeme” 42 / seafile \ “seafile” Storage\> **10** \*\* See help for dropbox backend at: [https://rclone.org/dropbox/](https://rclone.org/dropbox/) \*\* OAuth Client Id Leave blank normally. Enter a string value. Press Enter for the default (“”). client\_id\> **Enter the name of your app** OAuth Client Secret Leave blank normally. Enter a string value. Press Enter for the default (“”). client\_secret\> **Enter the client secret** Edit advanced config? (y/n) y) Yes n) No (default) y/n\> **y** OAuth Access Token as a JSON blob. Enter a string value. Press Enter for the default (“”). token\> **Paste your token here** Auth server URL. Leave blank to use the provider defaults. Enter a string value. Press Enter for the default (“”). auth\_url\> **ENTER** Token server url. Leave blank to use the provider defaults. Enter a string value. Press Enter for the default (“”). token\_url\> **ENTER** Upload chunk size. (\< 150M). Any files larger than this will be uploaded in chunks of this size. Note that chunks are buffered in memory (one at a time) so rclone can deal with retries. Setting this larger will increase the speed slightly (at most 10% for 128MB in tests) at the cost of using more memory. It can be set smaller if you are tight on memory. Enter a size with suffix k,M,G,T. Press Enter for the default (“48M”). chunk\_size\> **ENTER** Impersonate this user when using a business account. Note that if you want to use impersonate, you should make sure this flag is set when running “rclone config” as this will cause rclone to request the “members.read” scope which it won’t normally. This is needed to lookup a members email address into the internal ID that dropbox uses in the API. Using the “members.read” scope will require a Dropbox Team Admin to approve during the OAuth flow. You will have to use your own App (setting your own client\_id and client\_secret) to use this option as currently rclone’s default set of permissions doesn’t include “members.read”. This can be added once v1.55 or later is in use everywhere. Enter a string value. Press Enter for the default (“”). impersonate\> Instructs rclone to work on individual shared files. In this mode rclone’s features are extremely limited - only list (ls, lsl, etc.) operations and read operations (e.g. downloading) are supported in this mode. All other operations will be disabled. Enter a boolean value (true or false). Press Enter for the default (“false”). shared\_files\> Instructs rclone to work on shared folders. When this flag is used with no path only the List operation is supported and all available shared folders will be listed. If you specify a path the first part will be interpreted as the name of shared folder. Rclone will then try to mount this shared to the root namespace. On success shared folder rclone proceeds normally. The shared folder is now pretty much a normal folder and all normal operations are supported. Note that we don’t unmount the shared folder afterwards so the –dropbox-shared-folders can be omitted after the first use of a particular shared folder. Enter a boolean value (true or false). Press Enter for the default (“false”). shared\_folders\> **ENTER** Upload file batching sync|async|off. This sets the batch mode used by rclone. For full info see [the main docs](https://rclone.org/dropbox/#batch-mode) This has 3 possible values - off - no batching - sync - batch uploads and check completion (default) - async - batch upload and don’t check completion Rclone will close any outstanding batches when it exits which may make a delay on quit. Enter a string value. Press Enter for the default (“sync”). batch\_mode\> **ENTER** Max number of files in upload batch. This sets the batch size of files to upload. It has to be less than 1000. By default this is 0 which means rclone which calculate the batch size depending on the setting of batch\_mode. - batch\_mode: async - default batch\_size is 100 - batch\_mode: sync - default batch\_size is the same as --transfers - batch\_mode: off - not in use Rclone will close any outstanding batches when it exits which may make a delay on quit. Setting this is a great idea if you are uploading lots of small files as it will make them a lot quicker. You can use --transfers 32 to maximise throughput. Enter a signed integer. Press Enter for the default (“0”). batch\_size\> **ENTER** Max time to allow an idle upload batch before uploading If an upload batch is idle for more than this long then it will be uploaded. The default for this is 0 which means rclone will choose a sensible default based on the batch\_mode in use. - batch\_mode: async - default batch\_timeout is 500ms - batch\_mode: sync - default batch\_timeout is 10s - batch\_mode: off - not in use Enter a duration s,m,h,d,w,M,y. Press Enter for the default (“0s”). batch\_timeout\> **ENTER** This sets the encoding for the backend. See: the [encoding section in the overview](https://onehack.st/overview/#encoding) for more info. Enter a encoder.MultiEncoder value. Press Enter for the default (“Slash,BackSlash,Del,RightSpace,InvalidUtf8,Dot”). encoding\> **ENTER** Remote config Already have a token - refresh? y) Yes (default) n) No y/n\> **n** [dropbox] type = dropbox client\_id = redacted client\_secret =redacted token =redactedlol8OT28QtDHhEdYnl4JfH-cVYg-kZ8Bhxkj2Xk8MKJ0 y) Yes this is OK (default) e) Edit this remote d) Delete this remote y/e/d\> **y** Current remotes: Name Type ==== ==== dropbox dropbox e) Edit existing remote n) New remote d) Delete remote r) Rename remote c) Copy remote s) Set configuration password q) Quit config e/n/d/r/c/s/q\> **q** Your dropbox config is now ready to be used and we made it in a way rclone recommends **6.Testing out the configs** This is by far the most simple step, you can type either of these to test your configs out `!rclone lsd remote:` here the word remote means the name you used for your config, say you want to test out the mydrive config and you named it mydrive, the following will list all the directories inside your mydrive > !rclone lsd mydrive: Similarly other linux commands like ls and size can be used instead of lsd say you want to check the size of any folder in your cloud drive, use !rclone size “remote:pathtofolder” I recommend that you use quotes like shown in the above example because it tackles the problem of having space in directory name, so from here on I will be using it only 😁 **7.Making a test transfer to see if everything will go all right(–dry-run)** So finally we will make a test run of transferring files from one cloud to another the syntax will be using either of the two depending on what you need, Use move if you want to ‘cut’ and copy for ‘copying’, And as I said, this will only do a test run and no actual copying will take place, Significance of this step will be made clear in a while The syntax to test the copying is `rclone copy "remote1:pathofthefolder" "remote2:pathofthefolder" --dry-run` This will imitate the following:copy contents of remote 1 in the specified path(if specified that is) to the specified folder in remote 2 You will get as output the list of files that will be transferred if the copying actually takes place For the majority of the people this will be it, just remove the --dry-run arg and it will copy for real, do read the next contents if you want to optimize this transfer and make it faster **8.Using rclone’s copy command to sync things up** The copy command mentioned above will start everything over, but that usually isnt the case when taking backups and hence that command alone isnt optimal for synchronizing folders as it will waste time copying the files over which are already there, to solve this problem we use the --update arg `rclone copy "remote1:pathofthefolder" "remote2:pathofthefolder" --update` This command will only copy over the stuff from specified path in remote 1 to specified path in remote 2 which arent already present, Now is the time for the --dry-run arg to shine!, you can team it up with the --update arg to see what new files will be copied when you try to sync the folders using `rclone copy "remote1:pathofthefolder" "remote2:pathofthefolder" --update --dry-run` **9.Speeding up the transfer using args** For those who dont know colab has a upload speed of 1Gigagbits per second and to make the most out of it we need to optimize the rclone transfers, Lets start with the basics Using --transfers and --checkers The transfers arg is self explanatory, it will tell rclone how many transfers to do at once, I think the default is set to 4, in some of the clouds you can amp this number up to 700! and make things go super fast. The checkers args is often combined with the transfers arg, it just tells rclone how many directories to work with at once, I personally like to keep the number of checkers to 1/4th of that of transfers but there is no hard and fast rule, you know the number of files and the directory structure of files you are dealing with so set it appropriately syntax is as follows `rclone copy "remote1:pathofthefolder" "remote2:pathofthefolder" --update --transfers=a --checkers=b` Just change a and b to the number you think will be the most suitable, if not sure and just want to see what happens, set ‘a’ to 16 and ‘b’ to 4 and try optimizing from there on. Now lets suppose you are dealing with a very huge number of files and that is crippling your transfers, the best way to tackle this problem is to use the --fast-list arg Note: The --fast-list arg will take up a lot of ram, tho on colab until and unless you are being crazy you wont run into any problem as 12GB RAM is provided for use, but still keep this fact in mind, if you run into ram overload problems, try lowering the transfers and checkers before removing the fastlist arg Also suppose you are to move data within google to google drive(be it mydrive/sharedwithme/team) using `--drive-server-side-across-configs=true` can speed things up as well, somtimes drastically Now lets suppose you arent moving large volume of small files, instead you are moving large files itself. To make things fast here use the --drive-chunk-size=nM arg Here n needs to be a number which is power of two, This step also consumes ram like a hog, so be cautious, for files over 1GB, just use --drive-chunk-size=128M and it will be fine. If using dropbox, then use the --dropbox-chunk-size=nM instead Also coming to dropbox and why I made you all install a specific beta version of rclone is the fact that this particular package has the async mode! Which is far far better when it comes to copying a large volume of small files, to use it just use the following arg `--dropbox-batch-mode async` if dealing with a large volume of small files and if possible please use dropbox instead because of the drive limitations discussed below **10.Experimental flags for google drive and rclone** So the biggest limitation with google drive is the fact that it can only commit 2 files a second which is super slow at times and this limitation will sometimes be the bottleneck, best way to avoid this problem is to obviously just use a zip archive of all the text files, the other way is a workaround which pushed the number of files committed to around 3.5 a second, to do so just use the following args `–tpslimit=60 -vv --drive-pacer-min-sleep=60ms` well the args here are super experimental and might even cause you getting rate limited and hence might do more harm then good, I wont explain the tpslimit and drive-pacer-min-sleep arg but what the -vv one does is that it will run two instances of rclone at once and try syncing that up. So yeah sometimes it might work but it is bound to break, I dont recommend using anything mentioned in section 10, just wanted to put it out there So yeah thanks to everyone for reading, feel free to ask questions below in the comment section ---
**Author:** ![waseemsofficial](https://onehack.st/user_avatar/onehack.st/waseemsofficial/32/80734_2.png) [@waseemsofficial](https://onehack.st/u/waseemsofficial)\ **Post date:** [May 21, 2021, 10:41am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/2 "2021-05-21T10:41:03Z")
Awesome, great explanation , well I shall give it a try, if possible make pdf please and share. ---
**Author:** ![chaku](https://onehack.st/user_avatar/onehack.st/chaku/32/87908_2.png) [@chaku](https://onehack.st/u/chaku)\ **Post date:** [May 21, 2021, 10:45am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/3 "2021-05-21T10:45:44Z")
I will try making a pdf of this if you want tho it will most be images converted to pdf rather than the text cuz that will be much simpler for me to do, And yeah thanks for giving it a read, feel free to ask if you have any problems/queries ---
**Author:** ![DementedZandra](https://onehack.st/user_avatar/onehack.st/dementedzandra/32/87704_2.png) [@DementedZandra](https://onehack.st/u/DementedZandra)\ **Post date:** [May 21, 2021, 11:35am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/4 "2021-05-21T11:35:55Z")
Very nice and detailed. Perhaps an idea you can do is to create a youtube guide from it 😃 ---
**Author:** ![chaku](https://onehack.st/user_avatar/onehack.st/chaku/32/87908_2.png) [@chaku](https://onehack.st/u/chaku)\ **Post date:** [May 21, 2021, 11:42am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/5 "2021-05-21T11:42:50Z")
I made a video version but that too people have to pause and watch at times to be sure that are entering right stuff in the prompts. Trust me for rclone nothing will beat a text guide. ---
**Author:** ![Roberto\_Diaz](https://onehack.st/user_avatar/onehack.st/roberto_diaz/32/18084_2.png) [@Roberto\_Diaz](https://onehack.st/u/Roberto_Diaz)\ **Post date:** [May 21, 2021, 12:58pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/6 "2021-05-21T12:58:15Z")
Hi @chaku Thank you very much for sharing this guide with us Regards ---
**Author:** ![rahulmasal](https://onehack.st/user_avatar/onehack.st/rahulmasal/32/172379_2.png) [@rahulmasal](https://onehack.st/u/rahulmasal)\ **Post date:** [May 21, 2021, 1:00pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/7 "2021-05-21T13:00:54Z")
thanks 😄@chaku ---
**Author:** ![Havok](https://onehack.st/user_avatar/onehack.st/havok/32/48191_2.png) [@Havok](https://onehack.st/u/Havok)\ **Post date:** [May 21, 2021, 1:57pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/8 "2021-05-21T13:57:21Z")
If you are not familiar with cli, u can use rclone browser to perform copy/move/sync or any other functions via clean ui. Or u can use rclone web gui too. ---
**Author:** ![Jay\_Patel](https://onehack.st/user_avatar/onehack.st/jay_patel/32/15813_2.png) [@Jay\_Patel](https://onehack.st/u/Jay_Patel)\ **Post date:** [May 21, 2021, 2:42pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/9 "2021-05-21T14:42:56Z")
Here you can download pdf for the above guide [article.pdf](https://onehack.st/uploads/short-url/go7aJYa5euh1RXKUTh8IOxqFFpH.pdf) (418.2 KB) Nice article @chaku ---
**Author:** ![chaku](https://onehack.st/user_avatar/onehack.st/chaku/32/87908_2.png) [@chaku](https://onehack.st/u/chaku)\ **Post date:** [May 21, 2021, 3:09pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/10 "2021-05-21T15:09:41Z")
Thanks Jay, more coming soon, Next will be on downloading from indexer which is protected with username and password via opendirectoryindexer and use of wget inside colab ---
**Author:** ![moaxs1](https://onehack.st/user_avatar/onehack.st/moaxs1/32/145979_2.png) [@moaxs1](https://onehack.st/u/moaxs1)\ **Post date:** [May 22, 2021, 6:44am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/11 "2021-05-22T06:44:55Z")
Using rclone can i bypass 5GB daily download limit. (Copying mega to gdrive) And thanks for the tutorial @chaku ---
**Author:** ![chaku](https://onehack.st/user_avatar/onehack.st/chaku/32/87908_2.png) [@chaku](https://onehack.st/u/chaku)\ **Post date:** [May 22, 2021, 7:11am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/12 "2021-05-22T07:11:29Z")
Unfortunately you cant, The daay google colab allows the use of proxy inside it, something can be done maybe ---
**Author:** ![dillu\_dada](https://onehack.st/user_avatar/onehack.st/dillu_dada/32/26385_2.png) [@dillu\_dada](https://onehack.st/u/dillu_dada)\ **Post date:** [May 22, 2021, 8:31am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/13 "2021-05-22T08:31:17Z")
/bin/bash: rclone: command not found i get this when i run !rclone config ---
**Author:** ![rahulmasal](https://onehack.st/user_avatar/onehack.st/rahulmasal/32/172379_2.png) [@rahulmasal](https://onehack.st/u/rahulmasal)\ **Post date:** [May 22, 2021, 9:36am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/14 "2021-05-22T09:36:32Z")
Hey @chaku please tell me daily copy limit of rclone??? i want to transfer shared drive to shared drive ! ---
**Author:** ![chaku](https://onehack.st/user_avatar/onehack.st/chaku/32/87908_2.png) [@chaku](https://onehack.st/u/chaku)\ **Post date:** [May 22, 2021, 9:38am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/15 "2021-05-22T09:38:01Z")
you probably didnt install ig ---
**Author:** ![rahulmasal](https://onehack.st/user_avatar/onehack.st/rahulmasal/32/172379_2.png) [@rahulmasal](https://onehack.st/u/rahulmasal)\ **Post date:** [May 22, 2021, 10:44am UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/16 "2021-05-22T10:44:24Z")
maybe 750gb limit for every account! ---
**Author:** ![ayomite](https://onehack.st/user_avatar/onehack.st/ayomite/32/39670_2.png) [@ayomite](https://onehack.st/u/ayomite)\ **Post date:** [May 22, 2021, 12:01pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/19 "2021-05-22T12:01:10Z")
Thanks in advance, we will surely give feedback, pls make it newbie friendly ---
**Author:** ![Jason\_hooda](https://onehack.st/user_avatar/onehack.st/jason_hooda/32/75978_2.png) [@Jason\_hooda](https://onehack.st/u/Jason_hooda)\ **Post date:** [May 22, 2021, 2:13pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/20 "2021-05-22T14:13:31Z")
Sir can you please also include how to make mega config file I’m getting errors while mounting mega in the colab😅 ---
**Author:** ![Kawsar\_Mahmud](https://onehack.st/user_avatar/onehack.st/kawsar_mahmud/32/77052_2.png) [@Kawsar\_Mahmud](https://onehack.st/u/Kawsar_Mahmud)\ **Post date:** [May 22, 2021, 6:42pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/22 "2021-05-22T18:42:47Z")
Hey UC brother, you’re post is at the top. Thanks for sharing. ---
**Author:** ![vishalkaushik](https://onehack.st/user_avatar/onehack.st/vishalkaushik/32/88209_2.png) [@vishalkaushik](https://onehack.st/u/vishalkaushik)\ **Post date:** [May 22, 2021, 7:19pm UTC](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603/23 "2021-05-22T19:19:05Z")
All these codes become unusable as Google has made its colab having limited resource now. So as soon as a little time passes by colab now a days get disconnected. And the reconnection removes all configuration. Afterwards it keeps disconnecting more frequently. Surprisingly It’s not even completing a 12 GB download using colab. Please suggest some real solution. [Next page](https://onehack.st/t/comprehensive-guide-move-files-folders-from-one-cloud-to-another-rclone-colab/184603.md?page=2)