Skip to main content

Sync files from remote system via command line - Linux, Ubuntu, Debian

If you are using more than one laptop/computers in your day to day life for eg: Your personal laptop and Office laptop. Chances of needing a file from one laptop on the other laptop is very common. We don't want to copy the files over the system again and again. We just want the changes to the files made in one system to reflect on the other system.

In this post we will see a simple way to keep files in sync between your multiple laptops/computers. Linux has an wonderful utility called rsync which can be used to sync files/folders between systems in a very optimised way (copy only modified and new files/folders)
If you don't have rsync utility installed on your system, install it by
$ sudo apt-get update
$ sudo apt-get install rsync
Also we are planning to sync files from remote systems, So lets have the openssh-server installed on the both machines
$ sudo apt-get install openssh-server
openssh-client will be by default installed on linux machines, if not install it
$ sudo apt-get install openssh-client

Basic Usage of rsync

$ rsync source destination
The above command will simply send/sync all the files recursively under the directory 'source' to the 'destination'
To send/sync files to a remote systems
$ rsync source username@host:destination
Note: "username@host:"  will point to home directory of username in the host (Please note the colon (:) at the end of hostname)
With some more options from rsync we can create a single line file syncronizer as follows
$ rsync -avzP username@host:source destination
Options used:
-a     - archive mode
-v     - increase verbosity
-P     - To see the file transfer progress with its speed
-z     - compress file data during transfer
         Use this option so that you can utilise your network bandwidth efficiently
Note: I have changed the username@host term to the source option to intimate that remote host can be either source or destination.

Skip Some files from Sync/Copy

$ rsync -avzP --exclude "*.conf" username@host:source destination
--exclude option will exclude the specified file(s) syncing from source to destination. You can give a file name, Directory name or even file globs like (*.something)

To skip more files

Enter your list of files to be skipped/excluded in a text file and use that in rsync with  --exclude-from option
# File exclude-list.txt
*.conf
bin
blib
Now pass this file name to --exclude-from option
$ rsync -avzP --exclude-from exclude-list.txt username@host:source destination

Some more options to make it more finer tool

Sometimes we might have just changed the permissions/groups for a file/folder but we don't want to reflect that change on the other machine.
$ rsync -avzP --no-group --no-perms --no-owner username@host:source destination
You can create an alias of the above command and make life even more easier. rsync utility has many other options available please do check manual of rsync for more options (man rsync).

Comments

Popular posts from this blog

Git and Github useful commands

Working on a personal forked repository Most of the time when you are working in an organisation who uses git, you will be requested to fork the project and create pull for your feature or bug fixes (Most of the open source contribution in git will be happening like this).

In this note I will let you know some useful git commands which will be very helpful for you in your day to day life with git. I am not going to explain any git technical terms. I am assuming you already know about it or all those terms are linked to a proper source for more information.
Lets start. You can fork any github project by clicking the fork icon on the top right of a repository.  git clone git@github.com:<your-github-id>/Project.git - to clone your forked Project (personal repo)cd Project/ - get into your repositorygit fetch origin - will fetch all the details/indexes (branches and commits) from remote origin but will not apply.git branch - is used to check all the available branches and current work…

Make use of JavaScript console methods

When I say JavaScript console methods, the one and only thing that hit most of our mind is console.log() and we use it a lot and only that some might be familiar with error() and debug(). Did you ever think of checking if there are any other methods available in console other than log? Most of us don't do that, but knowing those methods might have saved lot of our development time. In this post I will show you some of the console methods which will be very useful in our day to day coding.
Log based on conditionconsole.assert(assertion, log_message); To print something on the console only if the assertion failed - assertion can be any expression which returns a boolean.
Note: In chrome this log will print as an error with message saying "Assertion failed:" with the log_message passed. In FireFox its a normal log message.
Log number of occurrence console.count([label]); If we want to count something, it may be a click, may be a callback, or event triggers. We don't …

My First Post

After lot of thinking and research me too started a blog finally to share my knowledge :-).

Not everybody know everything but also everybody else don't know what we know. So lets share and gain knowledge with Win Win approach.