Linode + S3 backup? – Idle musings
this article on the Linode WikiAmazon S3
Now I'm wondering; Could I use this bucket [in its guise as a volume on my Linode] as a destination for backing up my laptop at home? I'm thinking something along the lines of a cron job using rsync [or similar] to ssh into my linode and make an incremental backup to the mounted S3 volume. As I said, I'm a bit vague on some of the nitty-gritty details and security implications, so any thoughts gratefully received. Here are some of the issues I'm thinking about so far:
1: Security: How secure is the mounted S3 volume from outside access? The wiki article instructions mount it as root and it's outside the obvious publically accessible parts of my Linode, but I'm not quite clear on how easy it would be for some ne'er-do-well to access such a mounted volume on my Linode
2: Sync'ing: I've not used rsync before and my reading is turning up contradictory opinions as to its suitability for this kind of backup; some people claiming that rsync cannot do block-level synchronisation, if the backup is encrypted [which obviously it would have to be] and other people claiming it can
3: Speed: I'm presuming there would be a performance hit, given that any such backup would be sending data from my laptop to my Linode, which would then in turn be sending that data onto S3. The question is, would the convenience of having an S3 bucket mounted as a 'regular' volume, rather than having to deal with Amazon's proprietory API and data format outweigh the inconvenience of the slower access?
4: Bandwidth: Piping everything to S3 via my Linode will obviously involve using a fairly huge chunk of bandwidth for the first backup but, assuming some block-level sync'ing mechanism can be put in place, subsequent backups shouldn't be too hungry, should they?
I'm currently using Jungle DiskSparkleSharemono
Any thoughts?_
4 Replies
I personally use duplicity
this page
@hoopycat:
Remember, you can reach your bucket from home, too. No need to pipe stuff through your Linode…
True. I use expandrive[url=https://code.google.com/p/macfuse]macfuse
I guess I just got a bit carried away with the excitement of having grafted potentially infinite storage onto my Linode via S3fs and was looking round for something to use it for!
Fortunately, it handles that for you, and reads from S3 are pretty spry. And one good thing about tar under the hood: if all else fails, you can probably get at your data using gpg and tar.
To be honest, I don't generally think too much about it. It just works, it can do an incremental off-site backup of a Linode with 18 GB of stuff in about 10 minutes, and I can easily do single-file restores. It is part of a complete backup strategy, alongside the Linode Backup Service.