My Backup Strategy

I recently read an article entitled Mac Software for Advanced OS X Users over at AppStorm, and one of the tools it tipped me off to was SMARTReporter. SMART stands for “Self-Monitoring, Analysis, and Reporting Technology”, and it is a monitoring technology built into most hard disks. SMARTReporter asks the drive for it’s status every once in awhile, and if there is trouble, it alerts you. This seemed like a good idea, so I installed it. Just a few weeks later, SMARTReporter began notifying me that OS X was reporting I/O Errors with the drive. Soon after the first few warnings the computer started hanging. I quickly attached one of my external backup drives, and while it took some time, I was able to update the backup to include any files that had changed since my last backup.

I took the computer to the Apple Store and while they were ready to replace the drive under warranty immediately, I had a non-standard drive. When I ordered my Macbook I chose the 7200RPM disk, which isn’t typically carried in the physical Apple Stores. They ordered the disk, and the next day they called me back to say it had arrived and to schedule a time to bring the machine in to have it replaced. They replaced the drive in about 20 minutes, and when I got home I hooked up that aforementioned backup drive and had my computer restored to normal in no time.

Now this entire ordeal was annoying, but I never truly got angry. The truth is that my fairly regimented backup strategy gave me the confidence to know that there was almost no chance of me losing any data. In fact, in the 24 hours between my visits to the Apple Store, I was able to continue to use my laptop by booting off of that Firewire Backup disk. I honestly didn’t expect the replacement to arrive in 24 hours, so I even went a bit overboard and MacGyver’ed a method of keeping my laptop portable while using the external disk.

In a few conversations I’ve had since all of this happened, some questions have come up about my backup methods, so I figured I would write them up here.

I love my MacBook Pro, but at the end of the day it is just a hunk of hardware that will go bad at some point. The data stored on that computer is much more valuable (to me) than the hardware itself. My computer contains email archives going back to the early 90s, photos going back even further, all of my music, documents, writing, code, and more. Preventing the loss of this data is worth a bit of hassle, but I promise you that my methodology is only a bit of hassle. In practice it isn’t anywhere near as painful as it seems. I start with the low-hanging fruit and then get into the more involved practices. The most important thing to take away from this is that no backup method is 100% reliable, so make sure you choose more than one way to backup your files.

  1. The first line of my defense is Dropbox, which is where my “Documents” folder lives. Dropbox gives every user a free 2GB virtual disk that lives “in the cloud” (in other words, online). The Dropbox application which runs on your computer ensures that a copy of that virtual disk is also in a directory on your computer. If you add, modify or delete a file in the Dropbox folder on your computer, it will (almost) instantly be copied up to “the cloud”. If you are offline and modify files on your computer, the next time you are online it will copy any changes up. Furthermore, you can run Dropbox on multiple computers and it will keep all of them in sync. Want to get at your documents at work? Easy. This is one of those brain-dead simple tools that can be a lifesaver.
  2. The next step is Apple-specific. Apple’s Time Machine is backup for everyone. It requires almost no configuration and can totally save your bacon. In a default configuration, you pick an external hard disk to use, and every time you connect it it will backup your computer automatically. If you leave that external hard disk connected all the time (as in the case of a desktop computer) then Time Machine will perform a backup every hour. One great side effect of this is that it keeps old versions of files it has backed up around, so if you accidentally deleted a file yesterday, or made a change which you want to “undo”, you can grab the file from last week’s backup. They have made the configuration so simple that the act of simply attaching an external disk to your computer is enough; Mac OS will ask you if you want to use it with Time Machine. If you are a 100% laptop user like me, you may want to invest in Apple’s Time Capsule, which is a network device which Time Machine can backup to over the network, freeing you from having to connect disks to your computer. As a bonus it is a Wireless-N router, so you can kill a few birds with one stone.
  3. As if Time Machine and Dropbox got mashed together, BackBlaze [referral link] backs up your hard disk to that pesky “cloud”. The service costs $50 a year, but for that you get a complete, off-site online backup of your computer. That first backup takes several days, but it just plugs along in the background and you will most likely not even notice it is working. Once it is all backed up, it will copy updated or changed files up to their servers on the fly to keep your backup current. Note the emphasized words back there, off-site. In the event of a real disaster (fire, flood, robbery or the like), any number of backups at your home might be destroyed. That is why paying for one of these services is worth it. BackBlaze has several competitors (Carbonite and Mozy, among others), so take some time and figure out which one works best for you. Note that BackBlaze won’t back up any files bigger than 9GB. This is much bigger than only the largest video files, but it is good to note. (Update [20120331]: BackBlaze has removed the limitation on file size, though it is still restricted by default. You can easily change the default in the BackBlaze preferences panel)
  4. One of the things that NONE of these previous methods will get you is a way to get RIGHT back on your feet after a hard disk crash. If you want that you are going to need to keep a live copy of your hard disk, and the best way to do that (on a Mac) is with Carbon Copy Cloner (which is “donation-ware”, meaning it is free but the developer could use your support). Get (another) external hard disk, particularly one that your computer can boot from (on most Mac’s this means a FireWire drive, but check to make sure). Then use Carbon Copy Cloner to create a clone of your computers hard disk onto this external disk. Once you’ve done this, try and boot your computer off of this external drive. If you were successful, your computer should boot and look exactly the same as it normally does (although the external drives are often much slower, so everything may take a bit longer). Repeat this ‘cloning’ on a regular basis so if the hard disk dies in your computer you have a quick way to get back on your feet. I have a calendar alarm every Saturday morning to remind me to connect my clone drive.
    1. Advanced Tip: If you want to make life a bit easier on yourself, investigate CCC’s “Scheduled Tasks” functionality. You can cause a clone to happen automatically when you connect your external clone drive, and you can also cause it to only clone what has changed since your last clone (which should cause the clone to take much less time).
    2. Extra Credit: Once you get a CCC workflow that works for you, you may wish to consider duplicating your efforts with a second clone drive, and keep that second clone drive off site. Keep it at your desk at work or even at a trusted friend’s house. I personally keep my second drive in a safe deposit box at my bank. So I am not going to the bank every week, I keep one clone drive at home, and I clone to it every Saturday. Then once a month or so, I go to the bank and swap the clone drives. This way I have a clone that is no more than a week old at home, and one that is no more than a month old off site.

That all looks complicated, but really only the 4th level requires any “manual” intervention. Once Dropbox, Time Machine and BackBlaze are all set up, they don’t really require any work on your part. And for those first three methods, the initial setup is really easy, even for the novice.

Please don’t let the apparent complexity of #4 scare you off easily, because having a clone to boot from can be a life-saver. Because of this cloned drive, when the hard disk in my Mac started to fail last week, I simply ran CCC to update the clone before the drive completely died, then I rebooted my machine off the clone and was back to the races. I then ran off of this backup until Apple got the replacement drive in, and when I got home from Apple I just used CCC to clone that external drive back onto the new disk from Apple. Given that it only took Apple 24 hours to receive the replacement drive, this might seem like a bit of overkill, but what if it had been a few days? Or a week? I added #4 to my regimen after my last drive failure, I was out of commission for a few days because I didn’t have a clone to boot from.

The key thing to remember, especially about methods 2-4, is that unless you configure them otherwise, they will backup every file on your system. Even files that you might not think are important will get backed up. To me, this is a key feature of good backup strategy. Unimportant files have a notorious way of becoming really important the moment after a hard disk crash. Any backup method which requires you to manually select or copy files yourself is doomed to failure.

Nerdy Security Discussion

Ok, I’ve been having a debate in my head for about a week now, and so I figured I’d open it up for discussion:

Right now, I have three classifications of passwords:

  • "Secure" – A memorable, yet obscure base (would look random to most people) with host-specific unique data inserted within (via a mental hash function)
  • "Screen-door lock" – a simple mixed case alphanumeric password I reuse across multiple hosts.  This is for hosts (typically, random Web sites) where it would be mildly irritating if someone had access to my account…
  • "Who cares" – This is for the hosts that I don’t care about yet require me to input a password.  It is a completely insecure, throwaway password.  It could probably be brute-forced in about 30 seconds.

I began thinking about whether or not it would be ultimately more secure to have one classification of password (really secure, pseudo random noise) and store those passwords in a single, encrypted password store behind a single "secure" password.  This store would obviously be very backed up and treated as other personal data.  

Clearly, this is a single point of failure, so if someone compromises my password store, everything is compromised.  On the other hand, each individual password would be far less guessable…  

Opinions?



Futile attempt to recover my Powerbook disk

Out of the blue last night my laptop’s hard disk died… The machine locked up, I hard rebooted it, but it hung on the Apple logo… I booted it up with my 10.4 system disk and tried to use Disk Utility to repair the disk, but that said it couldn’t fix the problem.. I tried (as you can see in this photo) TechTool Deluxe to try and repair the volume, but that also couldn’t fix things…

I finally decided to try and reformat the disk, but when that didn’t work, I realized the drives number was pulled… Fortunately I have Applecare and I backed up the disk on Thursday… =)

Lewk is a Feeb

Let’s take a moment to thank , who managed to send a million message undeliverable notifications today; one for each message he has saved in the past year or so (to the author of said message). I alone got 100+!

In other news, the Nintendo DS Zelda game looks badass.

Retreat

Land of the Dead was great, although as predicted the Sunday Night Film Club turnout was small (but I don’t really care). As is common in zombie flicks, the (living) characters had retreated to a fortified position, as have I. As the weather has gotten unbearably hot I have retreated to our air-conditioned bedroom. And my love for my Powerbook grows.

I have used command-line mailers for as long as I’ve had internet email. Originally, elm on my Unix UUCP account on Dan’s Domain (hoser@gen.ds.nj.us) through pine then mutt at CSH, I have been a loyal command-line user (although I did have a minor dalliance with Mail-It! while using BeOS). I played around with graphical mailers while convalescing, but had all kinds of trouble dealing with my 500+ mailboxes over IMAP, so I threw in the towel. I finally decided to move my mail archive off of CSH’s servers and onto my laptop, and have been using OSX’s Mail.app as my mailer for a few weeks now. So far, so good, and searching my mail with Spotlight is very, very nice. I tried Thunderbird back with my failed IMAP experiment, and while I fully support the Mozilla project, I think I’ll wait for it to get a bit of polish before I revisit it. Anyway, I had started to feel that the only reason I was sticking with CLI email was geek pride, and that I was just being stubborn. Seeing all the niceties you kids and your GUI mailers have had for god-knows how long now I think I was correct in that assessment.

Post Trauma

Well, that was definately a difficult exam…. I am not sure how I did; Some questions were not that bad, while others I simply couldn’t answer. This guy doesn’t grade on a typical scale, so I guess I will have to wait until I get the exam back to even guess what letter grade I got.

Packing, Packing, Packing
I always overpack. Tomorrow I am heading out to California, to tour the Bay Area/Silicon Valley. I will be staying with Chris while I am out there, and I will be meeting up with Scot Hacker, Dave Bort (and his place of employment, Be, Inc.), Chuck Lapp (who is working for Crystal Dynamics currently), and Pink-Haired Kate. It will be wonderful seeing Kate and Chuck, because I haven’t seen either of them in a few years. And although I have seen Bort recently, It will be good to see what he is doing over at Be (which, as you can imagine, is exciting for me… *l*)

It is always good to see old friends, and in the case of Scot, I will be meeting him in person for the first time. For those of you who may not know, Scot is the author of the BeOS Bible, MP3: The Definitive Guide, and is also one of the editors that works with me over at BeNews. I have talked with Scot in one capacity or another for many years now, but we have never met face to face…

This whole internet thing is so odd… Sometimes I don’t understand how society continues to function with it, and other times I can’t imagine life without it… Computers have always been a part of my life.. Some of my first memories are my father taking me to a junior programming class at the local high-school. I can’t remember how old I was at the time, but to give you some perspective, I was writing BASIC on a Commodore PET loading its software off a cassette drive. Sometime after that my grandparents bought me a Commodore 64, and later my father bought a modem. I would say that I wasn’t past 4th grade by the time I dialed a BBS… So e-mail, programming, all this data, is all so familiar to me. I don’t say that to show off (or compensate for a ‘lack’ of something :P), but I am just trying to create perspective.. I take it all for granted, completely, and that really frightens me at times… Sometimes I look at an iMac and see a ugly, green machine for idiots; Other times I see it for what it is: The perfect machine for beginners running an OS that, while frustrating many advanced users, is perfect for people who have never looked at a computer before.

Anyway, back to the point, I am really looking forward to seeing all these people, but I guess there is special excitement for me in meeting Scot. I guess there is something special about a face-to-face meeting, and that is something that computers will be hard-pressed to replace….. Thankfully… :)