I just found out that the datahoarders are now abusing Google's GSuite Business, which has a bug (currently). It's supposed to be 1 TB per user, at $10 per user per month, until you reach 5 users ($50 per month) after which it switches all users to unlimited. But instead, GSuite is bugged out and gives even a single user unlimited. So they're paying $10 per month for unlimited storage and now they're doing a mass exodus from Amazon Cloud Drive to GSuite's bugged system. Which means, there's no point jumping on that bandwagon because they're going to force Google to fix their bug. Sigh. And then it will be $50/month for unlimited at GSuite, as intended.
https://www.reddit.com/r/DataHoarder/comments/5b79w7/is_the_gsuite_business_1tb_limit_enforced/
----
I also looked at other providers, like Jottacloud in norway, which is unlimited for about $8 a month and is super fast. But it turned out that they intentionally have not given 3rd party API write-access, since they want to avoid people abusing the service.
----
But here's where it gets interesting... Arq is adding support for Backblaze B2, which is the general-purpose storage cloud by the Backblaze backup provider:
https://twitter.com/arqbackup/status/871720559838711811
June 5, 2017, they wrote: "If you’d like to help with beta-testing B2 support in Arq, please send email to
support@arqbackup.com. Thanks in advance!"
B2 is charging $0.005 per GB per month. And $0.02 per GB downloaded. And they provide instant downloads (no waiting times).
So storing my current 850 GB would be just $4.25 there (as opposed to $4.99 at Amazon Cloud Drive).
And if I hit, let's say 1200 GB, it would be just $6 there since I pay per GB (as opposed to 2x$4.99 (two x 1 TB plan) = $9.98 at Amazon Cloud Drive).
The problem is if I need to restore something. Let's say my main system drive crashes. The restore of ~250 GB (my entire user-folder) would cost $5. Or if I need to restore my entire sample library collection of ~500 GB it would cost ~$10.
But this is really making me think... Why am I storing backups online? The answer is that I am doing it in case ALL of my drives crash, are stolen in a burglary, destroyed in a fire, etc.
I asked myself: When have I ever restored any files? The answer is: Maybe one tiny 50 MB document a month (which would cost $0.001 to restore via B2)! And most of the time, I only used Arq for that because it was faster than waiting for my Time Capsule to wake up.
----
Time to do some math:
- My current backup system: Arq + Amazon Cloud Drive Unlimited for online backups. An Apple Time Capsule 2 TB for local backups (which will give me a bootable system if I ever need to restore from it). And 2x 2 TB hard disks in RAID-1 for sample library installer backups.
- How safe is my current system?
- Well, let's say my Time Capsule drive dies? Then I just put a new drive in my Time Capsule. My computer keeps working.
- Let's say 1 of the two sample backup drives die? Then I have another. I just get another drive and duplicate the data to the new drive.
- No matter how I look at this, I pretty much never need to restore data. But I want the ability to do it without it costing HUNDREDS OF DOLLARS (a la Amazon Glacier).
----
So okay, let's compare the online storages available, and let's say my data storage needs are 1200 GB (I am SURE I'll reach that when I add the second computer). But I'll also do some math for ~600 GB because I can probably shrink my needs a bit, if I stop backing up my home-user folder's huge sample library folder (I can just reinstall those from my sample library drives or the backups of the installers).
Amazon Cloud Drive:
- Storage Cost (1200 GB): $4.99 (1 TB) * 2 per month = $9.98 per month.
- Retrieval Cost (1200 GB): Free. Instant access without waiting.
- Yearly Cost (1200 GB): $119.76.
- Storage Cost (600 GB): $4.99 (1 TB) * 1 per month = $4.99 per month.
- Retrieval Cost (600 GB): Free. Instant access without waiting.
- Yearly Cost (600 GB): $59.88.
Google Nearline (frequent access, similar to S3):
- Storage Cost (1200 GB): $12 per month.
- Retrieval Cost (1200 GB): $12. Instant access without waiting.
- Yearly Cost (1200 GB): $144.
- Storage Cost (600 GB): $6 per month.
- Retrieval Cost (600 GB): $6. Instant access without waiting.
- Yearly Cost (600 GB): $72.
Google Coldline (infrequent access, similar to Glacier):
- Storage Cost (1200 GB): $8.40 per month.
- Retrieval Cost (1200 GB): $60. OUCH!!! And LONG wait times (a few hours).
- Yearly Cost (1200 GB): $100.80.
- Storage Cost (600 GB): $4.20 per month.
- Retrieval Cost (600 GB): $30. OUCH!!! And LONG wait times (a few hours).
- Yearly Cost (600 GB): $50.40.
Amazon S3 (similar to Google Nearline, but super complex pricing based on data transfers, etc):
- Storage Cost (1200 GB): ~$28.11 per month. JUST FOR THE STORAGE, NOT FOR DATA TRANSFERS IN/OUT.
- Retrieval Cost (1200 GB): Something like $100.
- Yearly Cost (1200 GB): $337.32.
- Amazon is so complex that I am not even sure these numbers include all charges, meaning it could be even worse. They charge for API requests, for data transfer, for data storage, etc.
Amazon Glacier (infrequent access, similar to Glacier):
- Storage Cost (1200 GB): $4.8 per month.
- Retrieval Cost (1200 GB): About $100 per TB. And it's a truly terrible experience which takes a few weeks to complete, because Glacier is THAT slow.
- Yearly Cost (1200 GB): $57.6.
Backblaze B2:
- Storage Cost (1200 GB): $6 per month.
- Retrieval Cost (1200 GB): $24. Instant access without waiting.
- Yearly Cost (1200 GB): $72.
- Storage Cost (600 GB): $3 per month.
- Retrieval Cost (600 GB): $12. Instant access without waiting.
- Yearly Cost (600 GB): $36.
- However, they let you download 1 GB for free per day. So Arq's normal housekeeping actions, or if you do an occasional restore of a single file here and there, would almost always be free.
- Like a lot of other storage providers above, they charge per API calls, but the first 2500 API calls per day are free. And the rest are cheap at $0.004 (0.4 cents) per 10,000 calls:
https://help.backblaze.com/hc/en-us/articles/217667478-Understanding-B2-Pricing-Structure, and Arq doesn't do that many API calls. Maybe the first backup of half a million objects would rack up the biggest charge you'll ever see for API calls. And that'd still only be 50 * 10k API call packages (for the 500,000 API calls); aka 50*$0.004 = $0.2! ;-)
----
As I discovered above, it's very unlikely that I'll ever need to restore data from online, since I have so many different drives at home and would need to lose them ALL to ever need my online backup. So restoration prices don't matter as much as the storage prices.
However, restoration should not be insanely expensive.
So here are my rankings for permanently storing
1200 GB of data online:
1. Best: Backblaze B2! Just $6 per month ($72 per year). Paid per gigabyte, which means no unpleasant jumps as soon as you get to the "next tier" (which happens on Amazon Cloud Drive). Has VERY fast upload speeds (maxes out my 10 Mbit upload, meaning around 1200 KB/s, which means ~100 GB upload per day), because they provide UNTHROTTLED UPLOADS (test speed here
https://www.backblaze.com/speedtest/). Can be MUCH cheaper than Amazon Cloud Drive if you need to store less than 1 TB. No wait times to download data. And is getting support in Arq now. And restoring all of the data does cost a bit of money ($24 for 1200 GB) but is cheaper than almost the entire competition. Only Google Nearline is a bit cheaper (which is $12 for for recovery), but B2 compensates for that by being HALF THE PRICE for the ACTUAL STATIC STORAGE ITSELF (which is far more important!), so B2's lower cost over time automatically pays for its own slightly higher recovery costs if you ever need to recover. Two months of B2 subscription has paid for the entire price difference in recovery cost compared to Google Nearline. And I like that Backblaze has a very good reason to keep their data center alive - their entire backup software business depends on it. And they charge per GB so there's no way they'll suddenly end their "unlimited" pricing since there IS no unlimited pricing to end. ;-)
2. Now awful but still pretty cheap: Amazon Cloud Drive. It's almost twice the price of Backblaze B2, but at least it costs less than Google Nearline. And it has no wait times to download data. But seriously, the data upload to Amazon Cloud Drive is abysmal. It has always ranged between 300 KB/sec to 900 KB/sec for me (usually ~450) and it seems like they're intentionally throttling it. And they are horrible now because it's priced in 1 TB increments which means you must ALWAYS pay for more than you need, and anytime you hit for example 1001 GB you'll have to pay for 2000 GB of storage. Sigh.
3. Okay: Google Nearline. It's twice the price of Backblaze B2, but if you constantly need to download data, it may be cheaper over time since it's half the price at downloading. And just like B2 it has no wait times to download data.
4. Awful: Google Coldline. It's a LOT better than Amazon Glacier, it has faster recovery times (3 hours?) and is FAR CHEAPER at recovery, and is also a bit cheaper at the actual static storage itself. It's cheap for long-term storage that you NEVER touch. But overall, it's yet another super-inconvenient, slow-ass storage solution with hours of wait-time to do anything.
5. Truly awful: Amazon S3 (super expensive for static storage) and Amazon Glacier (cheap for static storage but extremely inconvenient and expensive for data recovery).
----
You can use this calculator to type in your storage needs and see what Backblaze B2 will cost you:
https://www.backblaze.com/b2/cloud-storage-pricing.html
(Remember to edit your "Monthly Upload" down from the default of saying that you're going to be adding 100 GB of extra storage per month, to something sane like "10 GB upload per month, 10 GB delete per month", to simulate the fact that Arq uploads new data and simultaneously deletes expired data, which gives you a net-change of almost no additional data at all.)
And I see that the B2 API verifies the checksum of all uploads, meaning it guarantees that whatever data Arq uploads to it was received properly at their side 100% non-corrupt!
----
So here's what I'll do now:
1. Demand a full refund of Amazon Cloud Drive, because they changed the terms. Others are getting refunds. Screw them. Maybe I would have stayed if they priced everything in 100 GB increments, but with their new 1 TB increment system I'm always going to end up paying way too much for my storage.
2. Sign up for Backblaze B2.
3. Wait for Arq's B2 support to be officially released. I don't want beta software.
4. Set up a B2 backup in Arq, with tweaked backup rules so that I avoid storing useless data (such as the final, installed versions of my huge music sample libraries; I'll only back up their installers).
Overall, this will give me much faster uploads/downloads. And a lower monthly price.
I guess I can thank Amazon Cloud Drive for pushing me away.
I hope this detailed overview helps others choose their new storage plans!