Backblaze Versus iDrive Cloud Backup Solutions

[JoelBC]

I am looking at cloud backup options primarily for my MBP.

I am trying to decide between Backblaze and iDrive.

In reading about the two it appears that:

1. Backblaze is easier to use and has unlimited storage but lacks disk imaging and zero-knowledge security (i.e., to recover data the user needs to send Backblaze their PEK); whereas
2. iDrive is harder to setup and potentially more costly (no unlimited storage) but does include an unlimited number of devices (not a major issue for me), disk imaging and zero-knowledge security.

I would appreciate comments / suggestions / thoughts on the two.

Thank you.

 

[Apple_Robert]

Take a look at Arq back up.

Cloud backup software for Mac and Windows : Arq

www.arqbackup.com

 

[JoelBC]

Take a look at Arq back up.

Cloud backup software for Mac and Windows : Arq

www.arqbackup.com

@Apple_Robert Appreciate the response and will take a look. The initial concerns I have with Area are a) the additional iCloud drive space would be more costly than iDrive on an annual basis and b) I need to check into the security of the transfer .

I am opened minded so with take a look. I would also appreciate comments / thoughts of any users.

I am now testing iDrive as they have a 15 day refund period. I decided to test them first as I like the zero-knowledge capability which in my view is limited / weakened by Backblaze by the need to send the PEK when restoring.

I will be back to you on Arq once I have taken a detailed look.

Thank you.

 

[JoelBC]

Take a look at Arq back up.

Cloud backup software for Mac and Windows : Arq

www.arqbackup.com

@Apple_Robert I took a quick look at the Arq documentation and it appears as though iCloud Drive is not a supported backup destination, is this correct? Kindly confirm or correct.

 

[Apple_Robert]

@Apple_Robert I took a quick look at the Arq documentation and it appears as though iCloud Drive is not a supported backup destination, is this correct? Kindly confirm or correct.

Thst is correct. It wasn’t a requirement in your OP.

Storage Locations

 

[gilby101]

iDrive is harder to setup and potentially more costly (no unlimited storage) but does include an unlimited number of devices (not a major issue for me), disk imaging and zero-knowledge security.

iDrive Disk Imaging is Windows only.

For Mac non-boot disk: use standard backup with restore: create new disk volume and restore data from cloud backup.

For Mac boot disk: The concepts of disk image and clone don't really work and most definitely not to the cloud. Recovery of boot disk involves new installation of macOS and either a) Migration Assistant restore from local storage or b) file and folder restore from cloud backup, but no app or settings restore.

To add to your comparison:
Backblaze: Does not backup extended attributes or retain file creation and modification dates.
iDrive: I believe is the same, but have never tested.

As @Apple_Robert implies, Arq Backup is a much better product for macOS. I use it with both OneDrive and Backblaze B2 cloud storage.

I hope you are including a local backup solution (e.g. Time Machine or CCC) as well as cloud.

 

[JoelBC]

Thst is correct. It wasn’t a requirement in your OP.

Storage Locations

@Apple_Robert: I thank you for the confirmation and the quick response. You are correct that it was not na requirement in my OP noting the use of iCloud is a preference, not a deal breaker as I am trying to consolidate things as much as possible. Thank you.

 

[JoelBC]

iDrive Disk Imaging is Windows only.

For Mac non-boot disk: use standard backup with restore: create new disk volume and restore data from cloud backup.

For Mac boot disk: The concepts of disk image and clone don't really work and most definitely not to the cloud. Recovery of boot disk involves new installation of macOS and either a) Migration Assistant restore from local storage or b) file and folder restore from cloud backup, but no app or settings restore.

To add to your comparison:
Backblaze: Does not backup extended attributes or retain file creation and modification dates.
iDrive: I believe is the same, but have never tested.

As @Apple_Robert implies, Arq Backup is a much better product for macOS. I use it with both OneDrive and Backblaze B2 cloud storage.

I hope you are including a local backup solution (e.g. Time Machine or CCC) as well as cloud.

@gilby101, thank you for taking the time to respond noting the following:

1. Appreciate the clarification of iDrive Disk Imaging being Windows only, very helpful.

2. Appreciate the clarification of macOS restore which unfortunately is something I am familiar with (i.e., i) reinstall OS, reinstall apps and then restore files from a backup OR ii) Migration Assistance).

3. On the retention of extended attributes (i.e. file creation dates, file modification dates, etc.) I will check and revert back.

4. On local backup, absolutely as I use BOTH CCC and Time Machine. I have just started to investigate / use a cloud storage in addition in case I lose data while travelling or my local storage is damaged / fails!

Thank you for all the help!

 

[JoelBC]

@Apple_Robert and @gilby101 : I started o look into Arq as you suggested. I am thinking that the best backup platform may be Arq Premium as it is $10 / year more than Arq for 1 TB of disk space which is cheaper that the other platforms that Arq supports.

I would appreciate yoru comments thoughts recognizing that price is not everything!

PS. Am I correct in concluding that Arq does retain extended file attributes (i.e. file creation dates, file modification dates, etc.) as I could not find it in their FAQ.

Thank you.

 

[HobeSoundDarryl]

ALT OPTION: OWN (NOT RENT) YOUR OWN CLOUD

Buy yourself a NAS like Synology and own your own cloud solution where you get to set all of the rules & parameters. Rather than lean on strangers to manage hard drive storage in the sky for you, do it yourself and you can enjoy what you like about Backblaze WITH what you like about iDrive. Want more storage at any time without an ongoing subscription? Add a drive or add a bigger drive to the NAS.

Setting up is relatively simple (execute a step-by-step wizard). If you have a family and want to offer them cloud space too, put them on shared cloud space and/or give them individual space.

None of this is hard to do. Watch some YouTube videos like this one to see for yourself. Up front, it will take more out of pocket to buy the NAS hardware and at least a few starter drives, but then $0 subscription cost forever after. As in ALL rent vs. buy choices, it's only a matter of time before the subscription route exceeds the ownership route.

Besides serving up your own cloud, a NAS will offer MANY other benefits... like whole house Time Machine, whole house security, whole house media management, whole house network sharing, whole house security system video storage, whole house DVR (with apps like Channels), etc.

Smart tip: mix Time Machine backups into this DIY solution and store at least one recently-backed-up time machine drive OFFSITE to protect against theft/fire/flood. If you use 2 HDDs for this, regularly rotate them so that the one offsite is always pretty up to date.

Works great, have cloud as YOU want it, no subscriptions, no trusting complete strangers with your data, etc.

 

[JoelBC]

@HobeSoundDarryl : A sa start, thank you for taking the time to respond.

I am familiar with NAD drives and used them for years.

I am considering this a possibility with the Arq software that I am testing (or even with the CCC software that I already own).

The thing that I do not know, is whether NAS based clouds are less / more secure than those of Arq, Backblaze, IDrive, etc. as there is still a third party hosting them (i.e., this was certainly the case with my WD NAS). To be clear, an on-site NAS drive is not an option because I already have local storage devices, I am looking for solution in case the house burns to the ground, the local stair age fails, etc.

 

[JoelBC]

And while we are talking about Arq, does anyone know how to delete old Activity Logs?

 

[HobeSoundDarryl]

@HobeSoundDarryl : A sa start, thank you for taking the time to respond.

I am familiar with NAD drives and used them for years.

I am considering this a possibility with the Arq software that I am testing (or even with the CCC software that I already own).

The thing that I do not know, is whether NAS based clouds are less / more secure than those of Arq, Backblaze, IDrive, etc. as there is still a third party hosting them (i.e., this was certainly the case with my WD NAS). To be clear, an on-site NAS drive is not an option because I already have local storage devices, I am looking for solution in case the house burns to the ground, the local stair age fails, etc.

Understood.

IMO, a personal NAS set up well is probably MORE secure than big brand clouds because the big ones have the far larger prize potential for hackers. Hack a major cloud provider and they can seek millions in ransom. Hack Average Joe's personal cloud on a NAS and Joe probably couldn't/wouldn't pay even hundreds. If me, I'd just wipe the NAS, rebuild and resume. But I think of it as same energy/effort being put towards very different prize potentials. Why bother trying to hack an individual's NAS where the dollar prize would be towards relatively nill?

The offsite backup pursuit is a very smart one and highly recommended. But again, Time Machine with as little as 2 DAS drives can fully cover that option (or using CCC if you prefer). TM backup to one directly connected now, while the other is stored offsite (I use a bank safe deposit box but there are many other options). Regularly- in my case about every 4 weeks- swap those drives. Fire, flood, theft could wipe out all storage at home and that offsite one would restore it all.

 

[JoelBC]

Understood.

IMO, a personal NAS set up well is probably MORE secure than big brand clouds because the big ones have the far larger prize potential for hackers. Hack a major cloud provider and they can seek millions in ransom. Hack Average Joe's personal cloud on a NAS and Joe probably couldn't/wouldn't pay even hundreds. If me, I'd just wipe the NAS, rebuild and resume. But I think of it as same energy/effort being put towards very different prize potentials. Why bother trying to hack an individual's NAS where the dollar prize would be towards relatively nill?

The offsite backup pursuit is a very smart one and highly recommended. But again, Time Machine with as little as 2 DAS drives can fully cover that option (or using CCC if you prefer). TM backup to one directly connected now, while the other is stored offsite (I use a bank safe deposit box but there are many other options). Regularly- in my case about every 4 weeks- swap those drives. Fire, flood, theft could wipe out all storage at home and that offsite one would restore it all.

Agree that the "merger clouds" have the "larger prizes".

In terms of using offset storage I agree but I am far too busy / lazy to go to the physical bank with any degree of regularity, hence the cloud based approach in addition to CCC and Time Machine. Time Machine is a wonderful when you need to rebuild from scratch, the Migration Assistant is unmatched!

Now back our discussion on Arq and IDrive.

 

[gilby101]

I am thinking that the best backup platform may be Arq Premium as it is $10 / year more than Arq for 1 TB of disk space which is cheaper that the other platforms that Arq supports.

Test and see if upload performance is good enough with Arq Premium. Depending on where you are, this may be good (or not). I suspect that most Arq advocates are long term users who appreciate being able to choose their storage provider. My understanding is that Premium was added in response to potential users requesting a simpler configuration.

With current pricing Arq Premium is US$60 per year. Arq (not premium) is US$50 for first year and US$25 per year after that. Storage providers are from about US$6 per month per TB.

Given that low cost storage providers (Wasabi, Backblaze B2, iDrive E2) are currently increasing prices by about $1 per month per TB, Arq Premium may need to increase price soon. Just my guess.

PS. Am I correct in concluding that Arq does retain extended file attributes (i.e. file creation dates, file modification dates, etc.) as I could not find it in their FAQ.

Yes it does.

And while we are talking about Arq, does anyone know how to delete old Activity Logs?

The logs are in /Library/Application Support/ArqAgent/logs/backup. Nothing to stop you deleting them, but they are not large - just text files. Much, much larger is /Library/Application Support/ArqAgent/cache.noindex which you do need to have.

 

[HDFan]

a personal NAS set up well is probably MORE secure than big brand clouds

There is always a tradeoff between internet access and security. NAS systems are subject to the same security concerns as your personal computer. Some QNAP users had their systems locked up with ransomeware. NAS system require upkeep, and there is a cost to purchase and run them. I could pay for decades of Backblaze backups for the cost of purchasing and running my NAS units.

1. Backblaze is easier to use and has unlimited storage but lacks disk imaging and zero-knowledge security (i.e., to recover data the user needs to send Backblaze their PEK); whereas

iDrive and Arq are prohibitively expensive for me given the size of my backups. Don't see the use of disk imaging as for OS backups on MacOS it is just better to reinstall the OS rather than restore from backup. You can just download the files from Backblaze for a recovery, or ask them you send you a disk.

You might also look into CrashPlan Business and Carbonite which offer unlimited backups. Their uploads, compared to Backblaze, are slow though.

In a 3-2-1 backup strategy I would only include 1 TM backup as they tend to fail.

 

[JoelBC]

@gilby101 , much thanks for the response. I will have more on speed momentarily.

@HDFan , much thanks for the response.

 

[JoelBC]

The logs are in /Library/Application Support/ArqAgent/logs/backup. Nothing to stop you deleting them, but they are not large - just text files.

@gilby101, I quit Arq, I deleted a few log files and I re-opened Arq and the log files were still there being displayed / shown in Arq! Any ideas / thoughts how to get the deleted log files to stop displaying in Arq?

 

[JoelBC]

I am new to Arq and have a few questions:

1. Activity Log Deletions: How do I delete old activity logs?
a. I tried closing Arq, deleting a few log files (located at /Library/Application Support/ArqAgent/logs/backup), and re-opening Arq but the log files were still there being displayed / shown in Arq! How do I get the deleted log files to stop displaying in Arq?



2. Backup Log Error Message: The attached PDF file is a sample of the error logs that I am consistently getting. The error log indicates that i) the backup failed and ii) there are 91 files not being backed up / errors despite having granted full disk access to Arq.

a. What is the cause / reason for the files not being backed up / resulting in errors (i.e., is there a reason these files cannot or should not be backed up?)

b. What is the fix / solution (i.e., is there a need for the files [and, if not, then can they or should they be excluded from the backup], is this problem common to all macOS backups, is / should this be a concern)


3. Backup Log Export: Is there a way to export backup logs as there does not appear to be one?


4. Activity Log Icons: What do the different icons mean (i.e. the red circle with an exclamation mark = issue / problem, the blue circle with a minus signs = ??? / what)?


5. Backup Frequency: How often does Arq backup files; that is, I know that Arq can be configured for daily backups and hourly backups but can it be configured for continuous / real time backups?


6. Backup Speed: The backup speed is very slow using the Arq Server as can be seen by the attached log / PDF file.

a. Is there a way to increase the speed (noting I am using the server in Finland)?

b. Will subsequent backups be faster?

c. Which Arq server is the fastest, because the one in Finland is brutal?


7. Settings: Please confirm / correct my understanding of each of the following options:

a. Use filesystem snapshot for APFS volumes: If this is selected / ticked then an APFS snapshot is taken and that snapshot is backuped as opposed to backing up files in their then currentstae during the backup (i.e., this snapshot crates a point in time backup).

b. Keep deleted files in subsequent backup records: If this is selected / ticked then files that i) are in previous backup records and ii) are not on the computer during the current backup then these files are included in the current backup for ease of reference / use.

Thanks in advance

 

[ignatius345]

TM backup to one directly connected now, while the other is stored offsite (I use a bank safe deposit box but there are many other options). Regularly- in my case about every 4 weeks- swap those drives. Fire, flood, theft could wipe out all storage at home and that offsite one would restore it all.

My strategy as well. The total time cost to me is probably 10 minutes/month just plugging in that offsite backup and then ejecting it again to take it back to work when it's done (typically, a few hours at most, though it can go longer than than if I have changed a lot of stuff).

I think the 4TB portable HDDs I'm using for both my onsite and offsite backups cost me $350 or so for both of them, but that would be cheaper today because drive prices have gotten so low. When these ones die or I outgrow them I'll probably spring for SSDs.

This probably goes without saying, but definitely you want to encrypt your offsite backup if you go this route. Time Machine does this very painlessly at the time of setup.

 

[gilby101]

1. Activity Log Deletions: How do I delete old activity logs?
a. I tried closing Arq, deleting a few log files (located at /Library/Application Support/ArqAgent/logs/backup), and re-opening Arq but the log files were still there being displayed / shown in Arq! How do I get the deleted log files to stop displaying in Arq?

I have been more concerned to preserve logs than delete. If you do delete them, you may need to restart Arq and the Arq Agent (or reboot) to stop them displaying. That is a guess.

2. Backup Log Error Message: The attached PDF file is a sample of the error logs that I am consistently getting. The error log indicates that i) the backup failed and ii) there are 91 files not being backed up / errors despite having granted full disk access to Arq.

a. What is the cause / reason for the files not being backed up / resulting in errors (i.e., is there a reason these files cannot or should not be backed up?)

You are trying to read files protected by file permissions. They all look like Spotlight cache files which you don't need to backup.

b. What is the fix / solution (i.e., is there a need for the files [and, if not, then can they or should they be excluded from the backup], is this problem common to all macOS backups, is / should this be a concern)

Either a) exclude cache folders, etc. or b) "skip items excluded by Time Machine rules" on exclusions. I skip items excluded by TM which have no value when wanting to recover as they all be recreated by macOS.

I don't use the "backup all drives" style of backup. I prefer to "choose the folders to backup". This seems to me to more in keeping with recovery from a serious disaster (e.g. file or theft). I focus on the folders with data important to me personally rather then important to operation of macOS.

3. Backup Log Export: Is there a way to export backup logs as there does not appear to be one?

I use a Hazel rule to copy logs to an another location. You could try creating a Folder Action (use Automator).

4. Activity Log Icons: What do the different icons mean (i.e. the red circle with an exclamation mark = issue / problem, the blue circle with a minus signs = ??? / what)?

Somewhere there used to be a statement on this. I can't find it. But basically you want green tick - anything else needs investigation.

5. Backup Frequency: How often does Arq backup files; that is, I know that Arq can be configured for daily backups and hourly backups but can it be configured for continuous / real time backups?

You can't configure continuous. Those that do "continuous" are just watching the file system and noting that files should be backed up asap - there can be quite a delay before the backup happens. I do daily - that seems appropriate for the risks being mitigated.

6. Backup Speed: The backup speed is very slow using the Arq Server as can be seen by the attached log / PDF file.

a. Is there a way to increase the speed (noting I am using the server in Finland)?

Arq Premium uses servers belong to one of the low cost storage providers (it was Wasabi, not sure if still true) located in US. I would expect it to be slow from Finland. Try with Arq (not premium) and a cloud provider with European storage (e.g. Backblaze B2). I am in Australia and find Backblaze B2 (US) is fast enough.

b. Will subsequent backups be faster?

Speed is dictated by a) lots of small files had local processing and b) network bandwidth to cloud storage. Only changed files are backed up, so yes subsequent backups (with few changes) will be faster.

c. Which Arq server is the fastest, because the one in Finland is brutal?

See 6 above

7. Settings: Please confirm / correct my understanding of each of the following options:

a. Use filesystem snapshot for APFS volumes: If this is selected / ticked then an APFS snapshot is taken and that snapshot is backuped as opposed to backing up files in their then currentstae during the backup (i.e., this snapshot crates a point in time backup).

Yes. Use that for APFS disks.

b. Keep deleted files in subsequent backup records: If this is selected / ticked then files that i) are in previous backup records and ii) are not on the computer during the current backup then these files are included in the current backup for ease of reference / use.

Yes, though I don't use that. I like it to look more like Finder's view of TM disk.

 

[JoelBC]

@gilby101 I GREATLY appreciate your response and apologize for teh slow reply but work got in the way!

I have been more concerned to preserve logs than delete. If you do delete them, you may need to restart Arq and the Arq Agent (or reboot) to stop them displaying. That is a guess.

Agreed. I want to delete logs in respect to previous backup setups that I no longer use as they are no longer relevant. I is a clean thing!

You are trying to read files protected by file permissions. They all look like Spotlight cache files which you don't need to backup.

I am trying yoru suggested approach. I deleted three "folders" as follows:

1. Library/Caches/come.apple.aned ((Failed to read file status: Operation not permitted)
2. Users/Joel/Library/Caches/com.apple.helpd/
3. Users/Joel/Library/Metadata/CoreSpotlight

I have no idea what these folders / files so but hope that they are not critical

Either a) exclude cache folders, etc. or b) "skip items excluded by Time Machine rules" on exclusions. I skip items excluded by TM which have no value when wanting to recover as they all be recreated by macOS.

Excellent idea and very interesting. I can text / check whether "Skip items excluded by Time Machine rules" includes the above folders which I deselected.

I don't use the "backup all drives" style of backup. I prefer to "choose the folders to backup". This seems to me to more in keeping with recovery from a serious disaster (e.g. file or theft). I focus on the folders with data important to me personally rather then important to operation of macOS.

I too prefer to use the "choose the elders to backup"! That said, I am lied backup up more information that is needed.

Would you agree / disagree that all that is needed is:

1. Application folder to get a list of the Applications installed; and
2. User/User name folder to get all the documents, pictures, etc.

And, if not, then why not?

I use a Hazel rule to copy logs to an another location. You could try creating a Folder Action (use Automator).

Hazel rule, what is that?

Somewhere there used to be a statement on this. I can't find it. But basically you want green tick - anything else needs investigation.

Appreciated. I figured as much but wanted to know what the specific icon meant!

You can't configure continuous. Those that do "continuous" are just watching the file system and noting that files should be backed up asap - there can be quite a delay before the backup happens. I do daily - that seems appropriate for the risks being mitigated.

Appreciate the response and agree on daily backups. I am doing theme frequently for testing purposes but will move to daily once I have completed the testing process.

Arq Premium uses servers belong to one of the low cost storage providers (it was Wasabi, not sure if still true) located in US. I would expect it to be slow from Finland. Try with Arq (not premium) and a cloud provider with European storage (e.g. Backblaze B2). I am in Australia and find Backblaze B2 (US) is fast enough.

I will try Backblaze B2. That said, another recommendations for faster cloud backups?

Speed is dictated by a) lots of small files had local processing and b) network bandwidth to cloud storage. Only changed files are backed up, so yes subsequent backups (with few changes) will be faster.

Yes, though I don't use that. I like it to look more like Finder's view of TM disk.

Curious, what do you mean by "look more like Finder's view of TM disk" (i.e., do you mean "sequential" where each backup / snapshot reflects what was on the computer when backed up)?

If this is what you mean then I am in agreement.

AGAIN, much thanks.!

 

[JoelBC]

A few more Arq related questions and updates (which is more and more becoming the way I will go though I do need to find a much faster server to backup to):

1. Is there a way to delete old backups to free of cloud disk space? And, if yes, then how?

2. If older backups are deleted then will the related activity log files be deleted (note: I hope so).

And, and update on excluded the folders i)Library/Caches/come.apple.aned ((Failed to read file status: Operation not permitted) ii) Users/Joel/Library/Caches/com.apple.helpd/ and iii) Users/Joel/Library/Metadata/CoreSpotlight resulted in a clean backup / backup report as follows:

Computer: Joel’s MacBook Pro
Storage Location: Arq Cloud Storage
Arq version: 7.24
Start Time: 9/19/23, 4:00 PM
End Time: 9/19/23, 5:43 PM
Errors: 0
Scanned Bytes: 537.296 GB
Scanned Files: 485,438
Uploaded Bytes (compressed): 29.276 GB
Uploaded Files: 1,371
Log:
19-Sep-2023 16:00:05 EDT Backup activity started
19-Sep-2023 16:00:05 EDT Arq version 7.24
19-Sep-2023 16:00:05 EDT macOS 13.5.2
19-Sep-2023 16:00:05 EDT Storage location: Arq Cloud Storage
19-Sep-2023 16:00:05 EDT Backup plan: All Files to Arq Cloud Storage (59BF1604-F23D-45A1-9571-F02E5A5E9F0B)
19-Sep-2023 16:00:05 EDT Dataless-files policy: Report cloud-only files as errors
19-Sep-2023 16:00:05 EDT Arq trial expires in 28 days
19-Sep-2023 16:00:07 EDT Creating APFS snapshot for Other (/Volumes/Other)
19-Sep-2023 16:00:08 EDT Created APFS snapshot for Other (/Volumes/Other)
19-Sep-2023 16:00:08 EDT Creating APFS snapshot for Data (/System/Volumes/Data)
19-Sep-2023 16:00:08 EDT Created APFS snapshot for Data (/System/Volumes/Data)
19-Sep-2023 16:00:09 EDT /Volumes/Other: Backup plan changed; rescanning all folders
19-Sep-2023 16:00:09 EDT /Applications: Backup plan changed; rescanning all folders
19-Sep-2023 16:00:24 EDT /Library: Created a new backup record.
19-Sep-2023 16:00:24 EDT /Library (1 exclusion): 3.792 GB, 13,737 files backed up
19-Sep-2023 16:46:25 EDT /Users: Created a new backup record.
19-Sep-2023 16:46:25 EDT /Users (2 exclusions): 604.407 GB, 171,900 files backed up
19-Sep-2023 17:01:26 EDT /Applications: Created a new backup record.
19-Sep-2023 17:01:26 EDT /Applications: 10.945 GB, 209,590 files backed up
19-Sep-2023 17:23:47 EDT /Volumes/Other: Created a new backup record.
19-Sep-2023 17:23:48 EDT /Volumes/Other: 240.646 GB, 223,234 files backed up
19-Sep-2023 17:23:48 EDT Total scanned: 537.316 GB, 485,623 files
19-Sep-2023 17:23:48 EDT Total uploaded (compressed): 29.276 GB, 1371 files
19-Sep-2023 17:23:55 EDT Enforcing budget and removing unreferenced data
19-Sep-2023 17:24:07 EDT Deleting backup record: 2023-09-17 15:16:32 +0000
19-Sep-2023 17:26:11 EDT Deleting backup record: 2023-09-18 00:48:19 +0000
19-Sep-2023 17:43:10 EDT Total stored bytes 996,121,260,772 is now less than or equal to the budget maximum 1000 GB
19-Sep-2023 17:43:10 EDT Removing APFS snapshot for /Volumes/Other
19-Sep-2023 17:43:10 EDT Removed APFS snapshot for /Volumes/Other
19-Sep-2023 17:43:10 EDT Removing APFS snapshot for /System/Volumes/Data
19-Sep-2023 17:43:10 EDT Removed APFS snapshot for /System/Volumes/Data
19-Sep-2023 17:43:10 EDT Backup activity ended

A huge thank you to everyone who recommended Arq (over Backblaze and IDrive, though I am still testing IDrive) and for helping me get to this point!

 

[gilby101]

1. Is there a way to delete old backups to free of cloud disk space? And, if yes, then how?

Yes. In Arq:
In sidebar, under Restore: Open (click on arrow/triangle) a destination, Open a backup set, Open a folder, Select a particular date, Choose Delete at far top right. You are then asked whether you want to delete just the one backup or the backup and all older.
You will not see an immediate reduction in used storage because it needs a couple of backup cycles to mark and recover space used by unused storage objects. Also, you will recover space used by files which are only in those particular backups - so might not be as much as your expect.

I am trying yoru suggested approach. I deleted three "folders" as follows:

1. Library/Caches/come.apple.aned ((Failed to read file status: Operation not permitted)
2. Users/Joel/Library/Caches/com.apple.helpd/
3. Users/Joel/Library/Metadata/CoreSpotlight

I have no idea what these folders / files so but hope that they are not critical

I assume these are critical to Spotlight on the running Mac. Expect Spotlight problems if you meant delete on the Mac.
But not critical in a disaster recovery because they will be rebuilt on a new Mac and/or not needed when you want to recover a few files or folders.

Would you agree / disagree that all that is needed is:

1. Application folder to get a list of the Applications installed; and
2. User/User name folder to get all the documents, pictures, etc.

You only need what you would want to restore in the event of the disasters you want to mitigate. In my case I am using Arq to mitigate the risks due to disasters like fire, lightning, theft, and accidental (but not realised for while) deletion of documents and photos. I don't backup the Applications folder or other things which can be downloaded from elsewhere. I do backup most of my User folder and external data disks. I do backup iCloud and other cloud synchronisation services. I only backup selected folders in ~/Library. I don't backup virtual machines.

I do use local backup (TM and CCC) for lesser disasters.

Hazel rule, what is that?

The Hazel app is a more advanced form of folder action. https://www.noodlesoft.com/

That said, another recommendations for faster cloud backups?

If speed is critical - use AWS. But it will cost 10x more. Backblaze B2 is probably good enough.

 

[JoelBC]

Yes. In Arq:

In sidebar, under Restore: Open (click on arrow/triangle) a destination, Open a backup set, Open a folder, Select a particular date, Choose Delete at far top right. You are then asked whether you want to delete just the one backup or the backup and all older.

You will not see an immediate reduction in used storage because it needs a couple of backup cycles to mark and recover space used by unused storage objects. Also, you will recover space used by files which are only in those particular backups - so might not be as much as your expect.

Appreciated noted I will give it a go.

One follow up, will this also clear up the related Activity Logs?

I assume these are critical to Spotlight on the running Mac. Expect Spotlight problems if you meant delete on the Mac.
But not critical in a disaster recovery because they will be rebuilt on a new Mac and/or not needed when you want to recover a few files or folders.

I meant critical in terms of recovery so we are good, no worries.!

You only need what you would want to restore in the event of the disasters you want to mitigate. In my case I am using Arq to mitigate the risks due to disasters like fire, lightning, theft, and accidental (but not realised for while) deletion of documents and photos. I don't backup the Applications folder or other things which can be downloaded from elsewhere. I do backup most of my User folder and external data disks. I do backup iCloud and other cloud synchronisation services. I only backup selected folders in ~/Library. I don't backup virtual machines.

Agreed and make sense. This is the exact reason that I am interested in have a cloud based backup though I will backup everything as I have been doing when testing Arq and IDrive (i.e., as you have seen in the file section).

I do use local backup (TM and CCC) for lesser disasters.

I have exactly the same process with CCC (i.e., two different CCC backups which run overnight) and TimeMachine. I have been using CCC for 10+ years!

In respect of CCC you may find the following interesting:

1. CCC full disk backup backs ups the all teh files on a disk other than those which I excluded. I confirmed this by both looking at the files that CCC backups and in an e-mail exchange CCC.

2. CCC full disk backup is Migration Assistant compliant per my e-mail exchange with CCC. I found this interesting in that CCC excludes fewer files that TimeMachine and therefore may do a better job restoring a machine (i.e., all the little settings and tweaks)!

The Hazel app is a more advanced form of folder action. https://www.noodlesoft.com/

Appreciated, I will take a look!

If speed is critical - use AWS. But it will cost 10x more. Backblaze B2 is probably good enough.

I will try Backblaze B2 and compare speeds.

I will run a few more backups using Arq's cloud to get a baseline and then do the same using Backblaze B2 and compare the results. I will share my findings.