Arq

[Weaselboy]

Arq is not really intended to be a clone or full disk backup app like Time Machine. It is more intended as a backup for your personal data and settings. By default Arq just backs up your personal home folder.

So in theory, if your Mac was stolen or died, you could fire up a new Mac and install your apps then restore your data from Arq and be in business.

 

[dai-leung]

Arq is not really intended to be a clone or full disk backup app like Time Machine. It is more intended as a backup for your personal data and settings. By default Arq just backs up your personal home folder.

Please forgive me for asking a dumb question. I learn that Mac has 5 folders: /System, /Applications, /Library, /Users and /Home. Why doesn’t backing up these folders by brute force using ARQ then restoring them give the same Mac?

 

[hallux]

Please forgive me for asking a dumb question. I learn that Mac has 5 folders: /System, /Applications, /Library, /Users and /Home. Why doesn’t backing up these folders by brute force using ARQ then restoring them give the same Mac?

Doing a full system restore using ARQ is just not going to work in the same way that CarbonCopyCloner or SuperDuper will. Why? Because in order to use ARQ you need, at the very least, a base OS installed on the system onto which you would then install ARQ.

Your best effort for backing up the info you seek to have to restored would be to back up /Applications, /Library and the full /users folder for the account you use (which also captures the user library). However - I would do a SELECTIVE restore of the /Library and /Applications folders, only restoring the information needed.

Devil's advocate here - if you have applications for which you are legitimately licensed, wouldn't you have a copy of the key or be able to request such from the developer so that you could install it on a clean OS install?

 

[dai-leung]

....However - I would do a SELECTIVE restore of the /Library and /Applications folders, only restoring the information needed.

Sincere thanks for yours and Weaselboy’s replies.

Your answer is consistent with my layman’s understanding. I forgot, indeed for some apps, I did have to contact the developers and at the end got them to work and for some apps I do have key codes. I am not a computer person, the more I have to do the more chance I would break something. Thus the desire of not having to install the apps if possible.

I feel confident enough to reinstall the OS and Arq, but not confident enough to do SELECTIVE restore. Would it work, if I just simply restore the /Library, /Applications and /Users folders to a returned from repair Mac on top of a newly installed OS and ARQ?

Just wondering if you know the snapshots mentioned in ARQ6 are the same as the time machine local snapshots.

 

[dimme]

As another poster mentioned, Superduper or CarbonCopyCloner will do a better job of doing a total restore. You should give consideration to making one of them part of your backup strategy.

 

[dai-leung]

As another poster mentioned, Superduper or CarbonCopyCloner will do a better job of doing a total restore. You should give consideration to making one of them part of your backup strategy.

Thank you! I did follow the advices given by experts of this forum and am using both CCC and time machine in addition to ARQ. I learned of ARQ from this forum. Without this forum and without ARQ, I would have no clue how to backup to the cloud.

Obviously, for a non-computer user like me, I would like ARQ to be as easy to use as CCC. If indeed all I need to do is to have ARQ backuped /applications, /library and /users, and then restore these folders to a just returned from repair Mac on which I had installed the OS and ARQ, then the mac would be equal to having a full restore. This level of skill I could manage.

There is something I don’t understand and have never been able to get an answer. If I ARQ backup the whole Macintosh HD (ARQ support told me how to do it), and I then restore the full backup on the cloud to an external SSD. If ARQ faithfully uploaded and then faithfully downloaded everything, wouldn’t this external SSD is a clone of the Macintosh HD just like doing backup using CCC? This is conceptually easier to understand for a layman like me.

 

[BigMcGuire]

There is something I don’t understand and have never been able to get an answer. If I ARQ backup the whole Macintosh HD (ARQ support told me how to do it), and I then restore the full backup on the cloud to an external SSD. If ARQ faithfully uploaded and then faithfully downloaded everything, wouldn’t this external SSD is a clone of the Macintosh HD just like doing backup using CCC? This is conceptually easier to understand for a layman like me.

Arq does the file copying at the file level. CCC and SuperDuper do the copying at the system disk utility level. Arq copies files, CCC and Super Duper copy the disk format, the partitions, and the boot records of the disks.

Arq is a great tool for backing up data. We use it at my work to store highly volatile data on a daily basis to external drives.

But when it comes to system clones - we use other tools like Acronis, CCC (for Mac), or Super Duper.


Benefit of Arq is, it's a lot faster, cuz it's just backing up files. A system clone of a server can take half a day or more.

To restore Arq, I'd need a computer with an operating system in place. To restore Acronis, CCC, or Super Duper - I'd need just a system, and I can restore onto its internal disks.


Two forms of backup, for different situations. You can never have enough backups! I use Acronis (for Windows), CCC (for Mac), BackBlaze for file backup on the internet, Arq for file backup locally to an external drive, and Time Machine (to another external drive).

 

[BigMcGuire]

In order to have a bootable backup of a system, you have to copy the hard drive's master boot record, the format of the disk, the partitions the disk has (many hidden partitions usually), then you can replicate a computer exactly.

Just having the files won't allow you to dump those files onto a blank disk. You got to have the stuff behind the files.

 

[gilby101]

I have been using ARQ5 to backup a Mac, but struggling to understand how it works and would appreciate answers for the following elementary questions.

Q1) I had used time machine backup to restore my Mac several times. Each time, all the applications worked, which is important to me as I don’t have license key codes for some of them. If I have to re-install apps, which I have no key code or license key, those apps will not work again.

Using ARQ, what folders of the Mac I should backup such that the restore from backup will preserve all the apps and their key codes just like the time machine would, that is without the need to input license keys for the apps? Would it work, if I omit /System, but back up all other folders?

Q2) I had used mac’s disk utilities to clone the internal Macintosh HD to an external drive. Afterward, the external drive was bootable and worked just like the internal MHD. If I use ARQ to back up the full Macintosh HD, is this ARQ backup a clone just like the one created by using the disk utilities? If not, why?

Q3) For ARQ6 and ARQ7, do answers for the above change?

Q4) ARQ 6 supports snapshots. Are these snapshots the same as the time machine local snapshots? If, yes, could they be used to restore the Mac to the system state at the time when the specific snapshot was taken?

Thank you in advance.

Q1: Arq, and other cloud backup solutions, are intended as a supplement to local fast recovery systems like Time Machine and the cloning apps. Yes, Arq can back up to a local disk but this is not its primary purpose. For fast recovery you are better off using TM or a local clone.

If you want Arq to retain all your apps and license keys, then you need to back up most of your boot disk. Obviously /Applications but also /Library, ~/Library and /Users/Shared. That will cover most cases. Be aware that some of /Library and ~/Library are frequently (in some cases continually) being modified which is not very friendly for cloud backup.

Better to use Time Machine and to have a record of all license keys.

Q2: Arq is not a clone. Why - never designed to be. If you want a clone CCC, Chronosync, etc. are what you need.

Q3: No

Q4: No. Arq 6 uses file system snapshots for the same purpose as TM does - to 'freeze' the state of the disk so as to ensure a consistent backup. But they are not the same snapshots. And it is not the snapshot which is backed up. For both Arq6 and TM it is the data in the snapshot.

 

[dai-leung]

BigMcGuire and gilby101,

Thank you both for giving me such detailed answers and for explaining the difference between copying at the file level vs at system disk utilities level and what is snapshot. Now it is clear why it does not make sense to backup the whole Macintosh HD and why restore from ARQ backup is not bootable. I do hope that the kind answers given by you all will benefit other non-computer ARQ users as well.

Not familiar with ~/Library and /Users/Shared, so I searched the internet. It seems that ~/Library is under /Users.

So am I correct that if I have a new Mac with Mac OS and ARQ installed and if I restore the 3 folders: /Applications, /Library and /Users from an ARQ backup, it would be equivalent to restoring from a corresponding CCC backup (that is no need to re-install all the apps)? And ARQ is able to backup the /Applications, /Library and /Users folders without any problem as system disk utilities level copying is not required?

I do understand I should use the ARQ backup only when all the local backups have failed.

 

[gilby101]

So am I correct that if I have a new Mac with Mac OS and ARQ installed and if I restore the 3 folders: /Applications, /Library and /Users from an ARQ backup, it would be equivalent to restoring from a corresponding CCC backup (that is no need to re-install all the apps)? And ARQ is able to backup the /Applications, /Library and /Users folders without any problem as system disk utilities level copying is not required?

Yes, restoring all those folders will restore your apps and most (maybe all) license keys as well as your user data. But it will likely cause other issues as simple overwriting of system data (/Library) can be troublesome. Whilst this will allow you to avoid reinstallation of most apps, I would not describe it as equivalent to using CCC or Time Machine.

Try to use backup and recover apps to their strengths and not to try to bend them to other usage. My recommendation:

For complete recovery (all apps, licenses, user data) use Time Machine or one of the cloning apps (CCC, etc.) to a directly attached disk drive. These methods are designed to enable complete and fast recovery.

Use Arq (or similar) for backup to cloud (off-site) storage. Recovery only in disaster scenarios involving the loss/destruction of computers and local backup storage. I would not expect to do a system restore from Arq, but I would expect to recover all my data - documents, photos, etc. Remember that after your house has burnt down, having to buy or download new copies of apps would be a minor inconvenience.

Keep a record of all license keys in off-site storage. That can be digital (e.g. files backed up using Arq) or paper records at the bank or, more likely, a friend's house.

That is the way I use Time Machine and Arq.

If complete recovery (without any app reinstallation or entry of license keys) after a major disaster is a requirement then I would buy two or more disk drives, use CCC to clone, and keep at least one drive stored off-site. How frequently you backup and swap drives will be a decision for you.

PS. Safe storage of passwords can be just as important as licence keys. Increasingly apps are tied to subscriptions and are enabled by user/password - e.g. Dropbox, Adobe.

 

[dai-leung]

Thank you for your further explanation and sharing your knowledge and experience. Your advice is helpful for me to use arq, time machine and CCC properly.

Once again, thank you, BigMcGuire and other members who answered my questions. I am grateful for your help.

 

[planteater]

I ended up upgrading from version 5 to 6. I found out that, although version 5 backups can't be written to, they can be accessed for restoring only. So I'm keeping my version 5 buckets and starting fresh buckets for version 6.

I'm disappointed to find out that the version 6 interface does not have a feature to review the session logs, in order to see all files backed up. I used that often in version 5. I was also unsuccessful in locating the session log file in the Arq directory hierarchy under library, although I did find the old version 5 logs.

Does anyone know where I can find them? Or perhaps an output file of some sort that I can grep while backups are running, or review afterwards?

 

[Weaselboy]

I'm on 6 also and I see no log that display all the files like you want.

 

[planteater]

Perhaps it’s one of the features coming in version 7. My understanding is that it will be a free upgrade from version 6 licenses.

 

[bwintx]

Anybody having errors with Arq 6 on macOS Big Sur? Ever since I upgraded to Big Sur last night, I’ve had an error each time Arq has tried to do a backup to B2. Log of most recent such episode:

14-Nov-2020 10:00:05 CST Backup activity started
14-Nov-2020 10:00:05 CST Arq version 6.2.54
14-Nov-2020 10:00:05 CST Storage location: B2 << EDITING OUT B2 BUCKET INFO >>
14-Nov-2020 10:00:07 CST Error found in latest snapshot; rescanning all folders
14-Nov-2020 10:00:07 CST Error found in latest snapshot; rescanning all folders
14-Nov-2020 10:00:07 CST Creating APFS snapshot for /
14-Nov-2020 10:00:07 CST Error: Failed to create APFS snapshot: Read-only file system
14-Nov-2020 10:37:23 CST Saving new complete snapshot
14-Nov-2020 10:37:25 CST Macintosh HD: 208,975,210,874 bytes backed up
14-Nov-2020 10:37:25 CST Backup activity ended

Update: Come to think of it — last time I had this issue a few months ago, Stefan at Arq advised me to try the Validate Backup Data Now option for the specific backup plan. Trying that now, but it will take quite a while to complete. Will advise later if that fixes the problem.

 

[Weaselboy]

Anybody having errors with Arq 6 on macOS Big Sur?

Below is my post from another thread with the temp fix for this.


===========

Arq Backup (6.2.46) doesn't seem to be working correctly. I always get the error "Error: Failed to create APFS snapshot: Operation not permitted"

I get that also, but the backups seem to be working okay. I sent an email to the dev and will let you know what he says.

Edit: Here is the temp fix from the dev.

Sorry about the error. As a workaround, we would ask you to uncheck the "use APFS snapshot" option from the backup set configurations (click "Edit" > go to the "Options" tab) for now.

We will get back to you shortly with a fix.

 

[bwintx]

Below is my post from another thread with the temp fix for this.


===========

I get that also, but the backups seem to be working okay. I sent an email to the dev and will let you know what he says.

Edit: Here is the temp fix from the dev.

Thanks, @Weaselboy — had missed that post. Greatly appreciated and beats the daylights out of waiting for the thing I was trying! ?

 

[planteater]

I'm not really happy with Arq 6 from an interface perspective. It is very limited compared to Arq 5. I really miss proper logging. It also does not show the full list of folders I've selected for backup from within the GUI window. I have to drill down into the selection box after clicking edit. But the stronger SHA256 hashing is reason enough to be using it instead of Arq 5.

The good news is that Arq 7 is going back to a native Mac interface and seems to have many of the missing Arq 5 features. Is anyone using the pre-release version of it? There is some information and screenshots at the link below.

Next up: Arq 7! - Arq Backup Blog

We’re shipping Arq 7 this year. It has a totally new user interface, and all the features of Arq 6 plus additional improvements, and it’s awesome! It’s a free upgrade for Arq 6 customers, and a discounted price for Arq 5 customers. But wait, didn’t you just ship Arq 6? Yes, we did, last April. […]

www.arqbackup.com

 

[Weaselboy]

Is anyone using the pre-release version of it?

I saw that blog entry also and it looks like he knows he made some poor decisions with 6. I'm nervous running beta software (7) for my backups though.

 

[planteater]

I saw that blog entry also and it looks like he knows he made some poor decisions with 6. I'm nervous running beta software (7) for my backups though.

Me too! Even when 7 is out, I'll wait for some reports and give it a bit of time to percolate. It does sound like he is heading in the right directions. All in all, I really like Arq.

 

[Soylent Yellow]

I saw that blog entry also and it looks like he knows he made some poor decisions with 6. I'm nervous running beta software (7) for my backups though.

I am running the beta and when you're nervous, stay on 5 or 6 till the official release.

 

[planteater]

I am running the beta and when you're nervous, stay on 5 or 6 till the official release.

Does it bring back full logging of all actions to the file level?

 

[gilby101]

Does it bring back full logging of all actions to the file level?

Yes.

To have some influence over what is in the final release, use Arq7 and make suggestions to support.

My recommendation to people is to use either Arq5 or Arq7. I feel any uncertainties because Arq7 is prerelease are less than the known problems with Arq6. But make your own decision on this.

 

[Soylent Yellow]

Does it bring back full logging of all actions to the file level?

It has the option ‘Include list of uploaded files in activity logs and email reports’ in settings.