Permission issue with external drive

[Levina]

So I updated to Sequoia and ran into a problem that I can't fix.

I have my apps on the internal drive and have my photo library on an external drive. When I'm in Canon's DPP (proprietary photo editing software), which I use to cull my photos, I can delete a photo from my internal drive just fine from within the app but I can't do it from the external drive. I first need to give permission, but after filling in my password (which in itself is annoying), it says I don't have permission to perform that action. But I'm the owner and admin on my Mac! How can I not have permission? And why do I need to give permission in the first place? Funny thing is that I can delete the same file from the external manually just fine.

I have re-installed the latest version of DPP and checked in System Preferences that it has full disk access.

Any way to fix this?

 

[FreakinEurekan]

Seems to be something in Canon DPP permissions. You said that it has "full disk access" so this may be redundant, but check:

* Check System Settings > Privacy & Security > Files & Folders, see if Canon DPP is listed there, and if so ensure the folder you're trying to use is listed.

* Could possibly be listed under "Full Disk Access" instead of "Files & Folders" - I wouldn't expect so, but possible.

If the folder isn't listed (or, frankly, if the App isn't listed) then Canon DPP isn't ASKING for that permission; Canon Support is your next step for an app update.

If the app IS listed there but you still can't delete - I'd look at how the disk is formatted. APFS is my recommendation; exFAT has its place if you also need Windoze compatibility but I don't personally use it. NTFS is right out - copy data to a different disk & re-format.

 

[Levina]

Seems to be something in Canon DPP permissions. You said that it has "full disk access" so this may be redundant, but check:

* Check System Settings > Privacy & Security > Files & Folders, see if Canon DPP is listed there, and if so ensure the folder you're trying to use is listed.

* Could possibly be listed under "Full Disk Access" instead of "Files & Folders" - I wouldn't expect so, but possible.

If the folder isn't listed (or, frankly, if the App isn't listed) then Canon DPP isn't ASKING for that permission; Canon Support is your next step for an app update.

If the app IS listed there but you still can't delete - I'd look at how the disk is formatted. APFS is my recommendation; exFAT has its place if you also need Windoze compatibility but I don't personally use it. NTFS is right out - copy data to a different disk & re-format.

DPP is listed under both Full Disk Access as well as under Files & Folders. With "Full Disk Access" enabled DPP is greyed out in "Files and Folders" saying "full disk access". I tried turning off Full Disk Access and then folders and externals are listed under "Files and Folders" and enabled but it makes no difference.

The external disk is APFS formatted.

 

[bogdanw]

Close DPP, remove it from Full Disk Access, then add it again.

Another thing you can try, reset all permissions for Full Disk Access from Terminal:

tccutil reset SystemPolicyAllFiles

 

[Levina]

Close DPP, remove it from Full Disk Access, then add it again.

Another thing you can try, reset all permissions for Full Disk Access from Terminal:

tccutil reset SystemPolicyAllFiles

Did both. Made no difference.

I'm going to try with a few other externals.

 

[Levina]

Well now, this is weird. I tried another external disk and I could delete a file from within DPP just fine. No permission needed.

So what is different between the two disks?

#1 WD Black SN850X 4TB in an Acasis TBU405M1 case (the problematic one)
#2 Samsung SSD 970 EVO Plus 2 TB in an Acasis TBU401E case

Both APFS formatted.

I'm getting a new warning now. I removed the disks the way I have since, oh I don't know, since I was born? But the system now tells me that the disk was not correctly removed (which one? I removed two). Then it says I should use "VM, Recovery" and "Preboot" before disconnecting or turning it off. What the hell?

 

[Fishrrman]

Try this trick that may help with permissions problems.

Connect the"problem drive".
Let the drive icon mount on the desktop.
Click on the drive icon ONE time to select it, then bring up the "get info" box (you can type "command-i").
At the bottom of get info, click the lock and enter your administrative password.
Put a checkmark into "ignore ownership on this volume".
Close get info.

Now try things again.
No promises.

 

[Levina]

Try this trick that may help with permissions problems.

Connect the"problem drive".
Let the drive icon mount on the desktop.
Click on the drive icon ONE time to select it, then bring up the "get info" box (you can type "command-i").
At the bottom of get info, click the lock and enter your administrative password.
Put a checkmark into "ignore ownership on this volume".
Close get info.

Now try things again.
No promises.

Unfortunately that didn't work either.

 

[M4th]

I don't know if this different issue with the same enclosure sheds any light on what the OP is experiencing?

 

[MarkC426]

This is freaky, I had this same issue at the weekend (couldn’t delete from external drive)…. 🤪

This solution fixed it for me (the automation setting)

Unable to delete rejected images in DPP on macos

I had been using DPP to cull images on my Windows laptop which was working as expected. However, I have a new Macbook Pro laptop and have loaded DPP. I review my images in Quick View and tag all rejected images. Then I highlight all rejected images and press CMD/Delete to delete all rejected...

community.usa.canon.com

 

[Levina]

I don't know if this different issue with the same enclosure sheds any light on what the OP is experiencing?

It's the same SSD and enclosure for sure. But I have never experienced problems like the person on the Apple community describes. It also doesn't get hot. That is so strange about this, it all worked perfectly fine - not even the slightest hiccup - until I updated to Sequoia. It could still be the SSD or the enclosure or the combo of course, something that doesn't agree with Sequoia.

This is freaky, I had this same issue at the weekend (couldn’t delete from external drive)…. 🤪

This solution fixed it for me (the automation setting)

Unable to delete rejected images in DPP on macos

I had been using DPP to cull images on my Windows laptop which was working as expected. However, I have a new Macbook Pro laptop and have loaded DPP. I review my images in Quick View and tag all rejected images. Then I highlight all rejected images and press CMD/Delete to delete all rejected...

community.usa.canon.com

I had that already enabled so it didn't fix it for me.

 

[bogdanw]

You could disable SIP, see if it works, then re-enable it.

Disabling and Enabling System Integrity Protection | Apple Developer Documentation

Disable system protections only temporarily during development to test drivers, kernel extensions, and other low-level code.

developer.apple.com

 

[MarkC426]

That is so strange about this, it all worked perfectly fine - not even the slightest hiccup - until I updated to Sequoia.

I am still on Sonoma, so it could be a Sequoia issue…. 🤔

 

[MayflyMaven]

My money was on "disabling ownership" to fix the issue. ¯\_(ツ)_/¯

Unfortunately that didn't work either.

It sounds like ownership was enabled initially though (which is not the default setting for an external volume). It sure seems like it is still a permissions issue, although possibly specific to the Canon software. Do you get the same prompt to authenticate when you delete the file manually from the external volume?

I'm getting a new warning now. I removed the disks the way I have since, oh I don't know, since I was born? But the system now tells me that the disk was not correctly removed (which one? I removed two). Then it says I should use "VM, Recovery" and "Preboot" before disconnecting or turning it off. What the hell?

Sounds like you have (or had) an APFS volume group in this APFS container, i.e. a volume had an installation of macOS. Those APFS helper volumes aren't usually mounted, but when they are, they're hidden so you wouldn't know that you need to unmount them first. I remember seeing these "disk not ejected properly" warnings way back in the day on Catalina, but assumed Apple had sorted it out since then. It's harmless, just annoying.

All of this begs the question – is the (external) volume that holds your Canon library a volume group member? If it is, it's possible that Canon's software just doesn't handle it well. Or perhaps if the volume is an "orphaned" group member, maybe that's the scenario that Canon doesn't handle well. Maybe this is a shot in the dark, but you can run a Terminal command to see if there are some old System remnants on your external volume:

ls -laO "/Volumes/Your Volume Name Here"

If you see items in the listing that you don't see in the Finder (like Volumes, etc, bin, cores), and especially if you see flags like "restricted", then the volume is probably "tainted" with some old OS installation. In that case I'd copy the data off of it to a new volume, then delete the original volume, then see if Canon has any trouble managing photos on that volume.

 

[Levina]

My money was on "disabling ownership" to fix the issue. ¯\_(ツ)_/¯


It sounds like ownership was enabled initially though (which is not the default setting for an external volume). It sure seems like it is still a permissions issue, although possibly specific to the Canon software. Do you get the same prompt to authenticate when you delete the file manually from the external volume?

No, that's so strange, I was expecting that but nope, it just deletes.

Sounds like you have (or had) an APFS volume group in this APFS container, i.e. a volume had an installation of macOS. Those APFS helper volumes aren't usually mounted, but when they are, they're hidden so you wouldn't know that you need to unmount them first. I remember seeing these "disk not ejected properly" warnings way back in the day on Catalina, but assumed Apple had sorted it out since then. It's harmless, just annoying.

👍

All of this begs the question – is the (external) volume that holds your Canon library a volume group member? If it is, it's possible that Canon's software just doesn't handle it well. Or perhaps if the volume is an "orphaned" group member, maybe that's the scenario that Canon doesn't handle well.

Here's a screenshot of Disk Utility with all the drives and their volumes. The selected one is the problematic external.

Both externals are APFS formatted so why the 4TB has the two volumes and the 2TB doesn't I'm sure I don't know. What I do know is that the 2TB is older, was formatted on the Mac Pro a couple of years ago whereas the 4TB I bought last year and was formatted on the Mac Mini M2pro. Maybe I should reformat the 4TB on the Mac Pro too...

By the way, that greyed out volume under Macintosh HD volumes says "systeemmomentopname geactiveerd" which in English would be something like a System Snapshot. The volume inside that says APFS startup snapshot (or whatever it is exactly in English).

I'm guessing this is a APFS feature and normal?

Going back on topic:

Maybe this is a shot in the dark, but you can run a Terminal command to see if there are some old System remnants on your external volume:

ls -laO "/Volumes/Your Volume Name Here"

If you see items in the listing that you don't see in the Finder (like Volumes, etc, bin, cores), and especially if you see flags like "restricted", then the volume is probably "tainted" with some old OS installation. In that case I'd copy the data off of it to a new volume, then delete the original volume, then see if Canon has any trouble managing photos on that volume.

I ran the command for both external drives and both show hidden and restricted items. But isn't that normal? I mean the Library is hidden and some features are restricted, no?

#1 = the problem disk:

#2 = the one without the problem:

I agree that probably the best solution would be to just erase the problematic disk and reinstall, see if the problem goes away.

You could disable SIP, see if it works, then re-enable it.

Disabling and Enabling System Integrity Protection | Apple Developer Documentation

Disable system protections only temporarily during development to test drivers, kernel extensions, and other low-level code.

developer.apple.com

That's something to try. I will do that later today. Thanks!

 

[Fishrrman]

Some questions:

How big is the photo library on the external drive?

Do you have ANOTHER external drive around that could hold it?

I was going to suggest something to try (moving library to another drive, that is formatted to HFS+ instead of APFS), but this only works if you have another drive that can hold the library...

 

[MayflyMaven]

I'm guessing this is a APFS feature and normal?

Yes, the startup disk is a "volume group" composed of a System volume and a Data volume. The System volume is read-only, and typically not mounted. Instead, a snapshot of the System volume is mounted on startup and the Mac boots from that. Apple introduced volume groups in Catalina, and then the "Signed System Volume" in Big Sur.

I ran the command for both external drives and both show hidden and restricted items. But isn't that normal? I mean the Library is hidden and some features are restricted, no?

That layout is normal for the startup disk, but not for a volume that you use just for storing photos. Granted, I don't know what you use these volumes for – they look like copies of the startup disk; are (or were) you using them as bootable external devices too?

The NVMe2TB volume is an "orphaned" Data volume – the associated System volume was deleted. That's perfectly fine, but there is a lot of system "noise" left behind on the Data volume that you may not need (unless that's a backup of your startup disk).

I agree that probably the best solution would be to just erase the problematic disk and reinstall, see if the problem goes away.

If you don't use the WDBlack4TB volume as bootable device, then it would probably be best to delete the System volume from that group. That would make it comparable to the NVMe2TB volume, and perhaps that would be enough to get Canon DPP to play nice with it.

Bigger-picture, though, if you use these two devices for making backups of your startup disk and for storing photos (i.e. photos that are not stored on the startup disk), I'd separate those two use cases on the external disks. Add volumes to each disk that you can use for photo storage, then use the NVMe2TB and WDBlack4TB volumes for the backup of your startup disk. You can add volumes in Disk Utility, e.g.:

- Select WDBlack4TB in the sidebar
- Click "+" in the toolbar to add a new volume

Then migrate your photos to the new volume, then delete the photos from the WDBlack4TB volume (to avoid any confusion about which copy is the one you're supposed to be working from).

APFS volumes share space on the underlying storage device, so it's more flexible than partitioning, but it gives you that same level of organizational "purity" if you're using the storage for multiple different purposes.