Optimized Storage reports?

[Feenician]

@Feenician https://forums.macrumors.com/posts/22269003 it's shocking. Someone, somewhere at Apple must be saying "Steve would never have allowed this". Cue the flames …

You know, in general, I'm not a fan of the "Steve would never have allowed this" meme because Apple turned out its fair share of crap under him and it's used inappropriately for almost everything. However, from everything on public record about him its fair to say that had he encountered some of the sloppy dialogs and so on we see in OS X/macOS he would have hit the roof and someone would have been in tears/taking those calls from Google recruiters (delete as applicable, based on the constitution of the dev in question)

With all of that said I've been spending a fair bit of time in CentOS 7 and Windows 10 lately (testing and developing atop one of our platform products) and I also think its fair to say that incorrectly sized dialogs are the least of those OS' usability issue and they generally make me extra grateful when I swipe back to my Sierra Space.

 

[digitalfx]

I selected "optimize storage" before I realized it was removing files from my drive. It was only selected for about 20 minutes

I had 26GB available prior and didn't think it would delete my local files since it states "When storage space is needed" But it did as I now have 71GB free.

How do I identify all the files no longer on my computer in iCloud so I can bulk move them back short of searching every single folder on my desktop and documents?

 

[Brookzy]

I selected "optimize storage" before I realized it was removing files from my drive. It was only selected for about 20 minutes

I had 26GB available prior and didn't think it would delete my local files since it states "When storage space is needed" But it did as I now have 71GB free.

How do I identify all the files no longer on my computer in iCloud so I can bulk move them back short of searching every single folder on my desktop and documents?

I'd assume just turn off Optimize Storage...

 

[digitalfx]

I'd assume just turn off Optimize Storage...

As I said it was only selected for 20 minutes, but the damage is done. My question is how do I find the files that it moved off my hard drive short of going thru every single folder manually?

 

[Brookzy]

As I said it was only selected for 20 minutes, but the damage is done. My question is how do I find the files that it moved off my hard drive short of going thru every single folder manually?

Oh, I thought if you turn it off that after a while your files are downloaded and restored locally.

 

[digitalfx]

Oh, I thought if you turn it off that after a while your files are downloaded and restored locally.

I hope so, it's still uploading. I'll report back if it does. But so far they haven't been restored and I turned it off yesterday. But its still copying files to iCloud

 

[grahamperrin]

@Feenician I added a screenshot to https://forums.macrumors.com/posts/23355235

@digitalfx thanks for joining this topic. The advice that I intended to offer is the same as offered by @Brookzy

 

[digitalfx]

@Feenician I added a screenshot to https://forums.macrumors.com/posts/23355235

@digitalfx thanks for joining this topic. The advice that I intended to offer is the same as offered by @Brookzy

Thanks. I'll be patient then. Im on day 2 and its still uploading to iCloud...going slow.
One other question, why does mine say "Documents" while others lists "Documents and Desktop" see image

 

[Brookzy]

Thanks. I'll be patient then. Im on day 2 and its still uploading to iCloud...going slow.
One other question, why does mine say "Documents" while others lists "Documents and Desktop" see image

Mine says the same.

 

[grahamperrin]

16A313a (not a golden master):

Given that I very recently downloaded more than 2 GB of Desktop and Documents test data that I had entrusted to Apple's service (side note: red alerts for dataloss) I'm puzzled that iCloud Drive reportedly uses less than half of that amount of data.

I imagined that I had disabled Optimize Mac Storage in the iCloud pane of System Preferences but now, I find it enabled. Enabled or not, there's more than enough space on the Sierra volume for everything from Apple's iCloud service.

Hmm. Let's see what happens after I truly disable the optimisation …

 

[digitalfx]

The past 3 days my fans are running 100% of the time and the MBPro is basically unusable. The system is completely unresponsive. I have finally reached 369GB of 369GB on my upload, but its been sitting here for 2 hours now. Hopefully once this upload is complete I will get my computer back...but why is uploading to iCloud monopolizing all the system resources?

 

[grahamperrin]

@digitalfx what percentage of the CPU is used by kernel_task?

What's the model identifier for the Mac?

Hard disk or solid state?

Any peripheral devices?

 

[digitalfx]

@digitalfx what percentage of the CPU is used by kernel_task?

What's the model identifier for the Mac?

Hard disk or solid state?

Any peripheral devices?

Sorry, meant to add that to original post:
MacBookPro11,3
MacBook Pro (Retina, 15-inch, Mid 2014)
2.8 GHz Intel Core i7
16GB RAM
1TB SS Drive

no peripheral devices other than TB to Ethernet adapter, but issue occurred while on WiFi as well
NOTE: Internet is Fiber connected 100/100

 

[digitalfx]

Looks like Photos App is the culprit
photoanalysisd

 

[blasto2236]

As I said it was only selected for 20 minutes, but the damage is done. My question is how do I find the files that it moved off my hard drive short of going thru every single folder manually?

Everything gets saved to your iCloud Drive folder when you turn off desktop/documents sync so I assume the same goes for files offloaded during the "Optimize Storage" process?

 

[blipmusic]

So, while these features seem practical I have to be absolutely sure about optimized storage and Desktop sync before upgrading later on:

1. Is optimized storage optional? (this thread says yes?)
2. Is optimized storage enabled by default? (I hope not)
3. Is iCloud sync (desktop etc) optional? (seems so?)
4. Is iCloud sync (desktop etc) enabled by default? (I hope not)

My personal and work laptops are on the same iCloud account currently (probably shouldn't be), and on my work laptop the desktop usually houses large, very temporary test/work-in-progress files (all backed up in various ways) which I *really* don't want to fight for space on my personal laptop.

Also, this app/service-centric world (rather than a more manual, data-centric world) together with the belief that we always have a connection is somewhere between annoying and catastrophic. I'd much rather get a "not enough disk space" notification before hand and plan/fix accordingly than to find out in the middle of nowhere (a.k.a. "what internet?") that an automated background-process tagged that large file I now desperately need to be a waste of space and had it moved to some server before I left. And that's only the start...

Sorry for the hopefully ignorant rant.

Maybe I've misunderstood how these processes work but I really, really need to be in more manual control of the data I work with (not security related, it's for practical reasons).

 

[Ritsuka]

1. YES
2. NO
3. YES
4. NO

 

[blipmusic]

1. YES
2. NO
3. YES
4. NO

Thanks, exactly what I needed to know!

 

[digitalfx]

Been stuck here for 2 days now...WTF?

 

[grahamperrin]

2. Is optimized storage enabled by default? (I hope not)

NO

With a clean installation I found the optimisation enabled by default after allowing iCloud Drive Desktop and Documents folders. Maybe relevant: it was not a golden master.

 

[digitalfx]

looks like the files "optimized" may be moving back now.

 

[digitalfx]

False Alarm..so far the files lost when I selected "optimize" have not restored. I have been experience odd behavior and processes hogging resources...but I just removed all the start up apps and now performance seems to be back to normal for now. I assume I had a start up app that didn't play well with Sierra.

But...so far none of my files lost during "optimize" have been restored. Actually it appears I lost additional files. Prior to turning on iCloud Drive I only had 30GB free on my drive. After selecting, then subsequently de-selecting "optimize" my storage jumped to 80+ GB free.

Now (after iCloud Drive copy has completed and a reboot) I have 133GB free...and a restore of the missing files doesn't seem to be happening in the background.

OPTIMIZE is deselected

 

[RoboWarriorSr]

Okay I'm on 16A319 and noticing an interesting bug, I'm curious to know if anyone else can replicate this. So when I click on "About this Mac" through the Apple logo, click on the storage tab, and wait for the storage to be identified (from grey to multiple colors) the memory usage sky rockets. I've uploaded a screen shot of the increasing memory.

 

[digitalfx]

WTF is "Purgeable" and how do I get it back?

 

[grahamperrin]

WTF is "Purgeable" and how do I get it back?

If you allow the operating system to purge that data, then you can get it back only if you have a backup.

Or if, for example, you originally used iTunes to download the data: you may re-use iTunes.

Do you, or did you, have any iTunes film or TV programme?

… wait for the storage to be identified … increasing memory.

That may be normal, whilst the data is identified.

… stuck here for 2 days …

iCloud Drive document sync stuck?

Upload of my first test set of data, which began with a relatively early pre-release, seemed to stick repeatedly over a period of weeks.

… files lost when I selected "optimize" have not restored. … processes hogging resources

Take an Activity Monitor view of all process (not just your own). Is kernel_task amongst the hogs?

… OPTIMIZE is deselected …

Try a safe boot followed by a normal boot.