In a Finder window it says the folder name at the top of the window. Can you still Cmd-click that Folder name to see the path of where it is?
Yes, you can, but the proxy icon doesn't appear until you hover over the window title so it's not discoverable at all.