Kind of an off topic question, but I guess your contacts need to have a photo so the Photos app can scan and match from it, right? Thanks in advance.
I don't use or assign contact photos at all. My iPhone photo library already had faces assigned that I'd done in OS X photos app and they persisted after upgrading to iOS 10