Object Capture API is the killer feature of macOS Monterey

[phobos]

The past few days I've been playing around with Object Capture, Apple's photogrammetry API. It's easily one of the best features of Monterey. It's super capable and I'm very happy with the results I'm getting. It looks like Apple knocked it out of the park! Not only it works flawlessly but you're also not limited to low res/ low detail 3D objects. If you shoot appropriately detailed images it will stitch everything up to give you a detailed mesh.

The objects on the image below were scanned with PhotoCatch which is a small little app using Apple's API.

 

[ranjan2001]

Whats the use of this app & the output?
If I understand correctly it creates depth map for the 2d images?

 

[phobos]

It actually does something better! It creates a 3D object out of series of photographs. The technique is called photogrammetry and this is the API provided by Apple.

 

[ranjan2001]

It actually does something better! It creates a 3D object out of series of photographs. The technique is called photogrammetry and this is the API provided by Apple.

Looks interesting after reading it here
https://arpost.co/2021/07/19/photocatch-3d-scanning-app-photos-ar-objects/

I will try once Monterey is out of beta & rolled to public.

 

[phobos]

I also made a youtube video about it where I'm going through the process of how to shoot photos for photogrammetry, in case you're interested.

 

[ranjan2001]

Is there a way to share these 3D as a video on Instagram or facebook?
I see this can be good use for product catalogs but as of now it needs a specific hosting page to view these 3D interactive files.

 

[phobos]

Facebook has the ability to share these 3d files files through glTF but I don't believe instagram allows that.

Meta for Developers

Today we're rolling out support for the industry-standard glTF 2.0 file format for Facebook 3D posts. This means artists and creators can easily share...

developers.facebook.com

 

[ranjan2001]

Facebook has the ability to share these 3d files files through glTF but I don't believe instagram allows that.

Meta for Developers

Today we're rolling out support for the industry-standard glTF 2.0 file format for Facebook 3D posts. This means artists and creators can easily share...

developers.facebook.com

Thanks I am going to try this for sure, very interesting tech.