How to quickly create 3D assets on your phone for XR prototyping using Polycam

Whether you're building an XR experience to pitch to a client or mocking up a project for internal review, having easy access to accurate 3D assets can significantly speed up the process and make changes much less painful. 

With tools like Polycam, you can capture and create detailed 3D models directly from your smartphone, making the process more accessible and efficient and the ideal solution for proof of concept prototyping. 

This step-by-step guide will walk you through using Polycam to capture a 3D model and quickly integrate it into your XR prototype, including any watch-outs or pitfalls. 

Step One: Choose and Prepare Your Object

Start by selecting the object you want to capture. Set it up in a position where you can easily move around it to take photos. Polycam recommends using a dark background and, if possible, a turntable for smoother captures. However, any plain, high-contrast background works well. If you don't have a turntable, don't worry—just ensure the lighting is even to avoid harsh shadows or bright spots, as these can cause abnormalities in the scan.

Step Two: Open Polycam and Start Capturing

Once your object is ready, open the Polycam app and select the capture mode. You can choose between manual mode, where you take each photo individually, or auto mode, which detects your camera movement and captures images automatically. You'll need to take at least 20 photos but aim for closer to 150 images for the best results. If your object has fine details, consider using the macro mode to capture them clearly.

Step Three: Capture All Angles

Now it's time to take your photos. Make sure to capture the object from all sides and angles to avoid missing any parts in the final model. Without a turntable, you'll need to carefully move the object around after each photo. Remember to capture the top, bottom, and all sides for a complete 3D model.

Step Four: Process Your Images

After you've taken all your photos, select "Done" in the app and choose your processing settings. Polycam offers different capture modes, such as photogrammetry for creating detailed 3D meshes or Gaussian Splat (Pro feature) for translucent objects. You'll also choose the level of detail, ranging from Optimised (small file, less detail) to Raw (large file, most detail). For quick prototyping, Medium detail is often sufficient. If your object has intricate details, consider using the object masking feature to improve the scan quality.

Step Five: Review and Reprocess If Needed

Once your model is processed, you can view and edit it. If you notice any issues, such as missing parts or distortions caused by lighting, Polycam allows you to reprocess the scan. This might involve retaking some images or adjusting the lighting conditions. While the model may not be perfect, especially with a simple setup, it's a good starting point for quick prototyping. For more polished results, consider using a lightbox and turntable or refining the model in a tool like Blender.

Step Six: Export Your 3D Model

Polycam allows you to download your model in several formats. While free accounts are limited to GLTF format, this is a widely supported format, especially for use in XR design tools like Zapworks Designer. GLTF is lightweight and optimised for web and mobile applications, making it an ideal choice for rapid prototyping.

Step Seven: Upload Your 3D Model to Your XR tool of Choice

With your model exported, open your XR tool of choice, for this example, we’re using Zappar’s no-code, drag-and-drop tool, Zapworks Designer. Open your Designer project and upload the 3D asset. You can then scale, move, rotate, and animate the model within your XR scene, just like any other asset. This workflow enables you to quickly mock up a concept, iterate on ideas, and share them with clients or team members without the usual wait time associated with asset creation.

Final Thoughts

With Polycam, you can quickly capture and create detailed 3D models using just your smartphone, streamlining your workflow and enabling rapid iteration. Whether you're working on a client pitch or an internal prototype, having the ability to generate your assets on the fly empowers you to focus on what truly matters: bringing your creative visions to life in XR.

Start creating 3D models for AR using just your smartphone 

Ready to start using Polycam and Designer for your next  XR project? Download the Polycam app for iPhone and Android and start a free 14-day Zapworks trial here.