LiDAR for 3D Capture

Enterprise

Peek.us

2023

Peek.us, 2024

Role

Lead/sole

Designer

Lead/Sole Designer

Type

Mobile -

iOS app

Web app - Mobile

Background

A property’s virtual tour is created by capturing images of the space and stitching them together to produce a 360-degree image.

Problem

Virtual tours are not being created quickly enough; scanning a new property can take over a month. The efficiency of the scanning process within the scanner-facing application needs to be improved.

Pain Points

After capturing each room, scanners must connect "markers" to all visible entryways by selecting or creating new rooms. This repetitive and tedious process is time-consuming and prone to human error, especially in units with more than two bedrooms.

Discovery

Apple's LiDAR roomplan API can scan an entire unit and create a 3D model. Captured images are layered on top of this model on the backend, automatically connecting rooms to create a complete 3D image.

Stage 1

Identify Constraints

LiDAR struggles with outdoor scanning, so amenities will need to be scanned using the current flow method.
LiDAR performs best with single-story homes.
LiDAR is compatible only with iPhone 12 Pro and newer models.

Stage 1

Identify Constraints

LiDAR struggles with outdoor scanning, so amenities will need to be scanned using the current flow method.
LiDAR performs best with single-story homes.
LiDAR is compatible only with iPhone 12 Pro and newer models.

Stage 1

Identify Constraints

LiDAR struggles with outdoor scanning, so amenities will need to be scanned using the current flow method.
LiDAR performs best with single-story homes.
LiDAR is compatible only with iPhone 12 Pro and newer models.

Stage 2

Set Success Metrics

Scanners need to be re-trained
Engineer development is extensive and require a lot of discovery and customization, leaving room for bugs
A small number of customers who self scan their properties might be opposed to the change as they have to retrain their internal team

Stage 2

Set Success Metrics

Scanners need to be re-trained
Engineer development is extensive and require a lot of discovery and customization, leaving room for bugs
A small number of customers who self scan their properties might be opposed to the change as they have to retrain their internal team

Stage 2

Set Success Metrics

Scanners need to be re-trained
Engineer development is extensive and require a lot of discovery and customization, leaving room for bugs
A small number of customers who self scan their properties might be opposed to the change as they have to retrain their internal team

Stage 3

Value Proposition

Significant difference in speed of scanning a unit and by extension a property
Streamlined scanner onboarding process
Reduced skips of requested units to be captured
Less human input errors and higher quality scans published

Stage 3

Value Proposition

Significant difference in speed of scanning a unit and by extension a property
Streamlined scanner onboarding process
Reduced skips of requested units to be captured
Less human input errors and higher quality scans published

Stage 3

Value Proposition

Significant difference in speed of scanning a unit and by extension a property
Streamlined scanner onboarding process
Reduced skips of requested units to be captured
Less human input errors and higher quality scans published

Execution

The Approach

Go through engineering team’s documentation

Roleplay as a scanner onsite

Ideation: User flow

Validate iOS requirements

On-site user testing

List technical requirements

List pain points & on field constraints

Wireframes and mockups

Flow test with props (camera, tripod, etc)

Finalize handoff file

Execution

The Flow

When a scanner uses an iPhone 12 or a later model, the LiDAR flow branches off from the initial singular flow of the scanner application once they select a unit to scan. If they choose an amenity or a unit that is not optimal for the LiDAR feature, they will be redirected to the current flow.

Final Designs

The Product

Step 1

Start Scanning

Scanners will begin the LiDAR flow upon selecting a property and unit to capture.

The RoomPlan API is customized to Peek's branding and functionality needs

A satisfactory 3D model will then be exported to create a top-down 2D image ready for use.

Step 1

Start Scanning

Scanners will begin the LiDAR flow upon selecting a property and unit to capture.

The RoomPlan API is customized to Peek's branding and functionality needs

A satisfactory 3D model will then be exported to create a top-down 2D image ready for use.

Step 2

Mark Camera Placement

To layer 360 images onto the 3D model, scanners must place a marker in the room where the camera is set up to capture.

Scanners cannot proceed to the next screen until a marker is placed.

Markers cannot be placed on walls or surfaces.

Step 2

Mark Camera Placement

To layer 360 images onto the 3D model, scanners must place a marker in the room where the camera is set up to capture.

Scanners cannot proceed to the next screen until a marker is placed.

Markers cannot be placed on walls or surfaces.

Step 3

Orient and Capture

Lastly, to automatically stitch 360 images into a cohesive virtual tour scanners must orient their camera as directed on the screen.

For ease of use and familiarity, the orientation will be consistent (north) within the floorplan.

Once oriented, the unit is ready for capture and labeling.

Lastly, to automatically stitch 360 images into a cohesive virtual tour scanners must orient their camera as directed on the screen.

For ease of use and familiarity, the orientation will be consistent (north) within the floorplan.

Once oriented, the unit is ready for capture and labeling.

Back to top

Darlene Tjahjo

Portfolio Site

Enterprise Projects

Contact

About

About Me

Darlene Tjahjo

Portfolio Site

Enterprise Projects

Contact

About

About Me

Darlene Tjahjo

Portfolio Site

Enterprise Projects

Contact

About

About Me