Camera Prototyping - Synthesis AI

Virtual Camera Prototyping

Iterating on camera system design is a lengthy process if you have to collect data from real hardware for each iteration. Instead, our synthetic data platform enables you to understand model performance trade-offs in software. Simulate camera placement, image modality, resolution, and more to inform the overall design of your computer vision system–all without touching a single wire.

Near Infrared Dataset

Systems with night vision, start here

Landmarks Dataset

The gamut of camera placements

Harsh Lighting Dataset

Handle edge cases in bright and dark light

Programmatic API

Fully customizable data for augmentation

The NIR dataset pairs near infrared images with their RGB counterparts so you can test how models would do in darkly-lit scenarios.

View Dataset

Crafted with facial landmarks in 3D across the spectrum of facial expressions, you’ll have the data your application needs.

View Dataset

The harsh lightning dataset lets you handle your poor lighting edge-cases with glare, spotlights, night time, and backlit images.

View Dataset

Our Face API lets you specify exactly the parameters you need, generating millions of images with unique people, environments, and camera settings.

Learn about our API

100x Cheaper.
1000x Faster Turnaround.

The average amount spent on single image for full-segmentation is $6.40* – any additional labels cost more above and beyond that. Our synthetic data provides full-segmentation, landmarks, surface normals, and more – for as little as $0.03 per image.

Of course, that’s only the labeling cost. Procuring the images to label is incredibly time-consuming as well. It can take weeks or months to legally collect diverse images of individuals’ faces for most companies. Our datasets are available immediately, and our programmatic API returns generated images and labels in minutes to hours.

*Based on scale.ai pricing, January 2021.

Pixel-Perfect Accuracy

100% accurate ground truth–every time. Eliminate your QA step on every label.

Privacy-First

Get peace of mind: with non-real humans, privacy concerns are history.

Less Bias

Even sampling across skin tones, ethnicities, and ages, for more ethical machine vision.

New Label Types

Use cutting edge models with depth, normals, dense 3D landmarks, & subsegmentation.

Broader Distributions

Combine identities, hair styles, facial hair, makeup, hats, glasses, face masks, lighting conditions, and camera angles for trillions of possibilities – all at the speed of writing JSON with our API.

from face_api_dataset import FaceApiDataset, Modality
dataset = FaceApiDataset("test_dataset")
item = dataset[0]

plt.figure(figsize=(20,20))
plt.imshow(item[Modality.RGB])

plt.figure(figsize=(20,20))
landmark_show(item[Modality.RGB], item[Modality.LANDMARKS])

View in colab View in GitHub

Adaptive Batch Normalization

Adaptive Batch Normalization is a simple technique, can be easily applied to any network with batch normalization layers, and combined with all other techniques for surprisingly good results.

Revisiting Batch Normalization For Practical Domain Adaptation. Domain-Specific Batch Normalization for Unsupervised Domain Adaptation. Official Implementation of “Domain Specific Batch Normalization for Unsupervised Domain Adaptation (CVPR2019)”.

Adversarial Domain Adaptation

Adversarial domain adaptation and its modifications for particular tasks usually result in strong improvement. The downside is that it typically requires heavy pipeline modifications.

Domain-Adversarial Training of Neural Networks. Alleviating Semantic-level Shift: A Semi-supervised Domain Adaptation Method for Semantic Segmentation. A collection of implementations of adversarial domain adaptation algorithms.

Refinement

Image-2-image translation methods coupled with self-regularization loss allows dataset-level refinement. While these methods require additional pipeline to train, it is completely independent and does not require modifications of the main training pipeline.

Contrastive Learning for Unpaired Image-to-Image Translation. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. Learning from Simulated and Unsupervised Images through Adversarial Training. Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch).

Combined methods

For the best results all the methods above typically should be combined together.

CyCADA: Cycle-Consistent Adversarial Domain Adaptation. Code to accompany ICML 2018 paper.

Scales out of the box

Our technology seamlessly scales in the cloud with our customers’ demands, from R&D phases with small amounts of data to production requirements of terabytes of data.

With everything available via an API, we integrate seamlessly with your workflows from day 1.

Learn More about our API

Learn More about our API

Machine Learning Development Support

If your team needs a little more machine learning muscle, our experts are ready to jump in. We’ll help reduce your time to market, so don’t hesitate to reach out.