How it works

The app tries to imitate how humans would rate attractiveness. It uses machine learning and computer algorithms to calculates attractiveness scores from images.

Architecture

The app consists of three components: a face extractor component and 2 Neural Networks of which one predicts age and gender and the other one estimates attractiveness.

attractiveness test model

Extract Face

The open-source tool OpenCV is used to locate and extract the face. If multiple faces are detected, one is randomly picked (We might improve this in the future). Black bars are added to the sides to make the result a squared image of the size 224 x 224 pixels.

cropped image

Predict Age and Gender

For this component, we created a customized Deep Neural Network, inspired by this open-source project. Output is the estimated age and a label that indicates whether the person is male or female. Our experiments showed that first predicting age and gender improves the accuracy of the attractiveness score.

Predict Attractiveness

This Component is a Deep Neural Network (based on the ResNet architecture). It takes as input the extracted face and previously predicted age and gender to perform the attractiveness prediction.

The model is trained with a dataset consisting of images with faces that are annotated with labels for age, gender and attractiveness score. An optimization algorithm ensures that the model learns to generalize, meaning that it also learns to predict the attractiveness of images that are not part of the dataset (supervised learing).

attractiveness test model accuracy

Statistics

attractiveness test model

This chart shows the results of 100.000 predictions from real people. The average score is 6.0 (std=1.25). See more statistics here.

Check out our attractiveness test

Start the test