How it works
The app tries to imitate how humans would rate attractiveness. It uses machine learning and computer algorithms to calculates attractiveness scores from images.
The app consists of three components: a face extractor component and 2 Neural Networks of which one predicts age and gender and the other one estimates attractiveness.
The open-source tool OpenCV is used to locate and extract the face. If multiple faces are detected, one is randomly picked (We might improve this in the future). Black bars are added to the sides to make the result a squared image of the size 224 x 224 pixels.
Predict Age and Gender
For this component, we created a customized Deep Neural Network, inspired by this open-source project. Output is the estimated age and a label that indicates whether the person is male or female. Our experiments showed that first predicting age and gender improves the accuracy of the attractiveness score.
This Component is a Deep Neural Network (based on the ResNet architecture). It takes as input the extracted face and previously predicted age and gender to perform the attractiveness prediction.
The model is trained with a dataset consisting of images with faces that are annotated with labels for age, gender and attractiveness score. An optimization algorithm ensures that the model learns to generalize, meaning that it also learns to predict the attractiveness of images that are not part of the dataset (supervised learing).
This chart shows the results of 100.000 predictions from real people. The average score is 6.0 (std=1.25). See more statistics here.
Check out our attractiveness testStart the test