Human Generated Data

Title

Untitled (two photographs: group portrait of nineteen member family posed in front of fireplace; double portrait of baby boy and baby girl sitting in large chair)

Date

1930-1945, printed later

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Human Generated Data

Title

Untitled (two photographs: group portrait of nineteen member family posed in front of fireplace; double portrait of baby boy and baby girl sitting in large chair)

People

Artist: Martin Schweig, American 20th century

Date

1930-1945, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon

Person 99.6
Human 99.6
Person 99.4
Person 99.3
Person 98.5
Person 97.2
Collage 97.1
Advertisement 97.1
Person 96.8
Person 96.5
Person 93.4
Person 92.7
Tie 92.2
Accessories 92.2
Accessory 92.2
Person 90.8
Person 88
Person 86.2
Furniture 85.6
Person 76.3
Figurine 74.6
Baby 66.6
Person 65
Person 60.9
Newborn 57.6
Person 53.8
Poster 52.8

Clarifai

people 100
group 99.8
adult 99.5
furniture 99.3
many 99.2
woman 98.5
child 98.5
seat 97.7
portrait 97.4
leader 97.1
group together 97
sit 97
facial expression 96.8
actress 96.4
wear 96.3
offspring 96.2
man 95.6
outfit 94.6
several 94.5
administration 94.3

Imagga

child 18.8
happy 17.5
window 17.1
furniture 16.7
people 16.7
black 16.3
portrait 15.5
face 14.9
dress 13.5
smile 13.5
family 13.3
doll 13.3
person 13.2
cute 12.9
plaything 12.6
adult 12.3
love 11.8
happiness 11.7
vintage 11.7
design 11.4
fashion 11.3
boy 11.3
smiling 10.8
man 10.7
case 10.6
bride 10.5
shop 10.5
sexy 10.4
hair 10.3
expression 10.2
furnishing 10
toyshop 10
color 10
kin 9.9
pretty 9.8
style 9.6
frame 9.6
flowers 9.6
container 9.5
women 9.5
holiday 9.3
clothing 9.3
art 9.1
kid 8.9
office 8.8
china cabinet 8.7
couple 8.7
cabinet 8.6
male 8.5
wedding 8.3
decoration 8.2
one 8.2
hat 8.2
girls 8.2
refrigerator 8.2
lady 8.1
new 8.1
home 8
colorful 7.9
model 7.8
eyes 7.7
party 7.7
toy 7.7
old 7.7
mercantile establishment 7.6
elegance 7.6
human 7.5
children 7.3
celebration 7.2
religion 7.2
childhood 7.2
interior 7.1
framework 7

Microsoft

clothing 98.3
person 97.8
text 92.4
human face 91.1
baby 79.3
gallery 74.6
white 70.5
black and white 69.7
posing 68.1
man 66.5
woman 59.7
toddler 56
child 55.4
different 43.9
room 43.2
picture frame 9.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 86.9%
Fear 2.1%
Surprised 1.3%
Angry 6%
Calm 34.5%
Sad 46.4%
Happy 0.7%
Disgusted 0.8%
Confused 8.4%

AWS Rekognition

Age 0-3
Gender Female, 52.6%
Sad 45%
Surprised 45%
Angry 45%
Confused 45%
Fear 45%
Happy 52.6%
Calm 47.2%
Disgusted 45%

AWS Rekognition

Age 6-16
Gender Female, 55%
Angry 45%
Confused 45%
Disgusted 45%
Happy 46.1%
Sad 45%
Fear 45%
Calm 53.7%
Surprised 45%

AWS Rekognition

Age 21-33
Gender Female, 55%
Disgusted 45%
Happy 45.6%
Angry 45%
Confused 45%
Calm 54.2%
Fear 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 0-3
Gender Male, 53.2%
Happy 45%
Fear 45.2%
Disgusted 45%
Angry 45.1%
Surprised 45%
Sad 54.6%
Confused 45%
Calm 45%

AWS Rekognition

Age 23-35
Gender Male, 53.2%
Happy 46.6%
Fear 45%
Disgusted 45%
Angry 45%
Surprised 45%
Sad 45%
Confused 45%
Calm 53.3%

AWS Rekognition

Age 23-37
Gender Male, 54.3%
Disgusted 45.1%
Sad 45.1%
Calm 53.2%
Fear 45%
Happy 45.1%
Confused 45%
Angry 46.3%
Surprised 45.1%

AWS Rekognition

Age 4-12
Gender Female, 51.2%
Surprised 45.1%
Fear 45.8%
Happy 45.1%
Sad 50%
Calm 47.8%
Disgusted 45.1%
Angry 45.4%
Confused 45.5%

AWS Rekognition

Age 31-47
Gender Male, 54.1%
Surprised 45%
Disgusted 45%
Happy 45%
Sad 45.4%
Calm 52.2%
Confused 45.1%
Fear 45%
Angry 47.1%

AWS Rekognition

Age 8-18
Gender Female, 54.3%
Calm 48.7%
Surprised 45.3%
Angry 45.5%
Confused 45.3%
Happy 48.7%
Fear 45.2%
Sad 46%
Disgusted 45.3%

AWS Rekognition

Age 12-22
Gender Female, 53.9%
Fear 45%
Disgusted 45%
Calm 54.9%
Angry 45%
Sad 45%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 32-48
Gender Female, 54.6%
Calm 54.6%
Sad 45.1%
Happy 45%
Angry 45.1%
Fear 45%
Surprised 45%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 31-47
Gender Female, 54.5%
Surprised 45.1%
Happy 45.1%
Confused 45.4%
Sad 48%
Angry 45.6%
Fear 45.1%
Disgusted 45.4%
Calm 50.4%

AWS Rekognition

Age 5-15
Gender Female, 54.5%
Disgusted 45%
Surprised 45%
Happy 45.1%
Sad 45.4%
Angry 45.2%
Fear 45%
Calm 54.2%
Confused 45%

AWS Rekognition

Age 15-27
Gender Female, 54.6%
Surprised 45.2%
Happy 45.1%
Confused 45.9%
Sad 47.2%
Angry 45.4%
Fear 45.2%
Disgusted 45.4%
Calm 50.7%

AWS Rekognition

Age 1-7
Gender Female, 53.9%
Fear 45%
Sad 45%
Disgusted 45%
Happy 54.7%
Angry 45.1%
Calm 45%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 47-65
Gender Female, 54.9%
Happy 52.4%
Confused 45.1%
Calm 47.2%
Fear 45%
Angry 45.1%
Surprised 45%
Disgusted 45.1%
Sad 45.1%

AWS Rekognition

Age 49-67
Gender Male, 54.7%
Disgusted 45%
Confused 45%
Angry 54.7%
Sad 45.2%
Happy 45%
Surprised 45%
Calm 45.1%
Fear 45%

AWS Rekognition

Age 12-22
Gender Female, 53.5%
Calm 50.4%
Disgusted 45%
Happy 45%
Fear 45%
Surprised 45%
Sad 49.3%
Confused 45%
Angry 45.2%

AWS Rekognition

Age 12-22
Gender Female, 53.6%
Confused 45%
Calm 54.5%
Surprised 45.1%
Fear 45%
Happy 45.1%
Angry 45.2%
Sad 45.1%
Disgusted 45%

AWS Rekognition

Age 28-44
Gender Male, 54.9%
Sad 45.1%
Calm 54.5%
Angry 45%
Fear 45%
Happy 45.2%
Confused 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 5-15
Gender Female, 54.3%
Confused 45%
Surprised 45%
Calm 54.8%
Fear 45%
Disgusted 45%
Happy 45%
Sad 45.1%
Angry 45%

AWS Rekognition

Age 26-42
Gender Female, 54.6%
Disgusted 45.2%
Happy 45.4%
Confused 45.3%
Angry 45.4%
Fear 45.1%
Sad 45.1%
Calm 53.1%
Surprised 45.4%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 92.2%
Poster 52.8%

Captions

Microsoft

a group of people posing for a photo 60.1%
a group of people posing for a photo in front of a window 52.3%
a group of people posing for the camera 52.2%

Text analysis

Amazon

A
00ve9erh

Google

MJIR
3TARTI
MJIR 3TARTI