Human Generated Data

Title

Untitled (portrait of young girls standing with boy in living room)

Date

1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4198

Human Generated Data

Title

Untitled (portrait of young girls standing with boy in living room)

People

Artist: Durette Studio, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.6
Clothing 99.6
Human 99.1
Person 99.1
Person 98
Person 97.9
Person 97.9
Person 97.9
Person 97.2
Person 97
Person 96.7
Dress 96.7
Person 95.2
Person 94.7
Person 94.5
Robe 85.3
Fashion 85.3
Female 82.9
Overcoat 82.2
Suit 82.2
Coat 82.2
Gown 80.9
People 78.2
Face 77.7
Costume 72.9
Sailor Suit 71.3
Wedding 69.1
Person 62.1
Girl 61.1
Woman 61.1
Wedding Gown 60.6
Indoors 60.2
Evening Dress 58.5

Clarifai
created on 2019-06-01

people 99.8
group 98.9
child 98.6
group together 96.2
woman 95.7
adult 93
man 92.4
wear 89.9
son 87.6
family 87.2
wedding 87.2
many 85.4
boy 84.7
offspring 84.3
several 84
dress 83.4
monochrome 79.9
facial expression 77.4
portrait 75.6
enjoyment 75

Imagga
created on 2019-06-01

dance 36.9
person 30
people 27.9
art 27.5
fashion 27.1
dress 25.3
adult 22.6
model 22.5
creation 21.1
attractive 19.6
bride 19.6
style 19.3
pretty 18.9
sexy 18.5
women 18.2
portrait 17.5
kin 16.8
clothing 16.7
hair 16.6
body 16
happiness 15.7
happy 15.7
elegance 15.1
posing 15.1
lady 14.6
cute 14.3
smile 14.2
wedding 13.8
pose 13.6
face 13.5
blond 13.3
brunette 13.1
studio 12.9
dinner dress 12.7
sensual 12.7
love 12.6
male 12
human 12
marriage 11.4
boutique 10.6
dancer 10.6
planner 10.4
black 10.2
culture 9.4
outdoor 9.2
traditional 9.1
girls 9.1
make 9.1
summer 9
cheerful 8.9
child 8.8
celebration 8.8
ceremony 8.7
smiling 8.7
hairstyle 8.6
elegant 8.6
clothes 8.4
performer 8.3
long 8.3
sensuality 8.2
costume 8
statue 7.9
couple 7.8
veil 7.8
standing 7.8
dressed 7.8
color 7.8
bridal 7.8
men 7.7
youth 7.7
old 7.7
charming 7.6
joy 7.5
man 7.5
figure 7.4
decoration 7.3
group 7.2
gorgeous 7.2
stylish 7.2

Google
created on 2019-06-01

Photograph 97.2
People 95.2
Social group 89.8
Standing 84.8
Snapshot 82.5
Family 68.7
Team 67.7
History 67.6
Vintage clothing 57
Black-and-white 56.4
Crew 54.9
Uniform 52.8

Microsoft
created on 2019-06-01

posing 99
person 97.2
clothing 95.8
group 91.9
standing 84.4
smile 65
old 49.3
team 32.8
clothes 18

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Happy 51.3%
Disgusted 45.5%
Angry 45.4%
Surprised 45.7%
Sad 45.8%
Calm 45.8%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 93.2%
Calm 18.5%
Disgusted 1.7%
Confused 4%
Surprised 3.8%
Happy 63.9%
Sad 5.6%
Angry 2.5%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Confused 45.7%
Angry 45.5%
Sad 46.3%
Calm 50.2%
Disgusted 45.2%
Happy 46%
Surprised 46%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 54.1%
Surprised 45.2%
Calm 45.2%
Sad 45.2%
Disgusted 45.1%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Angry 45.3%
Sad 45.7%
Surprised 45.3%
Happy 45.5%
Calm 52.2%
Disgusted 45.2%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Male, 61.4%
Happy 87.9%
Confused 1.4%
Disgusted 1.4%
Sad 3.1%
Calm 2%
Angry 2%
Surprised 2.3%

AWS Rekognition

Age 23-38
Gender Male, 53%
Angry 45.6%
Sad 46.1%
Happy 51.1%
Calm 46.1%
Confused 45.4%
Disgusted 45.3%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Surprised 45.5%
Calm 48.4%
Disgusted 45.2%
Confused 45.5%
Sad 46.1%
Happy 49.1%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 45.1%
Calm 52.3%
Confused 45.2%
Sad 45.5%
Surprised 45.3%
Angry 45.3%
Happy 46.3%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Angry 45.4%
Surprised 45.7%
Calm 46%
Sad 46.6%
Confused 45.4%
Disgusted 45.2%
Happy 50.7%

AWS Rekognition

Age 23-38
Gender Female, 54%
Confused 45%
Sad 45.1%
Calm 45%
Happy 54.6%
Surprised 45.1%
Disgusted 45%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Happy 49.6%
Calm 50.2%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.6%

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people posing for a photo 97.4%
a group of people posing for the camera 97.3%
a group of people posing for a picture 97.2%