Human Generated Data

Title

Untitled (portrait of couple with dead child in arms)

Date

1938

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4311

Human Generated Data

Title

Untitled (portrait of couple with dead child in arms)

People

Artist: Durette Studio, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.9
Apparel 99.9
Human 97.4
Person 97.4
Person 97.1
Female 95.2
Furniture 92.3
Chair 92.3
Dress 90.2
Woman 87
Fashion 85.7
Robe 85.7
Face 85.6
Gown 82.2
Accessories 79.3
Tie 79.3
Accessory 79.3
Plant 73.7
Portrait 73.4
Photo 73.4
Photography 73.4
Wedding 73.1
People 70.3
Wedding Gown 67.2
Floor 66.7
Bridegroom 62.9
Girl 59.7
Veil 59.2
Flower 57.2
Blossom 57.2
Indoors 56.9
Curtain 56.3
Costume 56.2
Bride 55.7

Clarifai
created on 2019-06-01

people 99.9
man 98.4
adult 98.4
woman 94.5
two 92.6
indoors 92.4
wear 90.2
group 89.4
facial expression 85.9
uniform 81
sit 80.9
veil 80
outfit 79.2
scientist 78.6
medical practitioner 75
wedding 74.9
furniture 74.5
portrait 74.1
chair 73.2
three 71.7

Imagga
created on 2019-06-01

person 35.5
people 34.6
man 28.5
male 25.7
business 25.5
adult 25.4
suit 24.7
portrait 23.3
happy 21.9
pretty 21
attractive 21
professional 20.6
human 20.3
corporate 19.8
businessman 18.5
smiling 17.4
dress 16.3
lady 16.2
negative 16.2
office 16.1
fashion 15.8
one 15.7
model 15.6
smile 15
film 14.8
businesswoman 14.5
sexy 14.5
casual 14.4
work 14.1
men 13.7
lifestyle 13.7
confident 13.7
face 13.5
businesspeople 13.3
holding 13.2
cute 12.9
looking 12.8
black 12.5
clothing 12.5
posing 12.4
formal 12.4
hand 12.2
couple 12.2
hair 11.9
alone 11.9
happiness 11.8
manager 11.2
color 11.1
successful 11
handsome 10.7
job 10.6
modern 10.5
success 10.5
career 10.4
style 10.4
elegant 10.3
art 10.1
indoor 10
photographic paper 10
silhouette 9.9
group 9.7
brunette 9.6
home 9.6
standing 9.6
women 9.5
tie 9.5
executive 9.4
shirt 9.3
studio 9.1
employee 9.1
team 9
cheerful 8.9
worker 8.9
bride 8.9
indoors 8.8
1 8.7
boy 8.3
occupation 8.3
life 8.2
gorgeous 8.2
pose 8.2
jacket 8.1
computer 8
coat 7.9
love 7.9
vertical 7.9
fresh 7.8
hands 7.8
expression 7.7
health 7.6
elegance 7.6
single 7.4
wedding 7.4
20s 7.3
bright 7.2
day 7.1
groom 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

window 95.6
wedding dress 94.2
bride 87.8
clothing 86.5
person 79.9
black and white 69.3
man 62.3
wedding 58.1
smile 55.7

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 70.2%
Sad 15.8%
Angry 24.7%
Happy 9.5%
Confused 2.6%
Calm 31.7%
Surprised 12.9%
Disgusted 2.8%

AWS Rekognition

Age 23-38
Gender Male, 54%
Angry 45.5%
Happy 46.4%
Calm 50.5%
Surprised 46.3%
Sad 45.7%
Confused 45.5%
Disgusted 45.3%

Feature analysis

Amazon

Person 97.4%
Tie 79.3%

Captions

Microsoft

a man standing in front of a window 76%
a man that is standing in front of a window 73.1%
a man standing next to a window 69.1%