Human Generated Data

Title

Untitled (formal family portrait outdoors with parents seated and children standing)

Date

c. 1905-1915

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3941

Human Generated Data

Title

Untitled (formal family portrait outdoors with parents seated and children standing)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.9
Clothing 99.9
Person 99.4
Human 99.4
Person 99.2
Person 99.1
Person 98.9
Person 98.8
Person 98.3
Person 98.2
Person 96.4
Person 95.5
Robe 95.3
Fashion 95.3
Gown 94.3
Wedding 90.7
People 86.2
Bridegroom 82.8
Bride 80.6
Face 80.5
Female 79.6
Accessory 72.1
Accessories 72.1
Tie 72.1
Dress 70.4
Sleeve 67.4
Long Sleeve 67.4
Wedding Gown 64.9
Suit 64.1
Overcoat 64.1
Coat 64.1
Woman 61.5
Photography 61.5
Photo 61.5
Portrait 60.9

Clarifai
created on 2019-06-01

people 99.9
group 98.8
group together 98.4
many 98
man 95.5
adult 94.8
several 92.8
wear 90
uniform 88.4
child 85.7
woman 83
military 82.9
war 80.9
leader 80.5
administration 72.9
outfit 72
veil 67.9
portrait 67.4
ceremony 66.3
memory 64.4

Imagga
created on 2019-06-01

nurse 32
brass 26.8
people 26.8
cornet 25.9
person 24.8
wind instrument 22.5
man 19.5
medical 18.5
male 18.4
adult 18.2
professional 17.9
portrait 16.8
coat 15.9
musical instrument 15.7
bride 14.8
clothing 14.5
doctor 14.1
business 12.7
dress 12.6
health 12.5
businessman 12.4
medicine 12.3
hospital 12.3
lab coat 12.1
men 12
human 12
happy 11.9
happiness 11.7
stethoscope 11.5
job 11.5
drawing 11.4
looking 11.2
attractive 11.2
work 11
black 10.8
laboratory 10.6
worker 10.5
wedding 10.1
face 9.9
team 9.8
handsome 9.8
clinic 9.6
healthy 9.4
day 9.4
smile 9.3
elegance 9.2
occupation 9.2
care 9
suit 9
one 9
cheerful 8.9
posing 8.9
office 8.8
art 8.7
women 8.7
old 8.4
pose 8.2
family 8
employee 7.8
hands 7.8
lab 7.8
groom 7.7
golfer 7.7
marriage 7.6
clothes 7.5
gown 7.4
kin 7.4
player 7.3
confident 7.3
uniform 7.2
celebration 7.2
sketch 7.2
working 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

posing 99.5
window 98.4
wedding dress 94
group 92.4
bride 92.1
old 74
black and white 68.9
black 67.1
smile 64.9
wedding 62.1
person 61.7
white 60.6
clothing 60.4
team 53.8
dressed 28.6
clothes 23

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 52.9%
Surprised 45.9%
Sad 45.7%
Angry 46.2%
Disgusted 45.3%
Calm 49.5%
Happy 47.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Sad 46.1%
Angry 45.5%
Disgusted 45.5%
Surprised 45.7%
Happy 46.2%
Calm 50.7%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Disgusted 45.3%
Calm 49%
Sad 48.9%
Confused 45.3%
Angry 45.3%
Surprised 45.5%
Happy 45.7%

AWS Rekognition

Age 38-59
Gender Male, 50%
Confused 45.4%
Disgusted 45.3%
Calm 47.9%
Angry 46.1%
Sad 48.4%
Happy 46.2%
Surprised 45.7%

AWS Rekognition

Age 23-38
Gender Male, 51.6%
Sad 47.5%
Calm 46.9%
Surprised 45.7%
Angry 45.6%
Disgusted 45.8%
Happy 48.2%
Confused 45.3%

AWS Rekognition

Age 27-44
Gender Female, 52.1%
Disgusted 45.2%
Calm 46.2%
Surprised 45.3%
Angry 45.4%
Happy 45.3%
Sad 52.4%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 45.3%
Surprised 45.6%
Calm 51.3%
Sad 45.8%
Confused 45.2%
Disgusted 45.2%
Happy 46.6%

AWS Rekognition

Age 35-52
Gender Male, 52.1%
Surprised 45.7%
Sad 49.9%
Angry 45.5%
Disgusted 45.5%
Calm 46.8%
Happy 46.1%
Confused 45.5%

AWS Rekognition

Age 38-59
Gender Female, 53.7%
Happy 45.6%
Confused 45.5%
Angry 46%
Disgusted 48.8%
Surprised 45.5%
Sad 48%
Calm 45.5%

Feature analysis

Amazon

Person 99.4%
Tie 72.1%
Wedding Gown 64.9%

Captions

Microsoft

a group of people posing for a photo 97.5%
a group of people posing for the camera 97.4%
an old photo of a group of people posing for the camera 96.4%