Human Generated Data

Title

Untitled (formal family studio portrait of couple and four children)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3776

Human Generated Data

Title

Untitled (formal family studio portrait of couple and four children)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.3
Person 99.3
Person 98.8
Person 98.6
Apparel 98.6
Clothing 98.6
Person 97.8
Person 97.6
Person 96.9
People 94.4
Shorts 88.9
Shoe 83.8
Footwear 83.8
Chair 79.3
Furniture 79.3
Family 78.2
Tie 65.6
Accessory 65.6
Accessories 65.6
Photo 64.8
Portrait 64.8
Face 64.8
Photography 64.8
Kid 63.7
Child 63.7
Female 62.4
Costume 59
Shoe 54.9

Clarifai
created on 2019-06-01

people 99.9
group together 99
adult 98.6
group 98.5
wear 97.2
several 96.8
three 96.7
man 96.7
four 94.1
woman 94
many 92.7
leader 91.8
two 91.5
outfit 89.7
five 89.4
medical practitioner 84.7
sit 83.2
furniture 83
administration 81.5
uniform 79.7

Imagga
created on 2019-06-01

kin 100
people 28.4
couple 27
bride 26.8
groom 24.3
man 23.5
wedding 22.1
love 21.3
happiness 21.1
dress 19.9
male 19.9
married 19.2
person 18.7
adult 18.4
men 17.2
bouquet 17.1
happy 16.9
marriage 16.1
two 16.1
portrait 14.9
world 14.2
wed 13.7
ceremony 13.6
family 13.3
celebration 12.8
women 12.6
bridal 12.6
fashion 12.1
smile 11.4
wife 11.4
flowers 11.3
home 11.2
smiling 10.8
life 10.7
husband 10.7
cheerful 10.6
together 10.5
rose 10.3
flower 10
matrimony 9.8
romance 9.8
mother 9.8
old 9.8
business 9.7
elegance 9.2
face 9.2
traditional 9.1
attractive 9.1
gown 9
history 8.9
lady 8.9
businessman 8.8
lifestyle 8.7
scene 8.7
monument 8.4
room 8.4
church 8.3
new 8.1
romantic 8
art 8
indoors 7.9
veil 7.8
black 7.8
color 7.8
clothing 7.8
party 7.7
culture 7.7
casual 7.6
future 7.4
tradition 7.4
girls 7.3
group 7.3
interior 7.1
day 7.1

Google
created on 2019-06-01

Photograph 97.3
People 93.7
Snapshot 86.7
Photography 62.4
Family 55.3

Microsoft
created on 2019-06-01

wall 98.1
person 96.1
clothing 95.8
smile 83.7
human face 67.4
posing 65.9
woman 55.1
man 53.9
old 50.5
clothes 15.2

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 51.3%
Disgusted 45.2%
Sad 45.4%
Happy 45.3%
Surprised 45.3%
Angry 45.2%
Calm 53.5%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Angry 45.5%
Happy 45.6%
Confused 45.2%
Calm 51.7%
Disgusted 45.3%
Sad 46.5%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 51.7%
Happy 46.7%
Angry 46.2%
Surprised 45.5%
Disgusted 45.3%
Sad 49%
Calm 46.9%
Confused 45.4%

AWS Rekognition

Age 16-27
Gender Male, 53.6%
Calm 52.5%
Disgusted 45.1%
Confused 45.2%
Surprised 45.1%
Happy 45%
Sad 47.1%
Angry 45.1%

AWS Rekognition

Age 19-36
Gender Female, 50.1%
Happy 45.7%
Disgusted 45.4%
Angry 45.8%
Surprised 45.9%
Sad 47.9%
Calm 48.6%
Confused 45.6%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Disgusted 45.2%
Sad 49.4%
Surprised 45.6%
Happy 45.6%
Angry 45.7%
Calm 48%
Confused 45.5%

Feature analysis

Amazon

Person 99.3%
Shoe 83.8%
Tie 65.6%

Captions

Microsoft

a group of people posing for a photo 94.6%
a group of people posing for a picture 94.5%
a group of people posing for the camera 94.4%