Human Generated Data

Title

Untitled (portrait in house of couple with man standing and woman seated)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3849

Human Generated Data

Title

Untitled (portrait in house of couple with man standing and woman seated)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 100
Apparel 100
Human 97.8
Robe 97.5
Fashion 97.5
Gown 97.3
Suit 95.9
Overcoat 95.9
Coat 95.9
Wedding 95.7
Person 95
Bride 93.6
Person 92.4
Bridegroom 90.6
Female 89.4
Tuxedo 80.9
Dress 77.8
Woman 76.4
Face 70.1
Photography 67.3
Portrait 67.3
Photo 67.3
Plant 64.7
People 62.7
Veil 59.9
Wedding Gown 57.7

Clarifai
created on 2019-06-01

people 99.5
adult 97.4
man 95.5
veil 94.5
one 92
uniform 91.2
wear 90.3
medical practitioner 88.2
scientist 85.9
woman 85.6
two 84.4
medicine 81.8
portrait 81.2
group 79
coat 79
military 78.2
healthcare 77.7
leader 77.2
administration 76.1
hospital 75.2

Imagga
created on 2019-06-01

lab coat 33.7
coat 30.1
nurse 27.5
adult 24.1
people 24
person 23.3
clothing 22
male 22
man 21.5
happy 21.3
garment 20.1
happiness 19.6
doctor 18.8
hospital 18.4
portrait 17.5
old 16
medical 15.9
face 15.6
casual 15.2
smiling 15.2
professional 14.7
attractive 14.7
health 14.6
smile 14.2
businessman 14.1
day 14.1
clinic 14.1
elderly 13.4
business 13.4
indoors 13.2
care 13.2
camera 12.9
indoor 11.9
job 11.5
office 11.4
one 11.2
looking 11.2
home 11.2
men 11.2
color 10.6
cheerful 10.6
businesspeople 10.4
standing 10.4
antique 10.4
worker 10.1
bathrobe 10.1
bright 10
patient 9.9
consultant 9.7
colleagues 9.7
mother 9.4
lifestyle 9.4
20s 9.2
handsome 8.9
good mood 8.8
medicine 8.8
clinical 8.8
assistant 8.7
couple 8.7
brunette 8.7
30s 8.6
ancient 8.6
vintage 8.6
senior 8.4
black 8.4
modern 8.4
mature 8.4
occupation 8.2
bride 8.2
retro 8.2
confident 8.2
healing 8.1
religion 8.1
robe 8
stethoscope 8
general practitioner 7.9
associates 7.9
heal 7.8
work 7.8
statue 7.8
corporate 7.7
mid adult 7.7
desk 7.6
fashion 7.5
house 7.5
human 7.5
wedding 7.4
light 7.3
historic 7.3
alone 7.3
businesswoman 7.3
aged 7.2
team 7.2
family 7.1
women 7.1

Google
created on 2019-06-01

Photograph 97.3
Art 50.2

Microsoft
created on 2019-06-01

wedding dress 96.2
wall 95.6
bride 92.9
smile 87.8
text 85.6
clothing 79.9
old 78.5
person 76
black and white 75.6
white 73.2
posing 72
human face 70.3
wedding 58.2
gallery 53.7

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 99.6%
Sad 7.1%
Happy 8.9%
Confused 2%
Angry 3.6%
Surprised 2%
Disgusted 1%
Calm 75.3%

AWS Rekognition

Age 35-52
Gender Male, 77.8%
Sad 2.9%
Happy 26.1%
Surprised 4.9%
Calm 57%
Disgusted 3.6%
Confused 2.9%
Angry 2.6%

Feature analysis

Amazon

Person 95%
Wedding Gown 57.7%

Captions

Microsoft

a vintage photo of a person 89.4%
a vintage photo of a group of people posing for the camera 79.2%
a vintage photo of a group of people posing for a picture 79.1%