Human Generated Data

Title

Photo Album

Date

c. 1857 - c. 1874

People
Classification

Photographs

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.61

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.6
Apparel 99.6
Person 98.5
Human 98.5
Person 98
Painting 97.7
Art 97.7
Outdoors 72.3
Portrait 65.5
Photography 65.5
Face 65.5
Photo 65.5
Hat 61.3
Sun Hat 59.2
Hat 57.5
Tool 56.9

Imagga
created on 2022-01-09

weapon 25.8
helmet 25.6
man 22.2
cowboy hat 17.4
person 17.1
tool 16.4
hat 16.1
old 16
armor plate 15.3
shovel 14.3
clothing 14
halberd 13.4
adult 13
people 12.8
male 12.8
sword 12.3
hand tool 11.9
headdress 10.9
warrior 10.7
pike 10.7
sculpture 10.7
statue 10.6
art 10.5
culture 10.3
protection 10
outdoor 9.9
instrument 9.9
military 9.7
outside 9.4
grunge 9.4
vintage 9.1
sport 9.1
cowboy 9
outdoors 9
costume 8.7
plate 8.7
uniform 8.6
portrait 8.4
staff 8.4
dark 8.4
color 8.3
crutch 8.3
light 8
soldier 7.8
protective 7.8
horror 7.8
war 7.7
attractive 7.7
power 7.6
leisure 7.5
style 7.4
danger 7.3
active 7.2
religion 7.2
history 7.2
posing 7.1
face 7.1
summer 7.1
rustic 7.1
child 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

wall 96.1
clothing 92.5
hat 90.8
person 89.8
old 76.2
man 72.5
text 69.6
cowboy hat 67.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 74.9%
Confused 9.6%
Sad 7.1%
Surprised 3%
Angry 2.6%
Fear 1.2%
Disgusted 0.8%
Happy 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Sad 44.8%
Calm 27.2%
Fear 11.7%
Surprised 6.6%
Confused 4%
Angry 3.3%
Disgusted 1.8%
Happy 0.7%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 97.7%
Hat 61.3%

Captions

Microsoft

an old photo of a man 88%
old photo of a man 85.3%
a old photo of a man 84.9%