Human Generated Data

Title

Photo Album

Date

c. 1857 - c. 1874

People
Classification

Photographs

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.56

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 98.9
Sport 81.7
Sports 81.7
Painting 67.3
Art 67.3
Monk 65.8
Costume 58.1
Judo 57.4
Martial Arts 57.4
Clothing 55.8
Apparel 55.8

Imagga
created on 2022-01-09

person 25.5
man 23.5
black 18.7
old 17.4
male 17.1
people 16.2
adult 14.9
portrait 14.9
clothing 14.6
grunge 14.4
dark 14.2
boy 12.3
antique 12.1
art 11.7
vintage 11.7
smile 11.4
garment 11.2
religion 10.7
player 10.4
kin 10.4
ancient 10.4
face 9.9
one 9.7
body 9.6
religious 9.4
uniform 9.3
world 9.1
fashion 9
bathrobe 9
style 8.9
coat 8.8
happy 8.8
ballplayer 8.5
athlete 8.4
health 8.3
care 8.2
retro 8.2
aged 8.1
posing 8
covering 7.9
happiness 7.8
model 7.8
nurse 7.7
child 7.7
statue 7.6
sport 7.5
robe 7.5
contestant 7.4
symbol 7.4
pose 7.2
hair 7.1
family 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

old 98.5
clothing 97.6
person 97.2
window 96.5
text 93.8
man 81.8
smile 80.8
white 76.3
black 75.7
vintage 62.3
human face 59.9
posing 59.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 68.2%
Happy 13.2%
Confused 5.5%
Surprised 3.6%
Sad 3.1%
Angry 3%
Fear 1.9%
Disgusted 1.5%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 90.7%
Confused 4.4%
Sad 2.4%
Angry 1.5%
Fear 0.4%
Happy 0.2%
Surprised 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 53
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 67.3%

Captions

Microsoft

a vintage photo of a man 95.4%
a vintage photo of a man standing next to a window 88.9%
a vintage photo of an old man standing next to a window 87.9%