Human Generated Data

Title

Untitled (two women in fancy hats, one seated, one standing, full-length, parlor setting backdrop)
Date

c.1856 - c.1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3861

Human Generated Data

Title

Untitled (two women in fancy hats, one seated, one standing, full-length, parlor setting backdrop)

People

Artist: Unidentified Artist,

Date

c.1856 - c.1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3861

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Clothing 99.7
Apparel 99.7
Person 99.1
Human 99.1
Person 98.8
Painting 87.7
Art 87.7
Sun Hat 70.5
Female 66.2
Sleeve 61.7
Hat 60.1
Sailor Suit 60

Clarifai
created on 2021-04-03

people 99.9
portrait 99.3
lid 99.2
wear 98.9
two 98.8
adult 97.8
veil 97.2
child 96.9
woman 96.8
three 94.4
group 93.6
offspring 92.9
man 92.8
costume 92.3
one 91.8
uniform 91.2
son 90.7
outfit 90.4
boy 88.7
family 88.5

Imagga
created on 2021-04-03

person 28.6
man 26.9
clothing 22.3
male 21.4
world 20.5
black 20.4
people 20.1
portrait 20.1
military uniform 19.1
hat 18.6
human 17.2
face 16.3
old 16
sculpture 15.7
uniform 15.6
statue 15.5
cowboy hat 15.2
body 15.2
sexy 14.5
religion 14.3
adult 14.3
dark 14.2
art 13.8
one 13.4
model 13.2
performer 12.9
attractive 12.6
comedian 12
culture 12
covering 11.9
love 11.8
posing 11.6
helmet 11.4
headdress 11
dress 10.8
vintage 10.8
fashion 10.6
consumer goods 10.6
historical 10.4
mask 10.2
history 9.8
kin 9.8
lady 9.7
god 9.6
muscular 9.6
hair 9.5
grunge 9.4
religious 9.4
monument 9.3
style 8.9
couple 8.7
antique 8.7
ancient 8.7
church 8.3
figure 8.3
tourism 8.3
entertainer 8.2
costume 7.8
trench coat 7.8
sepia 7.8
mysterious 7.8
men 7.7
holy 7.7
mystery 7.7
guy 7.6
stone 7.6
head 7.6
historic 7.3
makeup 7.3
fitness 7.2
romantic 7.1
family 7.1
night 7.1

Google
created on 2021-04-03

Picture frame 89.1
Chair 87.7
Gesture 85.3
Military person 79.7
Tints and shades 76.4
Classic 75.4
Vintage clothing 74.9
Non-commissioned officer 74.4
Uniform 67.4
Room 67.4
Hat 66
Military officer 65.3
Art 63.1
Stock photography 62.1
History 61.1
Rectangle 55.8
Visual arts 53.1
Retro style 53.1
Family 53
Sitting 52.6

Microsoft
created on 2021-04-03

old 97.8
person 97.6
clothing 97.2
text 95.3
man 93.7
hat 91.3
human face 90.1
black 87.3
white 80.9
fashion accessory 75.5
player 67.2
vintage clothing 63
posing 60.9
retro 52.2
vintage 32.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 50.2%
Calm 84.7%
Happy 6.4%
Sad 2.3%
Confused 1.6%
Fear 1.5%
Surprised 1.5%
Angry 1.4%
Disgusted 0.6%

AWS Rekognition

Age 22-34
Gender Male, 93.6%
Calm 97.1%
Sad 1.9%
Angry 0.4%
Confused 0.3%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 87.7%
Hat 60.1%