Human Generated Data

Title

Untitled (portrait of two women in formal dress seated against plain backdrop)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13275

Human Generated Data

Title

Untitled (portrait of two women in formal dress seated against plain backdrop)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13275

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Hat 99.5
Clothing 99.5
Apparel 99.5
Person 99.2
Human 99.2
Person 99.2
Hat 97.3
People 81
Painting 63.6
Art 63.6
Officer 63.2
Military 63.2
Military Uniform 63.2
Long Sleeve 59.3
Sleeve 59.3
Sun Hat 57.8
Female 57.6

Clarifai
created on 2023-10-27

people 99.9
portrait 99.1
wear 98.9
two 98.6
lid 97.7
veil 96.3
adult 95.4
sepia 95.4
child 95.3
vintage 95.3
uniform 94.8
group 94.8
outfit 94.7
woman 94.1
three 93.6
military 93
man 93
retro 91.1
son 90.7
military uniform 90

Imagga
created on 2022-01-24

military uniform 100
uniform 100
clothing 93.4
consumer goods 64.6
covering 64.4
commodity 31.9
man 29.6
portrait 27.2
male 26.2
statue 21.9
person 21.3
people 21.2
face 17.7
hat 17.6
adult 17.4
sculpture 17.2
ancient 16.4
love 15.8
old 15.3
religion 15.2
black 15
art 15
culture 14.5
attractive 14
antique 13.8
sexy 13.6
model 12.4
couple 12.2
fashion 12.1
stone 11.8
vintage 11.6
family 11.6
history 10.7
one 10.4
style 10.4
religious 10.3
dress 9.9
helmet 9.9
lady 9.7
catholic 9.7
costume 9.7
decoration 9.7
happy 9.4
handsome 8.9
romantic 8.9
posing 8.9
body 8.8
cute 8.6
architecture 8.6
guy 8.5
historical 8.5
monument 8.4
church 8.3
traditional 8.3
historic 8.2
figure 8.1
father 8
mother 7.9
together 7.9
smile 7.8
happiness 7.8
travel 7.7
men 7.7
holy 7.7
pretty 7.7
mask 7.7
youth 7.7
god 7.7
dark 7.5
human 7.5
retro 7.4
detail 7.2
home 7.2
hair 7.1

Google
created on 2022-01-24

Outerwear 95.2
Chair 86.8
Sleeve 86.4
Gesture 85.3
Cap 83.4
Headgear 82.8
Military person 80.3
Vintage clothing 78.8
Classic 74.7
Suit 73.6
Non-commissioned officer 69.7
Sitting 66.7
Rectangle 66.5
Uniform 65.6
Stock photography 65
Hat 63
Art 61.3
Military officer 59.9
Retro style 59.1
Military uniform 59

Microsoft
created on 2022-01-24

person 99.7
hat 97.7
fashion accessory 96.8
clothing 96.7
human face 95.6
text 87.7
white 81.3
black 73.2
smile 71
child 70
old 68.1
cowboy hat 66.4
vintage clothing 61
fedora 58.4
sun hat 56.5
retro style 52.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Female, 84.2%
Sad 92.6%
Calm 4.5%
Confused 0.9%
Fear 0.6%
Surprised 0.6%
Angry 0.5%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.1%
Calm 70.9%
Sad 19.1%
Confused 3.2%
Surprised 2.4%
Angry 2.3%
Disgusted 0.9%
Fear 0.7%
Happy 0.4%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat
Person
Painting
Hat 99.5%
Hat 97.3%
Person 99.2%
Person 99.2%
Painting 63.6%

Categories

Imagga

paintings art 97.7%
people portraits 2.1%

Captions

Microsoft
created on 2022-01-24

a vintage photo of a boy 81.8%
a vintage photo of a person 81.7%
an old photo of a boy 81.5%