Human Generated Data

Title

Untitled (portrait of two women in formal dress seated against plain backdrop)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13275

Human Generated Data

Title

Untitled (portrait of two women in formal dress seated against plain backdrop)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Hat 99.5
Clothing 99.5
Apparel 99.5
Person 99.2
Human 99.2
Person 99.2
Hat 97.3
People 81
Painting 63.6
Art 63.6
Military Uniform 63.2
Officer 63.2
Military 63.2
Sleeve 59.3
Long Sleeve 59.3
Sun Hat 57.8
Female 57.6

Imagga
created on 2022-01-24

military uniform 100
uniform 100
clothing 93.4
consumer goods 64.6
covering 64.4
commodity 31.9
man 29.6
portrait 27.2
male 26.2
statue 21.9
person 21.3
people 21.2
face 17.7
hat 17.6
adult 17.4
sculpture 17.2
ancient 16.4
love 15.8
old 15.3
religion 15.2
black 15
art 15
culture 14.5
attractive 14
antique 13.8
sexy 13.6
model 12.4
couple 12.2
fashion 12.1
stone 11.8
vintage 11.6
family 11.6
history 10.7
one 10.4
style 10.4
religious 10.3
dress 9.9
helmet 9.9
lady 9.7
catholic 9.7
costume 9.7
decoration 9.7
happy 9.4
handsome 8.9
romantic 8.9
posing 8.9
body 8.8
cute 8.6
architecture 8.6
guy 8.5
historical 8.5
monument 8.4
church 8.3
traditional 8.3
historic 8.2
figure 8.1
father 8
mother 7.9
together 7.9
smile 7.8
happiness 7.8
travel 7.7
men 7.7
holy 7.7
pretty 7.7
mask 7.7
youth 7.7
god 7.7
dark 7.5
human 7.5
retro 7.4
detail 7.2
home 7.2
hair 7.1

Google
created on 2022-01-24

Microsoft
created on 2022-01-24

person 99.7
hat 97.7
fashion accessory 96.8
clothing 96.7
human face 95.6
text 87.7
white 81.3
black 73.2
smile 71
child 70
old 68.1
cowboy hat 66.4
vintage clothing 61
fedora 58.4
sun hat 56.5
retro style 52.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Female, 84.2%
Sad 92.6%
Calm 4.5%
Confused 0.9%
Fear 0.6%
Surprised 0.6%
Angry 0.5%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.1%
Calm 70.9%
Sad 19.1%
Confused 3.2%
Surprised 2.4%
Angry 2.3%
Disgusted 0.9%
Fear 0.7%
Happy 0.4%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.5%
Person 99.2%
Painting 63.6%

Captions

Microsoft

a vintage photo of a boy 81.8%
a vintage photo of a person 81.7%
an old photo of a boy 81.5%