Human Generated Data

Title

Untitled (three-quarter length portrait of African-American man in front of painted backdrop)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13281

Human Generated Data

Title

Untitled (three-quarter length portrait of African-American man in front of painted backdrop)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Apparel 99.5
Clothing 99.5
Human 98.3
Person 98.3
Hat 98.1
Overcoat 76.4
Coat 76.4
Art 72
Painting 72
Sun Hat 69.3

Imagga
created on 2022-01-24

military uniform 51.9
statue 44.7
uniform 41.8
clothing 41.6
private 38.7
sculpture 38.2
ancient 34.6
religion 34.1
old 30.7
cowboy hat 26.7
stone 26.2
consumer goods 26.2
temple 25.8
covering 25.6
hat 25.4
architecture 24.2
culture 23.9
art 23.1
monument 20.5
religious 19.7
spiritual 17.3
god 17.2
headdress 17.2
travel 16.2
history 15.2
pray 13.6
traditional 13.3
man 12.8
catholic 12.6
tourism 12.4
antique 12.1
male 12.1
face 12.1
figure 12
building 11.9
vintage 11.6
holy 11.6
ruler 11.1
church 11.1
prayer 10.6
faith 10.5
portrait 10.4
historical 10.4
commodity 10.3
famous 10.2
historic 10.1
worship 9.7
east 9.3
peace 9.1
oriental 9
carving 9
people 8.9
ruin 8.8
decoration 8.7
spirituality 8.6
person 8.3
outdoors 8.2
landmark 8.1
symbol 8.1
grave 8.1
cemetery 7.9
carved 7.8
bronze 7.8
sacred 7.8
contemplation 7.8
marble 7.7
wall 7.7
meditation 7.7
tourist 7.6
close 7.4
child 7.4
peaceful 7.3

Google
created on 2022-01-24

Hat 87.5
Sleeve 87.2
Collar 84.1
Art 81.6
Blazer 77.7
Vintage clothing 75.1
Sun hat 72.7
Suit 70.7
Uniform 68.2
Visual arts 67.3
History 66.4
Rectangle 61.9
Stock photography 61.9
Military person 60.4
Formal wear 58.9
Costume hat 57.9
Artifact 55.7
Retro style 54.6
Button 54
Portrait 53.8

Microsoft
created on 2022-01-24

old 99.3
man 99
text 98.5
wall 98.3
human face 95.5
hat 94.3
person 94
clothing 93.5
suit 69.8
cowboy hat 64.2
fedora 56.1
drawing 51.9
sketch 51.7
fashion accessory 51.3
building material 30.5
stone 14.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 99.4%
Calm 100%
Sad 0%
Angry 0%
Surprised 0%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Hat 98.1%
Painting 72%

Captions

Microsoft

a vintage photo of a man wearing a suit and tie 94.5%
an old photo of a man wearing a suit and tie 94.4%
a vintage photo of a man 91%