Human Generated Data

Title

Untitled (full-length studio portrait of two standing men)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.10

Human Generated Data

Title

Untitled (full-length studio portrait of two standing men)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-23

Person 99.6
Human 99.6
Person 99.4
Clothing 86.8
Apparel 86.8
Military 83.3
Military Uniform 82.7
Archaeology 69.3
Art 68.1
Painting 66.6
Officer 66.1
Pants 65.4
People 64
Bronze 58.5
Coat 57.2
Army 57
Armored 57

Clarifai
created on 2019-03-23

people 99.9
adult 99
military 99
man 98.9
soldier 98.5
wear 98.2
print 98.1
group 97.6
war 96.6
two 96.5
uniform 96.1
illustration 95.4
art 94.5
weapon 93.9
military uniform 93.7
army 92.7
painting 92.3
outfit 91.9
one 91.4
three 88.7

Imagga
created on 2019-03-23

book jacket 50.6
jacket 39.4
statue 37.9
sculpture 36.1
wrapping 29.9
religion 29.6
art 29.5
ancient 27.7
old 24.4
covering 23.8
architecture 22.6
stone 22.1
religious 21.5
history 21.5
culture 21.4
historical 17.9
temple 17.8
monument 17.7
god 17.2
travel 16.2
famous 15.8
vintage 15.7
private 14.7
uniform 13.5
holy 13.5
spirituality 13.4
carving 13.1
antique 13.1
church 12.9
historic 12.8
ruler 12.7
museum 12
tourism 11.5
spiritual 11.5
military uniform 11.4
face 11.4
city 10.8
symbol 10.8
building 10.3
kin 10.2
man 10.1
male 9.9
currency 9.9
one 9.7
figure 9.5
tourist 9.1
landmark 9
soldier 8.8
carved 8.8
marble 8.7
military 8.7
prayer 8.7
saint 8.7
faith 8.6
money 8.5
clothing 8.1
postmark 7.9
statues 7.9
mythology 7.9
century 7.8
army 7.8
catholic 7.8
painter 7.8
pray 7.8
stamp 7.7
mail 7.7
traditional 7.5
dollar 7.4
close 7.4
letter 7.3
cash 7.3
person 7.3
icon 7.1
portrait 7.1

Google
created on 2019-03-23

Soldier 72.3
Illustration 62.3
Art 58.1
Non-commissioned officer 56.1
Gentleman 54.5
Military officer 54.5
Uniform 52.8
Military person 52.5

Microsoft
created on 2019-03-23

person 95.8
text 92.9
old 91.4
standing 78.2
posing 48.7
stone 5
military 5
soldier 1.7
army 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Male, 97.4%
Angry 2.7%
Happy 0.3%
Confused 2.2%
Sad 4.5%
Surprised 0.5%
Calm 88.9%
Disgusted 0.7%

AWS Rekognition

Age 38-59
Gender Male, 98.8%
Angry 4.5%
Calm 89.8%
Disgusted 0.3%
Sad 3.9%
Happy 0.1%
Surprised 0.6%
Confused 0.6%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 66.6%

Captions

Microsoft

a vintage photo of a man 87.8%
a vintage photo of a man standing in front of a building 77.2%
an old photo of a man 77.1%