Human Generated Data

Title

Untitled (full-length portrait of two men with backdrop and props depicting outdoor setting)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.9

Human Generated Data

Title

Untitled (full-length portrait of two men with backdrop and props depicting outdoor setting)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.9

Machine Generated Data

Tags

Amazon
created on 2019-03-23

Person 99.5
Human 99.5
Person 98
Clothing 89.3
Apparel 89.3
Painting 88.2
Art 88.2
Coat 67.9
People 67.3
Outdoors 62.9
Photo 59.9
Photography 59.9
Archaeology 57.6
Jacket 57
Brick 55.3

Clarifai
created on 2019-03-23

people 100
adult 99
two 98.4
one 97.1
wear 97.1
portrait 96.9
man 96.9
group 96.2
art 91.8
woman 91.6
administration 89.5
leader 88
child 88
print 87.5
music 87.2
three 86.2
affection 85.7
retro 84.8
military 81.9
four 78.9

Imagga
created on 2019-03-23

statue 41.5
ancient 33.7
stone 33.5
sculpture 31
religion 30.5
architecture 28.9
temple 26.4
old 25.8
art 23.6
cemetery 21.9
culture 20.5
travel 20.4
kin 18.9
religious 18.7
monument 18.7
god 18.2
history 17.9
historical 16.9
building 16.7
historic 16.5
ruler 15.1
famous 14.9
tourism 14.9
antique 13.9
carving 13.2
person 12.7
cell 12.5
spiritual 12.5
church 12
grave 11.9
face 11.4
adolescent 11
figure 11
man 10.8
spirituality 10.6
memorial 10.5
structure 10.2
marble 9.7
holy 9.6
mother 9.4
juvenile 9.3
traditional 9.2
city 9.1
vintage 9.1
people 8.9
mythology 8.9
symbol 8.8
faith 8.6
wall 8.6
decoration 8.2
tourist 8.2
landmark 8.1
close 8
male 7.9
carved 7.8
ruin 7.8
catholic 7.8
portrait 7.8
pray 7.8
sitting 7.7
heritage 7.7
serene 7.5
human 7.5
world 7.4
peace 7.3
adult 7.1
parent 7
groom 7

Google
created on 2019-03-23

Art 58.1
History 54.1

Microsoft
created on 2019-03-23

wall 98.9
old 96.5
posing 81.6
person 27
stone 27
child 17.6
photograph 13.2
portrait 10
group 6
military 5.8
boy 5.7
retro 5.7
victorian 5.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 97.5%
Sad 5.2%
Happy 0.2%
Disgusted 0.6%
Angry 1.4%
Surprised 0.2%
Confused 0.6%
Calm 91.8%

AWS Rekognition

Age 23-38
Gender Male, 93.9%
Sad 16.4%
Happy 1.3%
Surprised 2.4%
Confused 2.4%
Angry 38.7%
Calm 31.6%
Disgusted 7.1%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 88.2%

Categories

Imagga

paintings art 46.3%
streetview architecture 32%
people portraits 20%