Human Generated Data

Title

Untitled (full-length studio portrait of two seated men)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.11

Human Generated Data

Title

Untitled (full-length studio portrait of two seated men)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-23

Human 98.7
Person 98.7
Person 85.4
Apparel 84.7
Clothing 84.7
Hat 77.9
Art 69.2

Clarifai
created on 2019-03-23

people 100
adult 97.2
retro 95.4
two 95.2
art 95.1
wear 95
man 94.2
vintage 93.7
administration 91.8
child 89.8
print 89.1
one 89.1
woman 86.9
group 85.8
portrait 85.3
illustration 82
old 81.3
three 81
canine 78.6
leader 78.6

Imagga
created on 2019-03-23

book jacket 26.4
jacket 22.5
person 20.3
art 17.7
old 17.4
portrait 16.8
vintage 16.5
architecture 16.5
people 16.2
statue 16
wrapping 15.6
face 15.6
ancient 15.6
sculpture 15.3
sexy 14.5
body 14.4
man 14
adolescent 13.2
male 12.8
culture 12.8
one 12.7
fashion 12.1
covering 11.9
religion 11.7
juvenile 11.5
stone 11.4
grunge 11.1
adult 11
kin 10.4
antique 10.4
black 10.2
travel 9.9
building 9.6
hair 9.5
historical 9.4
artwork 9.2
attractive 9.1
figure 9.1
step 9
decoration 8.9
model 8.6
structure 8.4
monument 8.4
park 8.2
jigsaw puzzle 8.2
happy 8.1
aged 8.1
world 8.1
close 8
support 8
wall 7.9
postmark 7.9
sepia 7.8
stamp 7.7
men 7.7
mail 7.7
memorial 7.6
skin 7.6
sibling 7.5
religious 7.5
city 7.5
outdoors 7.5
retro 7.4
fountain 7.3
love 7.1

Google
created on 2019-03-23

Microsoft
created on 2019-03-23

text 99.3
book 95.3
person 92.1
outdoor 91.7
black 85.5
old 84.7
posing 79.9
white 68.8
retro 63.5
vintage 63.5
photograph 54.8
victorian 34.6
boy 32.4
child 26.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 59.1%
Surprised 1.4%
Sad 3.8%
Confused 1.4%
Disgusted 1.1%
Calm 90.1%
Happy 1.1%
Angry 1.1%

AWS Rekognition

Age 26-43
Gender Male, 98.8%
Disgusted 3.6%
Angry 6.3%
Surprised 4.1%
Happy 1.4%
Calm 49.4%
Confused 11.8%
Sad 23.4%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Hat 77.9%

Captions

Microsoft

a vintage photo of a man and a woman posing for a picture 86.7%
a vintage photo of a person 86.6%
a vintage photo of a person 86.5%