Human Generated Data

Title

W. M. W., Mr. and Mrs. C. M. Collins and Miss Collins
Date

1912
People

Artist: Leslie Hamilton Wilson, Scottish 1884 - 1968
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur Penn, 2.2002.953

Human Generated Data

Title

W. M. W., Mr. and Mrs. C. M. Collins and Miss Collins

People

Artist: Leslie Hamilton Wilson, Scottish 1884 - 1968

Date

1912

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Human 99.4
Person 99.4
Person 99.3
Person 99.3
Person 99.1
Nature 97
Outdoors 95.1
Apparel 93.4
Clothing 93.4
Countryside 88.4
Military Uniform 87.5
Military 87.5
Wood 86.9
Building 85.7
Rural 80.8
Hut 80.5
Shack 80.5
Tie 67.2
Accessory 67.2
Accessories 67.2
Dugout 63.6
Armored 63.2
Army 63.2
People 61.6
Carpenter 58.7

Clarifai
created on 2019-11-11

people 99.9
group 98.8
adult 97.2
man 96.4
two 95.2
three 93.6
four 93.1
war 92.9
group together 91.8
several 91.5
military 91.1
wear 88
furniture 87.9
vehicle 87.2
many 84.7
administration 84
leader 83.8
one 83.4
child 83.3
woman 82.2

Imagga
created on 2019-11-11

newspaper 100
product 77.1
creation 59.8
daily 38.3
old 23
vintage 20.7
washboard 16.7
people 15.6
man 15.4
male 14.2
person 14.2
black 13.8
device 13.2
portrait 12.9
adult 12.3
retro 12.3
outdoors 11.9
grunge 11.1
art 10.4
ancient 10.4
lady 9.7
aged 9
work 9
symbol 8.7
sepia 8.7
love 8.7
day 8.6
mail 8.6
sitting 8.6
letter 8.2
one 8.2
dirty 8.1
lifestyle 7.9
business 7.9
circa 7.9
postmark 7.9
postage 7.9
postal 7.8
architecture 7.8
bench 7.8
envelope 7.8
antique 7.8
stamp 7.7
outside 7.7
relax 7.6
park 7.4
building 7.3
transportation 7.2
family 7.1
working 7.1
autumn 7

Google
created on 2019-11-11

Photograph 96.1
Snapshot 83.9
Room 71.4
Table 67.2
Adaptation 67
Photography 62.4
Picture frame 61.8
History 60.4

Microsoft
created on 2019-11-11

gallery 98.9
clothing 98.1
text 97.8
person 97.6
room 97.3
scene 96.7
man 87.1
old 70.6
vintage 27.4
picture frame 27.2

Face analysis

Amazon

AWS Rekognition

Age 32-48
Gender Female, 52.8%
Surprised 45%
Calm 54.5%
Fear 45%
Happy 45%
Angry 45.2%
Confused 45%
Sad 45.1%
Disgusted 45.1%

AWS Rekognition

Age 32-48
Gender Male, 54.7%
Disgusted 45%
Calm 45.1%
Confused 45.2%
Happy 45%
Fear 45%
Angry 54.5%
Sad 45.2%
Surprised 45%

AWS Rekognition

Age 13-23
Gender Male, 55%
Angry 45.1%
Sad 45%
Surprised 45.2%
Fear 45%
Confused 45%
Calm 54.6%
Disgusted 45%
Happy 45.1%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Calm 50%
Happy 49.5%
Surprised 49.6%
Sad 49.6%
Fear 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 49.7%

Feature analysis

Amazon

Person 99.4%
Tie 67.2%

Captions

Microsoft

a vintage photo of a person sitting in a box 61.7%
a vintage photo of a person 61.6%
a vintage photo of a person sitting in a room 61.5%

Text analysis

Amazon

boins
bi
Miss
s
bollens
b
j N bi s b boins Y Miss bollens
Y
j
N

Google

WMr M. Mu b h ballens yMis bellens
WMr
M.
Mu
b
h
ballens
yMis
bellens