Human Generated Data

Title

Untitled (soldier and little boy standing on table)
Date

c. 1940
People

Artist: Michael Disfarmer, American 1884 - 1959
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, 2006.277

Human Generated Data

Title

Untitled (soldier and little boy standing on table)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 97.6
Human 97.6
People 90.4
Clothing 84.1
Apparel 84.1
Military 78.4
Military Uniform 78.4
Face 74.5
Family 73.2
Photo 71.6
Photography 71.6
Portrait 69
Baby 64.4
Soldier 58.8
Door 58.6
Text 57.2
Art 55.3

Imagga
created on 2022-03-05

military uniform 100
uniform 85.6
clothing 63.6
statue 63.1
consumer goods 44.6
covering 44
sculpture 42.5
religion 28.7
stone 26.2
ancient 26
art 23.6
culture 22.2
commodity 21.8
monument 21.5
architecture 20.3
child 19.8
old 19.5
history 18.8
marble 18.4
historic 18.3
antique 18.2
god 16.3
carving 16.1
religious 15.9
figure 15.5
temple 15.2
travel 14.8
people 14.5
person 14.4
portrait 14.2
face 14.2
historical 14.1
decoration 13.8
catholic 12.7
spirituality 12.5
city 12.5
tourism 12.4
famous 12.1
traditional 11.6
pray 11.6
holy 11.6
man 10.8
roman 10.7
male 10.6
human 10.5
vintage 9.9
detail 9.7
building 9.6
spiritual 9.6
faith 9.6
symbol 9.4
head 9.2
landmark 9
juvenile 8.9
kin 8.8
angel 8.8
prayer 8.7
saint 8.7
church 8.3
dress 8.1
closeup 8.1
world 8
museum 7.8
adult 7.8
worship 7.7
sky 7.7
model 7

Google
created on 2022-03-05

Standing 86.4
Headgear 82.7
Art 81.1
Baby 78.8
Toddler 77.4
Vintage clothing 75.6
Child 75.1
Visual arts 66.4
Stock photography 63
Illustration 62.1
History 60.5
Paper product 59
Portrait 58.1
Antique 57.9
Family 57.1
Retro style 57
Room 56
Painting 52.2
Sitting 51.3
Grandparent 50.2

Microsoft
created on 2022-03-05

text 99.1
wall 98.8
baby 97.5
person 96.5
human face 96.5
clothing 94.9
toddler 94.3
old 90.5
posing 90
black 83.6
smile 66
child 65.3
boy 61.3
vintage 52.5
picture frame 15.7
stone 7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Happy 84.8%
Calm 10.8%
Confused 1.7%
Sad 0.7%
Disgusted 0.6%
Angry 0.5%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 0-4
Gender Female, 82.6%
Calm 98.4%
Fear 0.9%
Happy 0.2%
Surprised 0.2%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Captions

Microsoft

a vintage photo of a person standing posing for the camera 93.9%
a vintage photo of a man and woman posing for a picture 83.3%
a vintage photo of a man and a woman posing for a picture 83.2%