Human Generated Data

Title

Untitled (visiting funeral home, man in casket, Louisville, Kentucky)

Date

c. 1925, printed later

People

Artist: Caufield and Shook, American 1903 - 1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3567

Human Generated Data

Title

Untitled (visiting funeral home, man in casket, Louisville, Kentucky)

People

Artist: Caufield and Shook, American 1903 - 1978

Date

c. 1925, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 98.6
Person 98.6
Person 95.3
Person 94.1
Person 92.5
Priest 90.8
Person 88
People 71.9
Face 68.2
Photography 62.4
Photo 62.4
Portrait 62.4
Bishop 58.7

Imagga
created on 2021-12-14

people 23.4
man 21.5
clothing 20.1
person 18.5
kin 18.3
black 18
adult 17.9
male 17
fashion 16.6
dress 16.3
wind instrument 16.2
silhouette 15.7
brass 15.4
groom 15.1
women 15
men 13.7
garment 13.2
musical instrument 13.1
couple 13.1
outfit 12.9
love 12.6
happiness 12.5
business 12.1
group 12.1
youth 11.9
window 11.9
bride 11.2
robe 10.9
style 10.4
room 10
dark 10
family 9.8
old 9.7
businessman 9.7
party 9.4
happy 9.4
art 9.3
wedding 9.2
hand 9.1
cornet 9.1
dance 8.8
light 8.7
model 8.6
clothes 8.4
portrait 8.4
pretty 8.4
gown 8.3
human 8.2
night 8
celebration 8
interior 8
hair 7.9
urban 7.9
boy 7.8
standing 7.8
two 7.6
elegance 7.6
city 7.5
monument 7.5
lady 7.3
shadow 7.2
religion 7.2
history 7.2
life 7.1
covering 7

Google
created on 2021-12-14

Outerwear 95.3
Coat 91.9
Monochrome 74
Vintage clothing 74
Art 73
Monochrome photography 72.8
Event 72.6
Formal wear 72.2
Classic 70.5
Cope 69.8
Presbyter 68.4
Hat 66.9
Chair 66.5
Door 66.4
Stock photography 66.2
Picture frame 65.8
Vestment 65.4
Bishop 64.5
Room 63.7
History 62.7

Microsoft
created on 2021-12-14

wall 96.5
clothing 95.3
text 94.7
person 92.7
man 90.7
standing 88.8
posing 87.9
gallery 77.8
black and white 76.2
cartoon 65.5
drawing 61.8
room 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 71.3%
Surprised 82%
Calm 9.9%
Fear 5.5%
Happy 0.9%
Angry 0.6%
Confused 0.5%
Sad 0.5%
Disgusted 0.2%

AWS Rekognition

Age 32-48
Gender Female, 88.2%
Calm 92%
Sad 4.6%
Confused 1.1%
Surprised 0.6%
Fear 0.5%
Disgusted 0.5%
Angry 0.4%
Happy 0.2%

AWS Rekognition

Age 33-49
Gender Male, 99.8%
Calm 31.7%
Angry 30.8%
Sad 20.9%
Confused 7.6%
Fear 5%
Disgusted 2.4%
Surprised 1.2%
Happy 0.4%

AWS Rekognition

Age 36-52
Gender Male, 84.4%
Calm 90.4%
Sad 2.9%
Surprised 2.9%
Angry 2%
Confused 0.8%
Happy 0.7%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 34-50
Gender Male, 96.7%
Calm 49.8%
Sad 28.6%
Happy 10.9%
Confused 5.8%
Fear 3.2%
Surprised 0.8%
Angry 0.7%
Disgusted 0.3%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 90.4%
a group of men standing in front of a mirror posing for the camera 85.7%
a couple of people standing in front of a mirror posing for the camera 85.6%

Text analysis

Amazon

SHOOK
USA

Google

SHOO K
SHOO
K