Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.18

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-24

Person 99.6
Human 99.6
Person 99.5
Person 99.2
Face 99
Hat 98.6
Clothing 98.6
Apparel 98.6
Person 98.6
Person 90.3
Hat 82.3
People 79.4
Man 73.1
Photography 68.9
Photo 68.9
Smile 68.3
Portrait 67.7
Military 65.9
Officer 65.9
Military Uniform 65.9
Beard 64.8
Finger 63.3
Head 62.7
Hug 61.2
Cap 60.6
Skin 60.4
Arm 56.8
Jaw 56.1
Sailor Suit 55.4

Imagga
created on 2022-06-24

man 46.3
senior 45
male 37.3
old 32.7
grandfather 31.7
elderly 31.6
couple 30.5
person 29.4
people 28.4
mature 27.9
adult 27.8
happy 26.9
retired 23.3
portrait 20.7
smile 20.7
love 19.7
smiling 19.5
men 18.9
outdoors 18
retirement 17.3
father 16.4
aged 16.3
age 16.2
spectator 15.3
face 14.9
grandmother 14.7
husband 14.3
happiness 14.1
together 14
looking 13.6
older 13.6
casual 13.6
hair 13.5
married 13.4
lady 13
pensioner 12.9
mother 12.8
parent 12.3
hat 12.2
home 12
two 11.8
gray 11.7
handsome 11.6
family 11.6
beard 11.4
marriage 11.4
wife 11.4
lifestyle 10.8
child 10.3
sitting 10.3
women 10.3
attractive 9.8
cheerful 9.7
aging 9.6
relationship 9.4
world 8.9
60s 8.8
laughing 8.5
togetherness 8.5
head 8.4
active 8.3
glasses 8.3
leisure 8.3
park 8.2
one 8.2
relaxing 8.2
life 8.1
dad 8
citizen 7.9
look 7.9
seniors 7.9
outside 7.7
outdoor 7.6
hand 7.6
clothing 7.6
enjoying 7.6
joy 7.5
fun 7.5
guy 7.4
activity 7.2
job 7.1
summer 7.1
uniform 7

Google
created on 2022-06-24

Black 89.5
Gesture 85.3
Style 83.9
Black-and-white 83.1
Smile 82.8
Headgear 81.2
Hat 79.8
Cap 79.8
Crew 77.1
Monochrome 75.7
Military person 75.7
T-shirt 75.3
Monochrome photography 74.3
Team 73
Military uniform 72.6
Vintage clothing 72.6
Tree 71
Crowd 70.2
Event 69.4
History 66.9

Microsoft
created on 2022-06-24

person 99.5
human face 98.9
outdoor 98.8
clothing 97.5
man 92.7
hat 90.9
smile 89.3
fashion accessory 78
old 67.8
people 58.5
black and white 54

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 86.4%
Happy 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Calm 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 63%
Happy 22.1%
Surprised 8.4%
Fear 6.3%
Sad 3.4%
Angry 2.9%
Confused 2.6%
Disgusted 1.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 90.2%
Surprised 6.6%
Fear 6.2%
Confused 3.9%
Sad 2.6%
Happy 1.2%
Disgusted 1.1%
Angry 0.7%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 98.6%

Captions

Microsoft

a group of people posing for a photo 94%
a group of people posing for the camera 93.9%
a group of men posing for a photo 93.3%

Text analysis

Google

IT
IF
S IF IT IT
S