Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)
Date

May 1934-June 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4183
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4183

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 100
Baseball Cap 99.9
Cap 99.9
Clothing 99.9
Hat 99.9
Ball 99.6
Rugby 99.6
Rugby Ball 99.6
Sport 99.6
Person 98.9
Person 98.5
Boy 98.5
Male 98.5
Teen 98.5
Person 98.4
Person 98.1
Face 95.1
Head 95.1
Sitting 65.9
Photography 57.6
Portrait 57.6
Basketball 57.5
Sphere 57.4
Body Part 56.4
Finger 56.4
Hand 56.4

Clarifai
created on 2018-05-10

people 99.8
adult 99
man 98
group 95.1
monochrome 94.2
woman 93.6
portrait 90.1
group together 88.5
administration 85.7
three 84.5
child 84.5
four 84.2
facial expression 81.6
war 79.8
offspring 77.2
sit 76.7
actress 76.4
education 74.1
wear 73.2
several 72.4

Imagga
created on 2023-10-06

nurse 46.5
patient 44.2
man 40.3
person 40.2
male 37.7
people 30.1
case 26.4
sick person 26
adult 22.9
happy 21.3
senior 20.6
home 19.1
medical 18.5
couple 18.3
father 17.5
family 16.9
portrait 16.2
dad 15.9
professional 15.8
mother 15.4
child 15.3
hospital 14.9
mature 14.9
parent 14.7
health 14.6
smiling 14.5
elderly 14.4
happiness 14.1
indoors 14.1
love 13.4
care 13.2
doctor 13.2
uniform 12.9
looking 12.8
old 12.5
husband 12.4
holding 12.4
smile 12.1
men 12
black 11.4
camera 11.1
70s 10.8
middle aged 10.7
sitting 10.3
two 10.2
grandfather 9.7
retired 9.7
women 9.5
baby 9.4
lifestyle 9.4
casual 9.3
joy 9.2
occupation 9.2
room 9.1
aged 9.1
clothing 8.9
half length 8.8
together 8.8
ancient 8.7
married 8.6
wife 8.5
face 8.5
females 8.5
inside 8.3
20s 8.2
park 8.2
outdoors 8.2
handsome 8
business 7.9
daughter 7.9
caring 7.9
standing 7.8
sick 7.7
retirement 7.7
outdoor 7.6
illness 7.6
statue 7.6
talking 7.6
stethoscope 7.5
human 7.5
surgeon 7.4
world 7.3
dress 7.2
worker 7.2
job 7.1
businessman 7.1
medicine 7

Google
created on 2018-05-10

people 97
photograph 96.2
sitting 94.2
facial expression 93.5
man 93
black and white 92.3
senior citizen 88.9
standing 86.3
monochrome photography 85.1
male 83.2
human behavior 81.9
snapshot 81.8
photography 81.2
family 78.4
conversation 72.9
human 72.3
monochrome 71.3
interaction 69.5
smile 67.5
friendship 65.9

Microsoft
created on 2018-05-10

person 100
outdoor 86.2
military uniform 82
group 79.3
people 74.8
old 49.8
team 27.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 97.1%
Happy 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Calm 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 100%
Happy 95.9%
Surprised 6.5%
Fear 6.3%
Sad 2.3%
Angry 0.7%
Calm 0.6%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 98.1%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Confused 0.5%
Disgusted 0.3%
Calm 0.2%
Angry 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 96.6%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 1.9%
Confused 0.7%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Confused 59%
Calm 29.2%
Surprised 6.4%
Fear 6.2%
Happy 6.1%
Sad 2.7%
Angry 1.5%
Disgusted 1.3%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Rugby Ball
Person
Boy
Male
Teen
Rugby Ball 99.6%
Person 98.9%
Person 98.5%
Person 98.4%
Person 98.1%
Boy 98.5%
Male 98.5%
Teen 98.5%

Categories

Imagga

people portraits 63.6%
paintings art 34.9%
pets animals 1.1%

Text analysis

Amazon

Fellows
inverted
Museums)
fm
College
of
and
Art
neg
University
President and Fellows of Harvard College (Harvard University Art Museums)
(Harvard
Harvard
P1970.4183.0000 inverted fm neg
President
P1970.4183.0000

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4183.0000 inverted fm neg
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4183.0000
inverted
fm
neg