Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4197

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4197

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Crowd 99.8
People 98.5
Person 97.9
Person 97.6
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 97.1
Adult 97.1
Male 97.1
Man 97.1
Audience 95.1
Person 94.7
Person 94.5
Person 93.4
Adult 93.4
Male 93.4
Man 93.4
Person 93.3
Adult 93.3
Male 93.3
Man 93.3
Person 93.1
Face 93.1
Head 93.1
Person 90.4
Person 90.3
Baby 90.3
Person 88
Person 87
Person 87
Person 86.8
Person 85.3
Person 84.6
Baby 84.6
Person 83.7
Person 79.8
Person 78.7
Person 78.5
Body Part 75.6
Finger 75.6
Hand 75.6
Person 75.6
Person 74.8
Person 72
Person 70
Person 69.7
Person 68.4
Person 66.1
Person 66
Concert 65.7
Person 63.4
Person 62.2
Person 60.1
Person 57.9
Person 55.9
Smoke 55.9

Clarifai
created on 2018-05-10

people 99.9
many 99.4
group together 98.9
group 98.9
audience 97
crowd 96.9
adult 96.7
man 95.8
administration 94.5
woman 92.4
leader 90.4
spectator 90
wear 88.9
theater 86.5
child 84.4
uniform 84
military 83.8
chair 81.1
war 80.4
retro 80.2

Imagga
created on 2023-10-06

male 34.1
man 32.9
love 30.7
couple 30.5
senior 30
people 29
together 28
spectator 26.2
happy 25
person 24.4
adult 23
husband 21
elderly 20.1
smiling 19.5
portrait 19.4
old 18.8
family 18.7
married 17.2
men 17.2
child 16.9
home 16.7
wife 16.1
grandfather 14.7
lifestyle 14.4
passenger 14.4
sitting 12.9
mother 12.8
hair 12.7
retired 12.6
loving 12.4
marriage 12.3
smile 12.1
grandmother 11.7
60s 11.7
face 11.3
women 11.1
hospital 10.9
affectionate 10.6
fun 10.5
group 10.5
friends 10.3
father 10.1
relaxation 10
sixties 9.8
handsome 9.8
affection 9.6
bride 9.6
room 9.5
enjoying 9.5
life 9.4
happiness 9.4
girls 9.1
attractive 9.1
aged 9
lady 8.9
indoors 8.8
celebration 8.8
hug 8.7
retirement 8.6
day 8.6
females 8.5
two 8.5
relationship 8.4
mature 8.4
leisure 8.3
20s 8.2
fan 8.2
dress 8.1
cheerful 8.1
gray 8.1
looking 8
kid 8
holiday 7.9
groom 7.8
black 7.8
bonding 7.8
dancing 7.7
pretty 7.7
daughter 7.6
age 7.6
adults 7.6
human 7.5
friendship 7.5
grandma 7.5
camera 7.4
wedding 7.3

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.5
group 73.9
posing 73.2
people 58.1
old 42.3
crowd 23.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 31-41
Gender Female, 89.8%
Calm 69.8%
Confused 9.9%
Surprised 7.2%
Disgusted 6.2%
Fear 6.1%
Happy 5.7%
Sad 3.9%
Angry 1.8%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 80.4%
Confused 9.9%
Surprised 6.7%
Fear 6%
Sad 5.4%
Disgusted 0.7%
Happy 0.6%
Angry 0.5%

AWS Rekognition

Age 31-41
Gender Male, 95.6%
Sad 100%
Fear 7.4%
Surprised 7%
Calm 3.8%
Disgusted 2.7%
Angry 1.8%
Happy 1.2%
Confused 0.4%

AWS Rekognition

Age 40-48
Gender Female, 68.1%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Female, 58.1%
Calm 85.9%
Fear 11.3%
Surprised 6.3%
Sad 2.5%
Happy 1%
Angry 0.6%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 48-54
Gender Female, 99.2%
Surprised 58.3%
Calm 55.3%
Fear 6.1%
Happy 6%
Sad 2.4%
Confused 0.9%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 19-27
Gender Female, 69.1%
Calm 97.6%
Fear 6.4%
Surprised 6.3%
Sad 2.3%
Angry 0.2%
Happy 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 30-40
Gender Female, 52.5%
Happy 31%
Calm 27%
Confused 22.7%
Surprised 7.9%
Fear 7.4%
Sad 7.3%
Disgusted 2.1%
Angry 1.6%

AWS Rekognition

Age 39-47
Gender Female, 54%
Calm 94.3%
Surprised 6.4%
Fear 6.2%
Happy 2.7%
Sad 2.5%
Disgusted 0.4%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 21-29
Gender Male, 78.9%
Calm 46.5%
Confused 26%
Sad 13%
Surprised 8.3%
Fear 6.2%
Happy 5.1%
Disgusted 3.3%
Angry 1.2%

AWS Rekognition

Age 4-10
Gender Female, 81.1%
Calm 56%
Happy 17.7%
Surprised 13.4%
Fear 6.5%
Angry 5.4%
Sad 3.6%
Disgusted 2.9%
Confused 2.6%

AWS Rekognition

Age 25-35
Gender Male, 94.4%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 64%
Fear 83.7%
Confused 11%
Calm 8.5%
Sad 8.4%
Surprised 6.5%
Angry 1.9%
Happy 1.6%
Disgusted 0.9%

AWS Rekognition

Age 22-30
Gender Male, 95.5%
Calm 48.6%
Sad 33.1%
Angry 16%
Surprised 9.7%
Fear 6.4%
Confused 3.1%
Happy 2.1%
Disgusted 1.3%

AWS Rekognition

Age 11-19
Gender Female, 62.3%
Sad 73.1%
Calm 56.7%
Surprised 6.8%
Fear 6.4%
Disgusted 2.8%
Confused 2.3%
Happy 1.4%
Angry 0.7%

AWS Rekognition

Age 25-35
Gender Female, 53.1%
Angry 47.4%
Calm 14.9%
Fear 10.9%
Sad 10.6%
Disgusted 8.9%
Surprised 7.3%
Happy 3.1%
Confused 1.9%

AWS Rekognition

Age 22-30
Gender Male, 95.3%
Calm 53.8%
Angry 16.6%
Surprised 10.1%
Happy 9.2%
Fear 7%
Confused 5.5%
Sad 3.6%
Disgusted 2.3%

AWS Rekognition

Age 23-33
Gender Female, 75.2%
Sad 66.1%
Fear 28.3%
Surprised 20.8%
Calm 10.1%
Confused 4.9%
Angry 4.1%
Happy 3.9%
Disgusted 2.2%

AWS Rekognition

Age 18-26
Gender Female, 89%
Fear 59.1%
Surprised 44.4%
Calm 6.5%
Sad 6%
Angry 4%
Confused 3.8%
Disgusted 1.5%
Happy 1.1%

AWS Rekognition

Age 23-31
Gender Male, 88.7%
Calm 77.8%
Surprised 6.6%
Fear 6.6%
Happy 6%
Confused 5.1%
Sad 3.9%
Disgusted 2.3%
Angry 1.9%

Feature analysis

Amazon

Person 97.9%
Adult 97.6%
Male 97.6%
Man 97.6%
Baby 90.3%

Categories

Text analysis

Amazon

(Harvard
College
Fellows
Harvard
of
Museums)
and
Art
President and Fellows of Harvard College (Harvard University Art Museums)
University
President
P1970.4197.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4197.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4197.0000