Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)
Date

May 1934-June 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2772
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2772

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.5
Human 99.5
Person 98.8
Person 97.9
Person 97
Person 95.4
Person 93.4
Person 92.3
Person 90.7
Person 90.4
Person 88.2
Crowd 85.4
People 76.3
Face 72.6
Apparel 65.5
Clothing 65.5
Hat 65.5
Weaponry 60.8
Weapon 60.8
Photographer 58.4
Gun 57

Clarifai
created on 2018-03-23

people 99.9
group 99.5
many 99.1
group together 99
adult 98.7
man 96.8
vehicle 96.5
administration 95.7
several 95.4
woman 94.5
wear 93.4
leader 90.1
war 88.7
military 88
music 87.5
recreation 82.3
five 79.3
crowd 79.3
one 78.9
spectator 77.9

Imagga
created on 2018-03-23

man 43
male 32.9
people 31.8
person 28.4
smiling 20.2
men 18.9
senior 18.7
happy 17.5
adult 16.5
together 15.8
hairdresser 15.5
sitting 15.5
child 14.4
work 14.4
outdoors 14.3
old 13.9
portrait 13.6
family 12.4
elderly 12.4
smile 11.4
women 11.1
shop 11
worker 10.8
grandmother 10.8
working 10.6
indoors 10.5
mature 10.2
two 10.2
lifestyle 10.1
color 10
team 9.8
computer 9.6
black 9.6
home 9.6
room 9.5
teenager 9.1
business 9.1
father 8.9
equipment 8.9
group 8.9
job 8.8
businessman 8.8
life 8.8
guy 8.7
boy 8.7
hat 8.6
face 8.5
hand 8.4
city 8.3
leisure 8.3
fun 8.2
care 8.2
music 8.1
mother 8
barbershop 7.9
love 7.9
grandfather 7.9
day 7.8
40s 7.8
generation 7.7
nurse 7.6
active 7.5
teamwork 7.4
professional 7.4
playing 7.3
children 7.3
relaxing 7.3
businesswoman 7.3
hospital 7.2
handsome 7.1
medical 7.1

Google
created on 2018-03-23

black 95.3
photograph 95.1
man 92.9
black and white 85.6
photography 80.2
monochrome photography 68.4
monochrome 62.7
crowd 58.7
recreation 52.1

Microsoft
created on 2018-03-23

person 100
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Male, 98.7%
Confused 11.3%
Sad 13.8%
Surprised 1.3%
Calm 54.4%
Happy 1.2%
Disgusted 9.1%
Angry 8.8%

AWS Rekognition

Age 35-55
Gender Male, 97.5%
Sad 14.7%
Calm 30%
Angry 24.7%
Surprised 2.8%
Confused 14%
Happy 3.6%
Disgusted 10.1%

AWS Rekognition

Age 57-77
Gender Male, 94.8%
Calm 35.9%
Disgusted 12.6%
Angry 26.9%
Happy 4%
Confused 6.3%
Sad 9.1%
Surprised 5.2%

AWS Rekognition

Age 26-43
Gender Female, 78.6%
Disgusted 1.6%
Happy 1%
Angry 7.2%
Surprised 1.5%
Sad 5.9%
Calm 82.1%
Confused 0.7%

AWS Rekognition

Age 48-68
Gender Female, 52.8%
Calm 47%
Angry 45.6%
Happy 45.8%
Disgusted 45.7%
Sad 49.9%
Surprised 45.6%
Confused 45.4%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 72
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 65.5%