Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Human Generated Data

Title

Untitled (Blackwell's Island Penitentiary, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Machine Generated Data

Tags

Amazon

Human 99.5
Person 99.5
Person 98.8
Person 97.9
Person 97
Person 95.4
Person 93.4
Person 92.3
Person 90.7
Person 90.4
Person 88.2
Crowd 85.4
People 76.3
Face 72.6
Clothing 65.5
Apparel 65.5
Hat 65.5
Weapon 60.8
Weaponry 60.8
Photographer 58.4
Gun 57

Clarifai

people 99.9
group 99.5
many 99.1
group together 99
adult 98.7
man 96.8
vehicle 96.5
administration 95.7
several 95.4
woman 94.5
wear 93.4
leader 90.1
war 88.7
military 88
music 87.5
recreation 82.3
five 79.3
crowd 79.3
one 78.9
spectator 77.9

Imagga

man 43
male 32.9
people 31.8
person 28.4
smiling 20.2
men 18.9
senior 18.7
happy 17.5
adult 16.5
together 15.8
hairdresser 15.5
sitting 15.5
child 14.4
work 14.4
outdoors 14.3
old 13.9
portrait 13.6
family 12.4
elderly 12.4
smile 11.4
women 11.1
shop 11
worker 10.8
grandmother 10.8
working 10.6
indoors 10.5
mature 10.2
two 10.2
lifestyle 10.1
color 10
team 9.8
computer 9.6
black 9.6
home 9.6
room 9.5
teenager 9.1
business 9.1
father 8.9
equipment 8.9
group 8.9
job 8.8
businessman 8.8
life 8.8
guy 8.7
boy 8.7
hat 8.6
face 8.5
hand 8.4
city 8.3
leisure 8.3
fun 8.2
care 8.2
music 8.1
mother 8
barbershop 7.9
love 7.9
grandfather 7.9
day 7.8
40s 7.8
generation 7.7
nurse 7.6
active 7.5
teamwork 7.4
professional 7.4
playing 7.3
children 7.3
relaxing 7.3
businesswoman 7.3
hospital 7.2
handsome 7.1
medical 7.1

Google

Microsoft

person 100
crowd 0.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Male, 98.7%
Confused 11.3%
Sad 13.8%
Surprised 1.3%
Calm 54.4%
Happy 1.2%
Disgusted 9.1%
Angry 8.8%

AWS Rekognition

Age 35-55
Gender Male, 97.5%
Sad 14.7%
Calm 30%
Angry 24.7%
Surprised 2.8%
Confused 14%
Happy 3.6%
Disgusted 10.1%

AWS Rekognition

Age 57-77
Gender Male, 94.8%
Calm 35.9%
Disgusted 12.6%
Angry 26.9%
Happy 4%
Confused 6.3%
Sad 9.1%
Surprised 5.2%

AWS Rekognition

Age 26-43
Gender Female, 78.6%
Disgusted 1.6%
Happy 1%
Angry 7.2%
Surprised 1.5%
Sad 5.9%
Calm 82.1%
Confused 0.7%

AWS Rekognition

Age 48-68
Gender Female, 52.8%
Calm 47%
Angry 45.6%
Happy 45.8%
Disgusted 45.7%
Sad 49.9%
Surprised 45.6%
Confused 45.4%

Microsoft Cognitive Services

Age 72
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 65.5%

Captions

Microsoft

a group of people posing for a photo 88.9%
a group of people posing for the camera 88.8%
a group of people posing for a picture 88.7%