Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

Date

1934-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2836

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2836

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Accessories 97.8
Bag 97.8
Handbag 97.8
Sitting 97
Stick 86.5
Overcoat 85.3
Coat 83
Glasses 77.7
Face 76.6
Head 76.6
Footwear 71.4
High Heel 71.4
Shoe 61.6
Hat 59.3
Shoe 57.5
Tripod 56.9
City 55.4
Photography 55.2

Clarifai
created on 2018-05-10

people 100
adult 98.7
one 98
two 96.9
wear 96.7
woman 96.4
man 96
administration 95.8
military 91.5
lid 90.2
veil 89.3
child 88.2
portrait 87.4
war 87.3
outfit 86.9
group together 85
three 83.9
group 83.6
actor 83.1
sit 81.2

Imagga
created on 2023-10-06

crutch 100
staff 100
stick 92.5
man 29.6
person 20.2
male 19.1
adult 17.5
bass 13.9
protection 13.6
portrait 13.6
people 12.8
one 12.7
trombone 12.6
sport 12.4
black 12
brass 11.2
old 11.1
clothing 11
walking 10.4
men 10.3
danger 10
equipment 9.9
music 9.9
holding 9.9
hand 9.9
worker 9.8
dark 9.2
city 9.1
studio 9.1
playing 9.1
dirty 9
suit 9
musician 8.9
standing 8.7
work 8.6
mask 8.6
play 8.6
musical instrument 8.6
safety 8.3
street 8.3
outdoors 8.2
industrial 8.2
working 8
indoors 7.9
wind instrument 7.8
protective 7.8
military 7.7
chemical 7.7
gas 7.7
instrument 7.7
fashion 7.5
happy 7.5
business 7.3
smile 7.1
interior 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.5
person 97
old 50.3
curb 7.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Male, 99.9%
Sad 88.3%
Calm 30%
Angry 13.9%
Confused 11.6%
Surprised 6.7%
Fear 6.2%
Disgusted 1.5%
Happy 0.5%

AWS Rekognition

Age 59-67
Gender Female, 99.9%
Calm 89.2%
Surprised 8.1%
Fear 6%
Sad 2.9%
Angry 1.9%
Confused 1.3%
Happy 1.2%
Disgusted 0.7%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.2%
Male 99.2%
Man 99.2%
Person 99.2%
Handbag 97.8%
Coat 83%
Glasses 77.7%
High Heel 71.4%
Shoe 61.6%
Hat 59.3%