Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)
Date

1934-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3593
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Welfare Hospital, Welfare Island, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3593

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 99.7
Body Part 99.7
Finger 99.7
Hand 99.7
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Overcoat 99.2
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Coat 96
Person 94
Face 93.6
Head 93.6
Fashion 90
Sitting 88.5
Hat 84.1
Coat 77
Accessories 69.1
Glasses 69.1
Photography 57.1
Portrait 57.1
Stick 55.9
Hat 55.8
Cap 55.6

Clarifai
created on 2018-05-10

people 99.9
adult 97.7
one 97.7
man 97.4
lid 97.3
veil 96.7
wear 96.7
two 94.7
elderly 92.7
woman 91.2
portrait 90.3
three 88.1
outfit 86.7
administration 86.5
offense 83.7
walking stick 82.7
outerwear 82.1
group 82
street 81.5
military 81.4

Imagga
created on 2023-10-06

crutch 100
staff 98.5
stick 73.9
man 29.6
people 22.3
adult 20.7
person 20.6
male 20.6
passenger 18.5
portrait 15.5
fashion 14.3
old 13.9
dark 12.5
black 12.2
business 12.1
sexy 12
men 12
room 11.8
work 11.8
model 11.7
attractive 11.2
interior 10.6
indoors 10.5
one 10.4
sitting 10.3
posing 9.8
working 9.7
looking 9.6
window 9.2
travel 9.1
leisure 9.1
worker 8.8
urban 8.7
building 8.7
light 8.7
repair 8.6
art 8.5
safety 8.3
inside 8.3
holding 8.2
sensual 8.2
stylish 8.1
dress 8.1
transportation 8.1
chair 7.9
smile 7.8
standing 7.8
prayer 7.7
pretty 7.7
studio 7.6
human 7.5
alone 7.3
indoor 7.3
industrial 7.3
metal 7.2
suit 7.2
body 7.2
religion 7.2
handsome 7.1
job 7.1

Google
created on 2018-05-10

black 96.1
photograph 95.6
black and white 90.8
infrastructure 88.2
photography 83.1
standing 81.9
snapshot 81.8
male 79.9
monochrome photography 79.9
street 70.8
human 68.7
monochrome 66.5
darkness 54.2
film noir 54
human behavior 52.5
gentleman 51

Microsoft
created on 2018-05-10

person 98
man 93.3
black 66.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 65-75
Gender Male, 100%
Calm 92.4%
Surprised 6.4%
Fear 5.9%
Sad 4.2%
Angry 1.6%
Disgusted 0.5%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 49-57
Gender Male, 94.5%
Calm 79.3%
Angry 7%
Surprised 6.6%
Fear 6.4%
Sad 6.1%
Disgusted 3.5%
Happy 0.4%
Confused 0.3%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Coat
Hat
Glasses
Person 99.4%
Person 98.8%
Person 94%
Adult 99.4%
Adult 98.8%
Male 99.4%
Male 98.8%
Man 99.4%
Man 98.8%
Coat 96%
Coat 77%
Hat 84.1%
Hat 55.8%
Glasses 69.1%

Categories

Imagga

paintings art 91.4%
streetview architecture 4.3%
people portraits 2.4%

Captions

Microsoft
created on 2018-05-10

a man wearing a black hat 90.7%
a man sitting on a bus 46.7%
a man sitting on a bench 46.6%