Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3649
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3649

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Coat 99.8
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Hat 98.1
Hat 90.8
Face 89.9
Head 89.9
Photography 65.8
Portrait 65.8
Formal Wear 64.9
Suit 64.9
Overcoat 57.3
Cap 56.4
Brick 55.1

Clarifai
created on 2018-05-10

people 99.7
lid 99.4
adult 97.8
veil 97.7
man 97.7
one 97.4
wear 96.5
elderly 94.4
fedora 92.8
portrait 92.1
retro 89.2
cowboy hat 88.4
facial expression 85.7
outfit 83.7
administration 82.8
cigar 82.2
street 81.8
music 81.7
side view 81.4
cap 80.5

Imagga
created on 2023-10-06

hat 45.9
clothing 41.1
military uniform 39.1
uniform 35.8
man 35.6
male 33.3
cowboy hat 32.3
person 29
people 25.7
covering 24
consumer goods 23.2
headdress 22.9
portrait 21.4
adult 20.7
men 18.9
face 15.6
black 14.4
smile 13.5
model 13.2
scholar 12.8
head 12.6
old 12.5
suit 12
building 11.9
hair 11.9
look 11.4
human 11.2
worker 11.2
professional 11
lifestyle 10.8
hand 10.6
serious 10.5
bow tie 10.5
business 10.3
love 10.3
intellectual 10.2
work 10.2
guy 10.1
occupation 10.1
handsome 9.8
job 9.7
boy 9.6
smiling 9.4
industry 9.4
vintage 9.1
attractive 9.1
retro 9
harmonica 8.9
family 8.9
looking 8.8
happy 8.8
happiness 8.6
necktie 8.5
world 8.4
businessman 7.9
life 7.9
engineer 7.9
couple 7.8
architecture 7.8
helmet 7.7
construction 7.7
pretty 7.7
youth 7.7
confidence 7.7
tie 7.6
fashion 7.5
dark 7.5
one 7.5
style 7.4
care 7.4
groom 7.4
safety 7.4
cheerful 7.3
free-reed instrument 7.1

Google
created on 2018-05-10

photograph 95.7
black 95
man 93.3
human behavior 85.7
black and white 84.5
snapshot 81.8
male 81
photography 80.7
wall 79.6
standing 78.5
gentleman 71.7
human 69.5
monochrome photography 65.7
window 65
monochrome 64.7
vintage clothing 58.4
angle 54.9
conversation 51.2

Microsoft
created on 2018-05-10

person 99.8
man 98.8
older 24.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 27-37
Gender Female, 70.1%
Calm 99.4%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 35-43
Gender Male, 98.3%
Calm 97.5%
Surprised 6.3%
Fear 6%
Sad 2.4%
Confused 0.4%
Happy 0.4%
Angry 0.2%
Disgusted 0.2%

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Hat 98.1%

Categories

Imagga

interior objects 83.8%
paintings art 12.3%
streetview architecture 3.7%

Captions

Microsoft
created on 2018-05-10

a man wearing a hat 92.9%
a man wearing a suit and tie 92.8%
a man wearing a suit and hat 92.7%

Text analysis

Amazon

SALAD
TEA
THE
10
THE BARGE
BARGE
Stapidity