Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3032
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3032

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Sun Hat 99.1
Face 87.1
Head 87.1
Cap 83.5
Adult 75.3
Person 75.3
Bride 75.3
Female 75.3
Wedding 75.3
Woman 75.3
Hat 73.1
Hat 70.2
Advertisement 57.1
Formal Wear 56.3
Suit 56.3
Hat 56.2
Overcoat 56
Poster 55.3
Photography 55.3

Clarifai
created on 2018-05-10

people 99.8
adult 97.8
group 95
man 94.8
administration 93.5
lid 92.3
war 91.7
offense 91.6
group together 91.1
education 90.1
fedora 87.7
one 86.2
military 85.5
leader 85.1
two 84.8
sitting 83.9
three 83.8
several 83.7
woman 83.1
wear 82.8

Imagga
created on 2023-10-05

blackboard 100
education 30.3
classroom 28.5
school 25.2
male 24.8
man 24.2
person 24.1
board 23.5
people 22.9
chalkboard 22.5
class 22.2
student 21.7
chalk 20.4
study 19.6
teacher 18.9
black 18
college 18
learn 16.1
adult 15.7
human 15
mathematics 14.7
teaching 14.6
hand 14.4
university 14.3
portrait 14.2
business 14
lesson 13.6
jacket 12.5
book jacket 12.3
men 12
happy 11.9
work 11.8
math 11.8
knowledge 11.5
exam 11.5
businessman 11.5
standing 11.3
looking 11.2
casual 11
formula 10.8
financial 10.7
information 10.6
writing 10.3
youth 10.2
room 10.1
smile 10
modern 9.8
success 9.7
studying 9.6
book 9.6
horizontal 9.2
dark 9.2
one 9
science 8.9
world 8.8
teach 8.8
text 8.7
chart 8.6
smart 8.5
learning 8.4
finance 8.4
exercise 8.2
symbol 8.1
boy 7.8
drawing 7.7
sign 7.5
holding 7.4
safety 7.4
guy 7.4
back 7.3
indoor 7.3
teenager 7.3
wrapping 7.3
lifestyle 7.2
handsome 7.1
face 7.1
to 7.1

Google
created on 2018-05-10

photograph 95.5
black and white 91.2
monochrome photography 78.1
poster 77.7
human behavior 77.4
monochrome 68.2
gentleman 65
font 62
vintage clothing 57.9
stock photography 53.2

Microsoft
created on 2018-05-10

person 98.7
outdoor 97.7
text 88.5
old 50.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 40-48
Gender Male, 97.9%
Calm 64%
Surprised 14.7%
Sad 8.2%
Angry 6.7%
Fear 6.5%
Confused 2.4%
Disgusted 2.2%
Happy 2.1%

AWS Rekognition

Age 24-34
Gender Female, 52.3%
Sad 66.7%
Happy 35.1%
Fear 10.4%
Confused 9.1%
Surprised 7.5%
Calm 5.4%
Angry 5.1%
Disgusted 2.2%

AWS Rekognition

Age 41-49
Gender Male, 84.4%
Calm 59.4%
Surprised 29.1%
Sad 12.5%
Fear 6.9%
Angry 1.4%
Disgusted 0.9%
Confused 0.8%
Happy 0.8%

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman
Hat
Adult 99.4%
Adult 99.3%
Adult 99.3%
Adult 99.3%
Adult 75.3%
Male 99.4%
Male 99.3%
Male 99.3%
Male 99.3%
Man 99.4%
Man 99.3%
Man 99.3%
Man 99.3%
Person 99.4%
Person 99.3%
Person 99.3%
Person 99.3%
Person 75.3%
Bride 75.3%
Female 75.3%
Woman 75.3%
Hat 73.1%
Hat 70.2%
Hat 56.2%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 82.2%
a man holding a sign 70.5%
a black and white photo of a man 70.4%

Text analysis

Amazon

OTTON
ELOURS
ELVETS
ELVETEENS
WEINST
&
EISENBERG & WEINST
EISENBERG
ORDUR
VE

Google

ISENBERG&WEINS ORDUR OTTON OTTON ネ/ELVETS ELVETEENS ELOURS
ISENBERG&WEINS
ORDUR
OTTON
ネ
/
ELVETS
ELVETEENS
ELOURS