Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2988
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2988

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Hardhat 99.8
Helmet 99.8
Captain 99.3
Officer 99.3
Person 99
Adult 99
Male 99
Man 99
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Accessories 95.3
Formal Wear 95.3
Face 94.6
Head 94.6
Photography 92.1
Portrait 92.1
Hat 90.6
Cap 84.6
Suit 83.4
Tie 82.3
Jacket 71.8
Terminal 62.7
Transportation 57.4
Vehicle 57.4
Baseball Cap 57.2
Sitting 56.1
Yacht 55.5
Overcoat 55
Shirt 55

Clarifai
created on 2018-05-10

people 99.9
adult 98.6
man 97.8
administration 97.6
two 97.5
vehicle 95.7
group together 95.3
wear 95
group 94.9
military 94.5
one 94.5
three 94.2
leader 93.9
portrait 92.9
transportation system 92.2
outfit 91.8
war 91.6
veil 91.5
four 86.9
lid 86.6

Imagga
created on 2023-10-06

man 51.1
male 42.6
business 40.7
businessman 37.1
office 35.9
person 35.1
people 30.7
suit 30.2
handsome 28.5
corporate 27.5
adult 27.4
professional 27.2
executive 23.7
happy 22.6
smiling 21
work 20.4
worker 20
job 19.5
portrait 18.8
computer 18.6
face 18.5
successful 18.3
confident 18.2
meeting 17.9
laptop 17.9
building 17.7
looking 17.6
attractive 17.5
men 17.2
smile 17.1
employee 17
working 16.8
tie 15.2
mature 14.9
communication 14.3
talking 14.3
necktie 14.2
clothing 14.1
indoors 14.1
bow tie 14.1
phone 13.8
sitting 13.7
businesswoman 13.6
serious 13.3
businesspeople 13.3
guy 13.2
manager 13
conversation 12.6
team 12.5
lifestyle 12.3
desk 12.3
cheerful 12.2
occupation 11.9
day 11.8
happiness 11.8
cell 11.5
look 11.4
career 11.4
group 11.3
success 11.3
waiter 11.1
expression 11.1
holding 10.7
employment 10.6
workplace 10.5
teamwork 10.2
glasses 10.2
indoor 10
salesman 9.9
grandfather 9.9
cellular 9.8
discussion 9.7
diversity 9.6
partnership 9.6
talk 9.6
garment 9.5
company 9.3
engineer 9.2
hand 9.1
black 9
dining-room attendant 8.9
jacket 8.8
40s 8.8
corporation 8.7
formal 8.6
ethnic 8.6
casual 8.5
senior 8.4
modern 8.4
alone 8.2
urban 7.9
couple 7.8
businessmen 7.8
scholar 7.8
outside 7.7
sales 7.7
communicate 7.6
student 7.6
mobile 7.5
device 7.5
shirt 7.5
technology 7.4
color 7.2
intellectual 7.2
love 7.1
together 7

Google
created on 2018-05-10

photograph 96.2
motor vehicle 91.9
black and white 90.7
gentleman 83.6
snapshot 81.8
photography 81.8
monochrome photography 80.7
standing 79.8
vintage clothing 72.1
vehicle 66.3
monochrome 66
film noir 56.7
station master 55.5
angle 55
military officer 54.3
stock photography 52.3
crew 50.7

Microsoft
created on 2018-05-10

person 99.8
man 97.4
old 92.7
black 87.9
white 78
hat 66.9
vintage 35.8
older 25.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 91.7%
Surprised 6.5%
Fear 6%
Sad 4%
Confused 1.3%
Happy 0.8%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 95.3%
Surprised 6.5%
Fear 5.9%
Sad 3.2%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Happy 0.1%

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Suit
Tie
Person 99%
Person 97.6%
Adult 99%
Adult 97.6%
Male 99%
Male 97.6%
Man 99%
Man 97.6%
Hat 90.6%
Suit 83.4%
Tie 82.3%

Captions

Microsoft
created on 2018-05-10

an old black and white photo of a man 97.7%
a black and white photo of a man 97.5%
a vintage photo of a man 97.4%

Text analysis

Amazon

-
adidas
If
and If - Now
Now
and