Human Generated Data

Title

Untitled (New York City)
Date

November 1935-1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2905
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

November 1935-1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2905

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Formal Wear 97.4
Suit 97.4
Hat 90.5
Face 88.1
Head 88.1
Hat 86
Electronics 76.4
Phone 76.4
Shop 66.5
Photography 62.4
Mobile Phone 57.9
Book 57.8
Publication 57.8
Overcoat 57.5
Jacket 57.1
Sun Hat 57
Portrait 56.7
Smoke 55.8

Clarifai
created on 2018-05-10

people 99.9
adult 98.1
two 98
group 97.8
man 96.7
administration 96
veil 95.3
wear 95.1
three 94.7
group together 91.9
four 90.3
outfit 90.2
leader 89
several 87.8
portrait 87
lid 85.9
one 85.9
offense 84.6
military 84.2
law 84

Imagga
created on 2023-10-06

bartender 52.7
man 51.7
male 40.4
people 31.2
person 30.7
shop 28.6
business 24.3
suit 23.3
adult 22.8
tobacco shop 21.7
men 21.5
portrait 21.3
black 20.3
work 19.6
face 19.2
mercantile establishment 18.9
businessman 18.5
office 18.5
job 16.8
guy 16.3
professional 15.6
smile 15
corporate 14.6
handsome 14.3
smiling 13.7
clothing 13.2
worker 13
looking 12.8
place of business 12.6
tie 12.3
glasses 12
head 11.8
attractive 11.2
industry 11.1
executive 11
happy 10.6
working 10.6
look 10.5
couple 10.4
standing 10.4
sitting 10.3
hat 10.2
lifestyle 10.1
building 9.7
one 9.7
computer 9.6
intellectual 9.4
casual 9.3
mature 9.3
scholar 9.3
communication 9.2
studio 9.1
hand 9.1
confident 9.1
technology 8.9
bow tie 8.7
happiness 8.6
formal 8.6
workplace 8.6
expression 8.5
safety 8.3
holding 8.3
occupation 8.2
indoors 7.9
restaurant 7.7
old 7.7
equipment 7.6
garment 7.6
meeting 7.5
shirt 7.5
phone 7.4
industrial 7.3
sexy 7.2
women 7.1
love 7.1

Google
created on 2018-05-10

photograph 96.2
black 94.9
standing 89.3
black and white 88.6
snapshot 81.8
photography 80.8
gentleman 80.6
vintage clothing 77
monochrome photography 76.3
monochrome 63.3
film noir 54.5
street 52.7
stock photography 50.9

Microsoft
created on 2018-05-10

person 98.8
standing 77.4
store 68.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Happy 53.9%
Calm 23.1%
Sad 9.1%
Fear 7.1%
Surprised 7%
Confused 3%
Angry 2.7%
Disgusted 2.2%

AWS Rekognition

Age 40-48
Gender Male, 97.9%
Calm 93.2%
Surprised 6.5%
Fear 6.2%
Sad 3.2%
Happy 0.9%
Disgusted 0.7%
Angry 0.5%
Confused 0.4%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.1%
Male 99.1%
Man 99.1%
Person 99.1%
Hat 90.5%

Text analysis

Amazon

The
Chocolated
9
STOPE
Laxative
EXLAX
THIS STOPE
-
THIS
:
N
on
I
on 29 :
for
|
NO
I I N -
de
40
for your de de
Prescriptions
h
your
h Commission
NS
29
Commission
601
at
601 are
by
at by 34
are
34
US

Google

LAX The
LAX
The