Human Generated Data

Title

Untitled (West Forty-ninth Street and Sixth Avenue, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3016

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (West Forty-ninth Street and Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3016

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Adult 99
Male 99
Man 99
Person 99
Adult 98.7
Male 98.7
Man 98.7
Person 98.7
Adult 98.6
Male 98.6
Man 98.6
Person 98.6
City 98.5
Sun Hat 96.6
Hat 93.3
Hat 91.8
Face 91.7
Head 91.7
Urban 82.7
Smoke 78.8
Person 77.5
Hat 61
Accessories 60.3
Formal Wear 60.3
Tie 60.3
Body Part 57.6
Hand 57.6
Overcoat 57.4
Outdoors 57.3
Photography 57.1
Metropolis 57
Road 56.3
Street 56.3
Finger 55.9
Suit 55.7

Clarifai
created on 2018-05-10

people 99.9
group together 99.1
many 97.5
group 97.4
adult 97.1
administration 96
military 94.4
leader 92.2
war 92.1
man 91.4
veil 89.9
wear 89.3
vehicle 89.3
soldier 87.2
uniform 86.7
outfit 86.3
two 86.3
several 84.4
transportation system 84.4
police 82.7

Imagga
created on 2023-10-06

plane seat 34.2
man 33.6
seat 26.9
male 24.1
support 22.5
person 21.2
city 20.8
people 20.1
business 17.6
work 17.2
engineer 17
businessman 16.7
building 16.7
device 15.8
urban 14.8
suit 14.3
architecture 14
face 13.5
job 13.3
construction 12.8
passenger 12.7
old 11.8
sky 11.5
travel 11.3
looking 11.2
adult 11
worker 10.7
night 10.6
professional 10.4
manager 10.2
uniform 9.9
clothing 9.8
black 9.6
bridge 9.5
serious 9.5
cityscape 9.4
senior 9.4
light 9.3
industrial 9.1
technology 8.9
river 8.9
working 8.8
cornet 8.7
water 8.7
corporate 8.6
men 8.6
industry 8.5
brass 8.5
expression 8.5
buildings 8.5
portrait 8.4
mature 8.4
town 8.3
street 8.3
office 8.2
tower 8
metal 8
scene 7.8
wind instrument 7.7
summer 7.7
tie 7.6
power 7.5
dark 7.5
outdoors 7.5
landscape 7.4
safety 7.4
occupation 7.3
ship 7.3
protection 7.3
machine 7.1
steel 7.1
car 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.5
man 99.2
military uniform 96
old 94.2
hat 88.3
black 75.5
white 68.8
vintage 26.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Male, 99.3%
Calm 93.4%
Surprised 6.6%
Fear 5.9%
Happy 3.4%
Sad 2.5%
Confused 0.6%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 77.2%
Surprised 8.5%
Fear 8.4%
Happy 6.9%
Sad 2.9%
Disgusted 2%
Angry 1.1%
Confused 1%

AWS Rekognition

Age 12-20
Gender Male, 95.8%
Happy 59.9%
Sad 31.4%
Disgusted 7.3%
Surprised 7.2%
Fear 6.5%
Calm 3.7%
Angry 3.1%
Confused 1.5%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Hat 93.3%
Tie 60.3%

Text analysis

Amazon

RAD
STAI
5FUP
BLIC
RS
IMSS

Google

BLIC TAL
BLIC
TAL