Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3025

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3025

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Bench 100
Furniture 100
Sitting 99.5
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 98.9
Adult 98.9
Female 98.9
Woman 98.9
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.5
Adult 98.5
Male 98.5
Man 98.5
Person 98.5
Adult 98.5
Male 98.5
Man 98.5
Person 96.2
Adult 96.2
Male 96.2
Man 96.2
Clothing 91.6
Coat 91.6
Person 91.4
Footwear 90.9
Shoe 90.9
Person 89
Person 88.5
Architecture 87.6
Building 87.6
Formal Wear 87.3
Suit 87.3
City 86.9
Shoe 86.8
Person 86.2
Adult 86.2
Male 86.2
Man 86.2
Shoe 83.6
Person 83.2
Urban 83
Hat 82.8
People 81.9
Face 77.3
Head 77.3
Person 75.6
Shoe 74.7
Shoe 66.7
Neighborhood 66.5
Person 64.7
Person 62
Table 56.8
Park Bench 56.5
Photography 55.5
Portrait 55.5
Shirt 55.5
Cap 55
Monastery 55

Clarifai
created on 2018-05-10

people 100
group 99.5
group together 99
many 98.7
adult 97.9
administration 96.4
leader 96.3
man 94.2
vehicle 92.3
several 92.3
war 90.1
child 89.4
woman 87.9
military 86.7
chair 86.6
home 86.2
furniture 86
two 82.8
wear 81.2
transportation system 80.5

Imagga
created on 2023-10-05

man 27.6
people 27.3
pedestrian 27
business 22.5
male 22
person 21.2
building 20.9
city 20.8
corporate 20.6
architecture 19.5
businessman 18.5
work 18
group 16.9
clothing 16.9
men 16.3
sitting 15.5
businesswoman 14.5
academic gown 14.5
adult 14.5
team 12.5
office 12.2
monument 12.1
smile 12.1
spectator 12
travel 12
suit 12
20s 11.9
old 11.8
gown 11.6
businesspeople 11.4
executive 11.4
meeting 11.3
happy 11.3
street 11
professional 11
smiling 10.8
working 10.6
university 10.5
standing 10.4
life 10.2
day 10.2
uniform 10.1
bench 9.9
history 9.8
colleagues 9.7
computer 9.7
together 9.6
looking 9.6
sculpture 9.6
laptop 9.4
lifestyle 9.4
casual 9.3
outdoor 9.2
portrait 9.1
musical instrument 8.9
scholar 8.8
outerwear 8.8
urban 8.7
statue 8.6
mature 8.4
town 8.3
tourism 8.2
outdoors 8.2
confident 8.2
military uniform 8.2
success 8
women 7.9
businessmen 7.8
corporation 7.7
covering 7.6
consumer goods 7.6
finance 7.6
tourist 7.5
park 7.4
church 7.4
cheerful 7.3
color 7.2
landmark 7.2
wind instrument 7.2
worker 7.2
seat 7.1
love 7.1
face 7.1
intellectual 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 97.6
sitting 96.2
outdoor 92.8
people 87.1
group 82.6
old 55.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.7%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 36-44
Gender Male, 93.8%
Calm 77.4%
Happy 16.3%
Surprised 6.6%
Fear 6.2%
Sad 2.8%
Confused 1.5%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 33-41
Gender Female, 99.2%
Calm 44.4%
Sad 41.9%
Confused 17.4%
Surprised 7.2%
Fear 6.6%
Disgusted 5.6%
Angry 3.6%
Happy 0.8%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 81.7%
Surprised 6.9%
Fear 6.1%
Disgusted 4.7%
Sad 3.3%
Angry 3%
Confused 2.8%
Happy 2.7%

AWS Rekognition

Age 56-64
Gender Male, 100%
Happy 91.4%
Surprised 6.4%
Fear 6%
Sad 4.7%
Confused 1.3%
Calm 0.5%
Disgusted 0.3%
Angry 0.1%

AWS Rekognition

Age 52-60
Gender Male, 99.3%
Calm 99.1%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 41-49
Gender Male, 100%
Sad 98%
Calm 31.9%
Confused 9.4%
Surprised 6.7%
Fear 6%
Angry 1.7%
Disgusted 1.5%
Happy 0.7%

AWS Rekognition

Age 16-22
Gender Female, 93.6%
Calm 78.9%
Sad 19.1%
Surprised 6.3%
Fear 6.1%
Happy 3.2%
Angry 0.3%
Disgusted 0.2%
Confused 0.1%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 76
Gender Male

Microsoft Cognitive Services

Age 72
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Adult 99.1%
Male 99.1%
Man 99.1%
Female 98.9%
Woman 98.9%
Shoe 90.9%
Building 87.6%

Categories

Text analysis

Amazon

SCHOOL
ST
MARTS