Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2834

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2834

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Bench 100
Furniture 100
Sitting 99.7
Clothing 99.4
Formal Wear 99.4
Suit 99.4
Person 99
Adult 99
Male 99
Man 99
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.7
Coat 98.5
Person 98.2
Adult 98.2
Male 98.2
Man 98.2
Person 98
Adult 98
Male 98
Man 98
Person 97.9
Adult 97.9
Male 97.9
Man 97.9
Person 91.8
Person 89.6
Person 89
City 88.5
Footwear 87.8
Shoe 87.8
Person 86.7
Shoe 86.6
Shoe 83.7
Architecture 79.6
Building 79.6
Urban 78.1
People 76.4
Shoe 73.9
Face 73.8
Head 73.8
Person 71.7
Person 70
Shoe 62.9
Shoe 62.3
Person 62
Shoe 57.3
Neighborhood 57.1
Overcoat 56.5
Hat 56.3
Shirt 56.2
Park Bench 56.1

Clarifai
created on 2018-05-10

people 99.9
group 99.4
group together 99.1
many 98.4
adult 97.9
leader 97.1
administration 97
man 95.1
several 92.2
vehicle 90.1
woman 89.1
chair 89.1
home 88.4
war 88.3
military 85.1
furniture 84.7
outfit 82.5
wear 80.6
education 79.5
soldier 74.6

Imagga
created on 2023-10-05

architecture 27.5
city 25.8
people 23.4
pedestrian 23.1
building 22.3
academic gown 20.4
park bench 20.3
bench 20.2
travel 18.3
gown 16.4
man 16.1
seat 16.1
clothing 16
university 15.8
person 15.5
old 15.3
town 14.8
street 14.7
tourism 14
male 13.5
musical instrument 13.4
religion 13.4
history 13.4
statue 13.3
urban 13.1
outerwear 12.5
business 12.1
monument 12.1
church 12
stone 12
house 11.7
men 11.2
culture 11.1
day 11
arch 10.9
tourist 10.4
corporate 10.3
adult 10.3
famous 10.2
keyboard instrument 10.2
accordion 9.8
cathedral 9.7
group 9.7
sculpture 9.6
sitting 9.5
work 9.4
place 9.3
spectator 9.2
historic 9.2
square 9
marble 8.7
crowd 8.6
life 8.5
classroom 8.5
scholar 8.3
furniture 7.8
ancient 7.8
wind instrument 7.7
outdoors 7.5
mature 7.4
vacation 7.4
room 7.3
road 7.2
women 7.1
monk 7.1
businessman 7.1
column 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

sitting 95.9
outdoor 94.9
person 85.5
people 66
group 56.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 74.1%
Angry 9.4%
Surprised 7%
Fear 6.3%
Sad 4.7%
Disgusted 4%
Confused 3%
Happy 1.2%

AWS Rekognition

Age 59-69
Gender Male, 100%
Happy 62.8%
Sad 22.7%
Confused 7.5%
Fear 7%
Surprised 6.8%
Calm 5.6%
Disgusted 1.5%
Angry 0.6%

AWS Rekognition

Age 54-62
Gender Female, 98.8%
Calm 95.6%
Surprised 6.5%
Fear 6%
Sad 2.7%
Confused 1%
Angry 0.5%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Happy 61.6%
Calm 32.1%
Surprised 6.8%
Fear 6.1%
Sad 2.9%
Confused 1.2%
Disgusted 0.8%
Angry 0.6%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 86.7%
Disgusted 12.1%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 59-69
Gender Male, 86%
Calm 98.5%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.8%
Confused 0.2%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 36-44
Gender Male, 100%
Confused 48.2%
Calm 27%
Sad 9.3%
Angry 8.3%
Surprised 6.9%
Fear 6%
Disgusted 2.9%
Happy 1.1%

AWS Rekognition

Age 19-27
Gender Female, 95.6%
Calm 71.3%
Sad 32.6%
Surprised 6.6%
Fear 6.2%
Happy 4%
Angry 1.2%
Disgusted 0.3%
Confused 0.1%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 70
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Adult 99%
Male 99%
Man 99%
Shoe 87.8%
Building 79.6%

Categories

Text analysis

Amazon

MARTS
SCHOOL
ST