Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3024

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3024

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Formal Wear 99.6
Suit 99.6
Sitting 99.6
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 98.9
Person 98.1
Adult 98.1
Male 98.1
Man 98.1
Person 97.5
Adult 97.5
Male 97.5
Man 97.5
Person 97.3
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Adult 97.3
Male 97.3
Man 97.3
Person 95.6
Person 94.4
Person 92.8
Person 89
Face 87.5
Head 87.5
Sun Hat 86.9
Person 82.8
Footwear 81.2
Shoe 81.2
Hat 75.5
Overcoat 71.4
Furniture 64.3
Shoe 62.9
Bench 60.4
Shoe 60.2
Smoke 57.6
Accessories 57.1
Glasses 57.1
Shoe 57
Art 55.7
Painting 55.7
Shoe 55.2
Cap 55

Clarifai
created on 2018-05-10

people 100
group 99.3
group together 98.8
adult 98.7
many 98.4
administration 97.5
man 96.8
leader 95
woman 94.7
several 94.5
military 92.9
wear 92.7
vehicle 91.5
veil 90.6
war 90.5
chair 90.4
outfit 90.2
two 89.1
transportation system 88
sit 88

Imagga
created on 2023-10-06

person 41.8
man 38.9
scholar 34.7
people 32.3
intellectual 27.7
male 24.8
business 21.8
sitting 20.6
professional 20.3
adult 20
attractive 18.9
happy 18.8
lifestyle 17.3
men 17.2
smile 16.4
portrait 16.2
room 16.1
businessman 15.9
chair 15.8
work 15.7
office 15
building 14.6
businesswoman 14.5
suit 14
corporate 13.7
casual 13.5
job 13.3
working 13.2
clothing 13.2
couple 13.1
mature 13
looking 12.8
worker 12.5
handsome 12.5
indoors 12.3
smiling 12.3
face 12.1
outdoors 11.9
old 11.8
cheerful 11.4
executive 11.1
20s 11
group 10.5
jacket 10.5
one 10.4
computer 10.4
career 10.4
sit 10.4
senior 10.3
street 10.1
occupation 10.1
wheelchair 9.8
bench 9.8
look 9.6
home 9.6
meeting 9.4
happiness 9.4
industry 9.4
relaxed 9.4
architecture 9.4
black 9.3
laptop 9.2
outdoor 9.2
successful 9.1
city 9.1
indoor 9.1
confident 9.1
pretty 9.1
hat 9.1
aged 9
fashion 9
team 8.9
interior 8.8
women 8.7
student 8.6
day 8.6
businesspeople 8.5
seat 8.5
two 8.5
horizontal 8.4
success 8
coat 7.9
love 7.9
together 7.9
urban 7.9
wall 7.7
ethnic 7.6
reading 7.6
leisure 7.5
manager 7.4
glasses 7.4
lady 7.3
sexy 7.2
autumn 7

Microsoft
created on 2018-05-10

person 99.5
outdoor 96
people 87.6
group 75.4
old 42.1
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 100%
Happy 96.4%
Surprised 6.4%
Fear 6%
Calm 2.9%
Sad 2.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 56-64
Gender Male, 96.3%
Calm 94.3%
Surprised 6.4%
Fear 5.9%
Confused 3%
Sad 2.5%
Angry 1.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 58-66
Gender Male, 100%
Sad 83.7%
Fear 29.8%
Calm 23.2%
Surprised 7.1%
Confused 3.7%
Happy 2.4%
Angry 1.4%
Disgusted 1.1%

AWS Rekognition

Age 56-64
Gender Male, 93.6%
Calm 73.9%
Happy 14.7%
Surprised 6.9%
Fear 6.1%
Sad 3.5%
Confused 2.9%
Angry 1.7%
Disgusted 1.5%

AWS Rekognition

Age 50-58
Gender Female, 91.8%
Sad 99.2%
Confused 11.1%
Calm 9.9%
Surprised 8.4%
Angry 7.1%
Fear 6.9%
Disgusted 4.6%
Happy 0.7%

AWS Rekognition

Age 47-53
Gender Male, 100%
Sad 88.9%
Calm 37.1%
Angry 9.2%
Happy 7.2%
Surprised 7.1%
Fear 6.2%
Disgusted 2.1%
Confused 0.9%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Confused 61.7%
Sad 58.5%
Surprised 7.5%
Fear 6.4%
Calm 3.5%
Happy 0.8%
Angry 0.8%
Disgusted 0.5%

AWS Rekognition

Age 9-17
Gender Male, 74.9%
Happy 93.7%
Surprised 8.1%
Fear 5.9%
Sad 2.3%
Calm 1.4%
Disgusted 0.6%
Angry 0.4%
Confused 0.2%

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 66
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Adult 99.1%
Male 99.1%
Man 99.1%
Shoe 81.2%
Hat 75.5%
Glasses 57.1%

Text analysis

Amazon

+
MARTS
SCHOOL
SP