Human Generated Data

Title

Untitled (New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3815

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3815

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Sun Hat 99.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Adult 98.6
Male 98.6
Man 98.6
Person 98.6
Formal Wear 97.6
Suit 97.6
Person 97.5
Sitting 97.5
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Adult 96.8
Male 96.8
Man 96.8
Person 96.8
Body Part 96.4
Finger 96.4
Hand 96.4
Person 95.6
Adult 89
Male 89
Man 89
Person 89
Face 87.4
Head 87.4
Person 78.1
Accessories 76.8
Glasses 76.8
Person 76.5
Hat 75.3
Overcoat 62.5
Footwear 61.3
Shoe 61.3
Shoe 59.7
Shoe 59.5
Fashion 57.1
Furniture 57
Cap 56.6
Shirt 56.1
Photography 55.9
Portrait 55.9
Home Decor 55.7
Linen 55.7
People 55.5
Bonnet 55.2

Clarifai
created on 2018-05-09

people 98.9
group 93.8
man 93.6
adult 93.5
wear 92.3
woman 89.7
veil 88.3
several 84.3
many 83.7
group together 82.8
outfit 81.6
lid 73.6
hospital 73.2
war 73.1
scientist 72.5
indoors 71
offense 68.2
vehicle 66.6
child 66.3
military 66

Imagga
created on 2023-10-06

person 43.3
patient 41.9
man 37
people 31.8
male 26.9
medical 26.5
home 26.3
hospital 24.7
room 22.3
doctor 21.6
adult 21.6
surgeon 20.9
professional 20.6
indoors 20.2
coat 20
health 19.5
illness 18.1
case 17.8
lab coat 17.8
working 17.7
men 17.2
bed 17.1
sick person 17
nurse 16.9
senior 16.9
office 16.9
business 15.8
work 15.7
smiling 15.2
businessman 15
medicine 15
computer 14.5
team 14.3
horizontal 12.6
worker 12.4
care 12.3
women 11.9
portrait 11.6
specialist 11.5
resting 11.4
happy 11.3
sitting 11.2
mature 11.2
occupation 11
sick 10.6
equipment 10.5
technology 10.4
surgery 9.8
clothing 9.7
interior 9.7
job 9.7
two people 9.7
lab 9.7
colleagues 9.7
laboratory 9.6
30s 9.6
elderly 9.6
profession 9.6
casual 9.3
laptop 9.3
inside 9.2
house 9.2
20s 9.2
indoor 9.1
clinic 9.1
newspaper 9.1
old 9.1
uniform 8.7
couple 8.7
lifestyle 8.7
garment 8.6
meeting 8.5
human 8.2
cheerful 8.1
family 8
to 8
middle aged 7.8
retired 7.8
retirement 7.7
mask 7.7
student 7.6
talking 7.6
teamwork 7.4
camera 7.4
businesswoman 7.3
bedroom 7.3
color 7.2
table 7.1
smile 7.1
science 7.1
face 7.1
modern 7
together 7
jacket 7

Google
created on 2018-05-09

Microsoft
created on 2023-10-30

text 99.6
clothing 91
person 82.2
man 76.3
fashion accessory 64.5
hat 61.5
clothes 15.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 75.5%
Surprised 20.3%
Fear 7.3%
Sad 3.4%
Confused 0.8%
Angry 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 86.6%
Surprised 7.2%
Fear 7%
Angry 5.5%
Sad 2.8%
Confused 0.6%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 24-34
Gender Male, 98.7%
Sad 100%
Calm 9%
Surprised 6.3%
Fear 6%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 38-46
Gender Male, 95.9%
Calm 98.6%
Surprised 6.3%
Fear 6%
Sad 2.3%
Confused 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 77.3%
Sad 11.1%
Surprised 7.1%
Fear 6.1%
Happy 3.9%
Confused 1.6%
Angry 1.5%
Disgusted 1.2%

Feature analysis

Amazon

Adult 98.8%
Male 98.8%
Man 98.8%
Person 98.8%
Glasses 76.8%
Hat 75.3%
Shoe 61.3%

Categories

Captions

Microsoft
created on 2023-10-30

text 39.7%

Text analysis

Amazon

College
Harvard
Fellows
Museums)
Art
and
University
of
President and Fellows of Harvard College (Harvard University Art Museums)
(Harvard
P1970.3815.0000
President
SCHOOL
+
MARTS

Google

and
of
(Harvard
University
Art
Museums)
P1970.3815.0000
@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.3815.0000
@
President
Fellows
Harvard
College