Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)
Date

c. 1945
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4360.5

Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4360.5

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Adult 98.4
Male 98.4
Man 98.4
Person 98.4
Adult 98.3
Male 98.3
Man 98.3
Person 98.3
Adult 94.7
Male 94.7
Man 94.7
Person 94.7
Adult 94.4
Male 94.4
Man 94.4
Person 94.4
Person 93.5
Overcoat 91.1
Sun Hat 91
Adult 88.7
Male 88.7
Man 88.7
Person 88.7
Person 88.7
Person 88.6
Person 88.5
Adult 88.2
Male 88.2
Man 88.2
Person 88.2
Person 85.3
Person 82.3
Cap 79.2
Person 78.8
Head 75.8
Hat 74.9
Face 73.8
Person 70.1
Outdoors 67.2
Person 66.3
Person 65.9
Person 64.5
Person 62
Hat 58.5
Person 58.1
People 55.5

Clarifai
created on 2018-05-09

people 100
group 99.1
adult 97.9
man 96.1
group together 95.6
veil 93.9
woman 93.5
several 92.6
many 92.2
wear 90.8
child 90
administration 89.1
two 86
leader 84.9
furniture 83.5
military 83.3
vehicle 82.6
one 81.6
four 80.4
sit 79.9

Imagga
created on 2023-10-06

man 29.6
person 27.8
vestment 27.8
gown 26.8
clothing 25.4
male 22.7
coat 22.4
people 22.3
lab coat 20.1
outerwear 16.7
men 16.3
medical 15.9
work 14.2
room 14
patient 13.7
worker 13.3
hospital 12.8
adult 12.8
doctor 12.2
metropolitan 11.4
medicine 11.4
health 11.1
fan 10.9
garment 10.9
religion 10.8
professional 10.3
nurse 9.9
working 9.7
home 9.6
happy 9.4
surgeon 9.3
two 9.3
tradition 9.2
old 9.1
interior 8.8
follower 8.8
surgery 8.8
uniform 8.8
couple 8.7
profession 8.6
sitting 8.6
serious 8.6
face 8.5
clothes 8.4
hand 8.4
table 8.2
technology 8.2
equipment 8.1
looking 8
holiday 7.9
scientist 7.8
seller 7.8
lab 7.8
laboratory 7.7
shop 7.4
church 7.4
wedding 7.4
office 7.3
historic 7.3
business 7.3
food 7.3
kitchen 7.2
smiling 7.2
building 7.2
color 7.2
mask 7.2
history 7.2
smile 7.1
covering 7.1
love 7.1
job 7.1
businessman 7.1
day 7.1
architecture 7
indoors 7

Google
created on 2018-05-09

white 96.1
photograph 95.7
black and white 92.5
monochrome photography 82.6
monochrome 75.5
history 70
vintage clothing 63
religion 57.3
stock photography 53.5

Microsoft
created on 2018-05-09

person 91.2
text 85.4
old 59.3
clothes 18.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Female, 98.4%
Happy 93.2%
Surprised 6.6%
Fear 5.9%
Calm 3.4%
Sad 2.5%
Angry 0.7%
Disgusted 0.7%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Female, 59.6%
Calm 76.6%
Fear 7.1%
Surprised 6.9%
Happy 6.2%
Sad 5.5%
Confused 3.1%
Angry 1.6%
Disgusted 1.3%

AWS Rekognition

Age 18-24
Gender Female, 68.8%
Calm 63.6%
Fear 19.2%
Surprised 7%
Sad 5.5%
Angry 2.5%
Disgusted 2.4%
Happy 2.1%
Confused 1.2%

AWS Rekognition

Age 13-21
Gender Male, 99.4%
Calm 88.4%
Fear 10.3%
Surprised 6.3%
Sad 2.2%
Happy 1%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Male, 69.9%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 20-28
Gender Female, 65.9%
Calm 91.3%
Surprised 6.4%
Fear 6.1%
Confused 2.9%
Sad 2.8%
Happy 1.9%
Disgusted 0.5%
Angry 0.4%

Feature analysis

Amazon

Adult 98.4%
Male 98.4%
Man 98.4%
Person 98.4%
Hat 74.9%

Text analysis

Amazon

Art
and
University
College
of
(Harvard
Harvard
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
President
P1970.4360.0005
N C

Google

@
and
of
College
University
Art
Museums)
P1970.4360.0005
21 @ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4360.0005
21
President
Fellows
Harvard
(Harvard