Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)

Date

c. 1945

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4362.3

Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4362.3

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 99.8
Adult 97.9
Male 97.9
Man 97.9
Person 97.9
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Adult 97.1
Male 97.1
Man 97.1
Person 97.1
People 96
Adult 95.7
Male 95.7
Man 95.7
Person 95.7
Person 94.9
Adult 92.9
Person 92.9
Bride 92.9
Female 92.9
Wedding 92.9
Woman 92.9
Person 91.6
Baby 91.6
Coat 91.6
Person 88.8
Adult 88.4
Male 88.4
Man 88.4
Person 88.4
Person 88.1
Person 88.1
Person 88
Person 86.6
Person 82.2
Person 77.4
Outdoors 75.3
Person 73.9
Face 69.1
Head 69.1
Person 69
Person 67
Person 65.8
Hat 64.5
Person 64.4
Nature 63.5
Snow 63.5
Person 63.1
Crowd 57.5
Art 55.5
Painting 55.5

Clarifai
created on 2018-05-09

people 99.9
many 98.8
group 98.7
adult 97.1
man 95.6
group together 95.6
wear 89.2
administration 88.3
art 87.1
print 86.8
leader 85.3
crowd 83.5
outfit 83
military 82.2
illustration 79.7
music 78.6
vehicle 78.5
one 77.3
cavalry 76.6
woman 76.4

Imagga
created on 2023-10-05

sketch 76.9
drawing 63.9
graffito 56.8
representation 46.9
decoration 44.1
grunge 35.8
old 33.5
vintage 29
texture 25.7
antique 24.2
art 24.1
ancient 22.5
paper 21.2
retro 20.5
history 19.7
architecture 19.5
aged 19
wall 18.6
frame 15.8
pattern 15
travel 14.1
structure 13.9
historic 13.8
design 13.5
material 13.4
historical 13.2
textured 13.2
stone 12.8
landmark 12.6
sculpture 12.6
tourism 12.4
newspaper 11.9
building 11.9
brown 11.8
old fashioned 11.4
backgrounds 11.4
artistic 11.3
monument 11.2
culture 11.1
graphic 10.9
decorative 10.9
city 10.8
style 10.4
money 10.2
grain 10.2
paint 10
dirty 9.9
currency 9.9
surface 9.7
detail 9.7
black 9.6
text 9.6
grungy 9.5
empty 9.5
space 9.3
film 9.3
famous 9.3
letter 9.2
statue 9
grime 8.8
damaged 8.6
finance 8.5
wallpaper 8.4
product 8.4
window 8.2
border 8.1
painting 8.1
symbol 8.1
negative 7.9
business 7.9
crack 7.8
decay 7.7
aging 7.7
sky 7.7
worn 7.6
temple 7.6
textures 7.6
creation 7.5
economy 7.4
gray 7.2
religion 7.2
daily 7.2

Google
created on 2018-05-09

Microsoft
created on 2018-05-09

text 87.2
old 82.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 16-24
Gender Female, 52.3%
Disgusted 39.8%
Fear 39.1%
Calm 19%
Surprised 7%
Sad 3%
Angry 1.9%
Confused 0.4%
Happy 0.4%

AWS Rekognition

Age 9-17
Gender Male, 100%
Fear 97.9%
Surprised 6.3%
Sad 2.2%
Disgusted 0.5%
Happy 0.2%
Calm 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.6%
Disgusted 74%
Calm 22.3%
Surprised 6.9%
Fear 5.9%
Sad 2.2%
Confused 1%
Happy 0.6%
Angry 0.4%

AWS Rekognition

Age 18-26
Gender Female, 89.4%
Fear 91.6%
Surprised 13.4%
Angry 4%
Confused 3.6%
Sad 2.4%
Calm 2.3%
Happy 1.6%
Disgusted 0.8%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Fear 54.5%
Sad 34.7%
Calm 19.6%
Surprised 10.8%
Confused 3.1%
Disgusted 1.6%
Happy 1.4%
Angry 1.1%

AWS Rekognition

Age 43-51
Gender Male, 99.2%
Calm 69.6%
Happy 8.9%
Fear 8.2%
Surprised 7.1%
Disgusted 6.2%
Sad 4.9%
Angry 1.3%
Confused 1%

Feature analysis

Amazon

Adult 97.9%
Male 97.9%
Man 97.9%
Person 97.9%
Bride 92.9%
Female 92.9%
Woman 92.9%
Baby 91.6%
Hat 64.5%

Categories

Imagga

paintings art 99.2%

Captions

Microsoft
created on 2018-05-09

an old photo of a person 67.2%
an old photo of a person 65.1%
old photo of a person 65%

Text analysis

Amazon

and
Art
University
of
(Harvard
College
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
Harvard
President
P1970.4362.0003
WTTM

Google

@
and
Fellows
Harvard
College
(Harvard
Art
Museums)
@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4362.0003
President
of
University
P1970.4362.0003