Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)
Date

c. 1945
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4360.4

Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4360.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
People 100
Person 98
Adult 98
Male 98
Man 98
Person 97.2
Person 97.1
Person 97
Adult 97
Bride 97
Female 97
Wedding 97
Woman 97
Person 96.9
Crowd 96.3
Person 95.9
Person 95.8
Person 95.2
Adult 95.2
Male 95.2
Man 95.2
Person 93.5
Person 93.3
Person 93.1
Person 92.9
Person 92.6
Person 92.4
Person 91.9
Sun Hat 90.5
Person 90
Adult 90
Male 90
Man 90
Person 89.4
Person 89.2
Person 88.5
Person 88.1
Accessories 87.7
Bag 87.7
Handbag 87.7
Hat 87.1
Face 81.8
Head 81.8
Person 81.7
Person 80.5
Person 80.2
Person 79.4
Person 79.4
Person 79.3
Person 79
Person 77.4
Person 76
Hat 76
Person 72.8
Person 71.9
Person 71.3
Person 71.1
Person 68.5
Hat 68.4
Person 66.9
Audience 65.8
Person 65.5
Flag 63.3
Person 62.4
Hat 56.6

Clarifai
created on 2018-05-09

people 100
monochrome 98.9
group together 98.8
adult 98.6
many 98.1
crowd 97.8
group 96.6
man 96.6
audience 91.9
woman 90
administration 89.6
sit 86.7
child 84.1
spectator 82.4
music 81.3
military 80.7
street 79.9
war 78.4
chair 76.4
sitting 76.2

Imagga
created on 2023-10-06

table 23.4
food 20.6
cup 18.8
restaurant 18.6
dinner 17.6
drink 17.5
flowers 17.4
meal 16.3
cake 16
wedding 15.6
tea 15.4
shop 15
luxury 14.6
celebration 14.3
glass 13.4
stall 13.4
dessert 13.2
decoration 13
bottle 12.7
bakery 12.2
party 12
fountain 12
event 12
wine 12
culture 11.9
plate 11.9
traditional 11.6
coffee 11.1
product 10.9
morning 10.8
lifestyle 10.8
candle 10.6
china 10.4
lunch 10.3
sweet 10.3
service 10.2
eat 10.1
water 10
teapot 9.9
religion 9.8
kitchen 9.8
reception 9.8
mercantile establishment 9.6
hat 9.5
dining 9.5
person 9
interior 8.8
setting 8.7
bride 8.6
beverage 8.5
flower 8.4
relaxation 8.4
people 8.4
old 8.4
life 8.3
tradition 8.3
banquet 8.2
breakfast 8.2
cowboy hat 8
women 7.9
catering 7.8
architecture 7.8
color 7.8
knife 7.7
chair 7.7
orange 7.7
arrangement 7.7
stone 7.6
clothing 7.6
marriage 7.6
still life 7.6
porcelain 7.5
close 7.4
natural 7.4
light 7.3
structure 7.3
calm 7.3
perfume 7.2
home 7.2
holiday 7.2
building 7.1
family 7.1
love 7.1

Google
created on 2018-05-09

black and white 92.6
monochrome photography 85
crowd 81.2
monochrome 75.4
history 65.1
recreation 56.6
stock photography 50.9

Microsoft
created on 2018-05-09

person 99
posing 51.9
crowd 1.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-10
Gender Female, 64.4%
Calm 38.5%
Surprised 30%
Confused 17.3%
Fear 10.3%
Sad 5.4%
Disgusted 2.7%
Angry 2.1%
Happy 2.1%

Feature analysis

Amazon

Person
Adult
Male
Man
Bride
Female
Woman
Handbag
Hat
Flag
Person 98%

Text analysis

Amazon

and
inverted
Art
University
College
(Harvard
neg
Fellows
of
Harvard
fm
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
P1970.4360.0004 inverted fm neg
President
P1970.4360.0004

Google

O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4360.0004
inverted
fm
O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4360.0004 inverted fm neg
neg