Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)
Date

c. 1945
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4360.4

Human Generated Data

Title

Untitled (Joseph Pataski [orator]?, event for the United Steel Workers of America and the CIO, central New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4360.4

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Sun Hat 99.9
Adult 97.6
Male 97.6
Man 97.6
Person 97.6
People 97.1
Person 96.5
Person 96.3
Person 96
Adult 94.5
Male 94.5
Man 94.5
Person 94.5
Person 94.3
Person 92.9
Person 92.8
Adult 91.4
Male 91.4
Man 91.4
Person 91.4
Adult 90.8
Male 90.8
Man 90.8
Person 90.8
Person 90.7
Person 90.5
Person 90.5
Adult 89.6
Male 89.6
Man 89.6
Person 89.6
Person 88.4
Baby 88.4
Person 87.4
Person 87.3
Person 87.2
Adult 83.9
Person 83.9
Female 83.9
Woman 83.9
Person 83.4
Head 78.1
Person 77.6
Person 77.3
Person 77
Hat 75.2
Face 75
Person 73.1
Person 69.2
Hat 67.8
Person 64.8
Food 64
Fruit 64
Pear 64
Plant 64
Produce 64
Person 63.2
Person 62.2
Person 62.1
Person 61.3
Person 60.6
Hat 59
Crowd 56.3
Landmark 55.1
Liberty Bell 55.1

Clarifai
created on 2018-05-09

people 100
group 99.8
many 99.6
group together 99.3
adult 98.7
man 98
veil 96.1
administration 95.1
wear 94.9
child 94.3
several 94
military 92.3
leader 91.7
woman 91
lid 90.3
war 90
watercraft 88.2
sit 87.9
crowd 86.9
vehicle 85

Imagga
created on 2023-10-07

coffeepot 65.7
pot 65.5
vessel 53.6
cooking utensil 44.3
container 41.2
kitchen utensil 29.5
utensil 28.4
cup 27.5
china 24.6
porcelain 19.1
coffee 18.5
glass 18.4
drink 18.4
table 18.3
food 17.6
tea 16.7
decoration 15.5
restaurant 14.8
teapot 14.8
luxury 14.6
plate 14.4
dinner 13.9
vase 12
beverage 11.8
morning 11.8
breakfast 10.9
relaxation 10.9
ceramic ware 10.8
meal 10.8
flower 10.8
setting 10.6
old 10.4
celebration 10.4
eat 10.1
napkin 9.8
caffeine 9.7
aroma 9.4
service 9.3
still 9.2
traditional 9.1
spa 9
kitchen 8.9
healthy 8.8
hat 8.8
antique 8.8
art 8.7
flowers 8.7
mug 8.6
party 8.6
fresh 8.5
gourmet 8.5
therapy 8.5
relax 8.4
black 8.4
hot 8.4
clean 8.3
health 8.3
event 8.3
wine 8.3
treatment 8.3
brown 8.1
life 8.1
metal 8
candle 8
decor 8
design 7.9
knife 7.9
tablecloth 7.8
reception 7.8
liquid 7.8
saucer 7.8
lunch 7.7
arrangement 7.7
dining 7.6
cake 7.5
dark 7.5
bowl 7.4
vintage 7.4
room 7.4
natural 7.4
water 7.3
dish 7.2
bottle 7.2
home 7.2
interior 7.1
silver 7.1

Google
created on 2018-05-09

photograph 95
black and white 93.3
monochrome photography 87.3
monochrome 76.7
history 58.2
stock photography 52.4

Microsoft
created on 2018-05-09

indoor 91.4
old 43.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Female, 75%
Calm 64.1%
Angry 12.6%
Sad 8.2%
Fear 7.1%
Surprised 6.9%
Happy 6.7%
Disgusted 1.3%
Confused 1.2%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 0.4%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 35-43
Gender Female, 50.5%
Calm 85.2%
Surprised 6.6%
Fear 6.6%
Disgusted 6%
Sad 3.5%
Angry 1.1%
Happy 1%
Confused 0.8%

AWS Rekognition

Age 29-39
Gender Male, 95.8%
Disgusted 31.8%
Calm 26.7%
Happy 19.7%
Surprised 8.1%
Fear 6.6%
Angry 5.8%
Sad 5%
Confused 4.9%

AWS Rekognition

Age 7-17
Gender Female, 51.3%
Happy 63.9%
Calm 30%
Surprised 6.6%
Fear 6.2%
Sad 2.6%
Confused 1.2%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Male, 97.8%
Calm 72.1%
Fear 8.1%
Surprised 6.7%
Sad 6.1%
Happy 5.6%
Angry 4.1%
Confused 3.4%
Disgusted 1.2%

AWS Rekognition

Age 16-22
Gender Male, 62.4%
Happy 94.8%
Fear 6.6%
Surprised 6.3%
Sad 2.3%
Calm 1.9%
Angry 0.6%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 79.4%
Calm 86.3%
Surprised 6.6%
Fear 6.2%
Sad 5.1%
Angry 2%
Confused 2%
Happy 1.3%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Male, 94%
Happy 58.5%
Calm 17.6%
Angry 10.4%
Fear 7.6%
Surprised 7%
Sad 5.2%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 27-37
Gender Male, 86.5%
Happy 80.7%
Calm 13.6%
Surprised 6.5%
Fear 6.2%
Sad 2.7%
Angry 1.9%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 22-30
Gender Female, 95.7%
Calm 67.6%
Sad 27.5%
Fear 6.7%
Surprised 6.5%
Happy 4.9%
Angry 2.5%
Confused 1.3%
Disgusted 1.1%

AWS Rekognition

Age 20-28
Gender Male, 99.5%
Calm 84.2%
Surprised 6.6%
Fear 6.3%
Happy 5.1%
Sad 4.1%
Angry 2.1%
Confused 1.4%
Disgusted 0.7%

AWS Rekognition

Age 23-33
Gender Male, 99.4%
Calm 57.6%
Happy 17.7%
Surprised 8.3%
Fear 7.4%
Sad 5.3%
Confused 5%
Angry 3.4%
Disgusted 2.5%

AWS Rekognition

Age 21-29
Gender Female, 75.1%
Calm 79.4%
Fear 11.3%
Surprised 6.8%
Sad 3.7%
Confused 1.3%
Happy 1.2%
Disgusted 1.2%
Angry 1.2%

AWS Rekognition

Age 19-27
Gender Male, 97.4%
Calm 76.5%
Sad 10.1%
Fear 9.3%
Surprised 6.4%
Angry 1.8%
Happy 1.2%
Confused 0.8%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 89.7%
Surprised 6.5%
Fear 6.1%
Sad 4.6%
Confused 1.6%
Angry 1.2%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Female, 77.5%
Calm 74.2%
Sad 23.4%
Fear 6.7%
Surprised 6.5%
Angry 2%
Happy 1.2%
Disgusted 0.9%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Female, 72.8%
Calm 95.4%
Surprised 6.3%
Fear 6%
Sad 2.6%
Disgusted 0.9%
Happy 0.8%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 16-22
Gender Female, 98.4%
Calm 66.3%
Happy 13.9%
Fear 10.4%
Surprised 7.2%
Sad 4.1%
Angry 1.8%
Confused 1.3%
Disgusted 1.1%

AWS Rekognition

Age 19-27
Gender Male, 89.5%
Calm 97.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1%
Disgusted 0.7%
Angry 0.2%
Confused 0.1%

Feature analysis

Amazon

Adult 97.6%
Male 97.6%
Man 97.6%
Person 97.6%
Baby 88.4%
Female 83.9%
Woman 83.9%
Hat 75.2%
Pear 64%

Text analysis

Amazon

College
and
Art
University
(Harvard
Fellows
Museums)
of
President and Fellows of Harvard College (Harvard University Art Museums)
Harvard
President
P1970.4360.0004

Google

President
and
Fellows
of
Harvard
College
Museums)
P1970.4360.0004
O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4360.0004
O
(Harvard
University
Art