Human Generated Data

Title

Untitled (Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4518.5

Human Generated Data

Title

Untitled (Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4518.5

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Crowd 99.3
Person 95.3
Adult 95.3
Male 95.3
Man 95.3
Person 93.4
Adult 93.4
Female 93.4
Woman 93.4
Person 92.8
Adult 92.8
Female 92.8
Woman 92.8
Bride 92.8
Wedding 92.8
Person 92.6
Adult 92.6
Male 92.6
Man 92.6
Audience 90.6
Person 89
Person 88.6
Person 88
Person 87.5
Person 86
Male 86
Boy 86
Child 86
Face 82.9
Head 82.9
Person 81.1
Person 80.7
Person 80.1
Person 79.8
People 79.1
Person 79
Person 78.3
Person 78.2
Person 77.3
Person 76.5
Person 70.8
Person 70.6
Person 69.9
Bridegroom 69.5
Person 69.4
Person 68.5
Person 68.1
Person 66.9
Person 65.8
Person 63.8
Person 62.5
Person 62.3
Person 61.3
Person 61.2
Car 57.4
Transportation 57.4
Vehicle 57.4
Speech 56
Person 55.2
Clothing 55
Dress 55
Fashion 55
Formal Wear 55
Gown 55

Clarifai
created on 2018-05-10

people 100
many 99.5
group 98.7
group together 98.3
adult 97.6
crowd 95.8
man 94.2
woman 91.5
administration 90.4
leader 87.7
monochrome 84.7
child 84.3
wear 83.8
street 75.9
several 75.3
spectator 75.2
ceremony 74.5
war 73.4
retro 66.6
music 66

Imagga
created on 2023-10-05

sketch 36.5
drawing 33.9
representation 21.6
snow 20.1
black 16.8
cemetery 16.2
old 16
winter 14.5
grunge 13.6
umbrella 13
outdoors 12.7
tree 12.3
people 12.3
park 11.5
texture 11.1
art 10.8
vintage 10.7
trees 10.7
person 10.6
sky 10.2
kin 10.2
parasol 10
dress 9.9
frost 9.6
ancient 9.5
cold 9.5
water 9.3
holiday 9.3
outdoor 9.2
pattern 8.9
decoration 8.8
stone 8.7
forest 8.7
negative 8.6
season 8.6
ice 8.5
design 8.4
weather 8.4
city 8.3
silhouette 8.3
human 8.2
landscape 8.2
aged 8.1
dirty 8.1
man 8.1
architecture 7.8
antique 7.8
snowy 7.8
portrait 7.8
frozen 7.6
style 7.4
fountain 7.3
paint 7.2
adult 7.2
women 7.1
love 7.1
happiness 7
structure 7

Google
created on 2018-05-10

photograph 95.2
black and white 92.6
crowd 89.4
monochrome photography 85.2
photography 81.2
monochrome 68.8
ceremony 67.6
history 67.2
event 58.9
recreation 53.2

Microsoft
created on 2018-05-10

person 96.8
group 85.5
posing 84
people 71
crowd 27

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-57
Gender Female, 61.6%
Happy 84.8%
Calm 9.9%
Surprised 6.8%
Fear 6.2%
Sad 2.5%
Disgusted 1.1%
Angry 0.7%
Confused 0.6%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 89.6%
Happy 7.6%
Surprised 6.7%
Fear 6%
Sad 2.3%
Angry 0.5%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Female, 90.5%
Happy 93.1%
Surprised 8.8%
Fear 5.9%
Sad 2.2%
Calm 2.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 34-42
Gender Female, 82.4%
Happy 59%
Calm 28.2%
Surprised 7.1%
Fear 6.8%
Disgusted 3%
Sad 3%
Confused 2.5%
Angry 1.1%

AWS Rekognition

Age 19-27
Gender Male, 97.1%
Calm 98.5%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 53-61
Gender Female, 91.3%
Happy 45.8%
Calm 45.8%
Surprised 7.1%
Fear 6.5%
Sad 2.6%
Disgusted 2%
Angry 1.1%
Confused 1%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 96.9%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Happy 0.8%
Disgusted 0.5%
Confused 0.4%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 84.4%
Happy 7.1%
Surprised 6.5%
Confused 6%
Fear 6%
Sad 2.3%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 34-42
Gender Female, 72.6%
Calm 94.9%
Fear 6.8%
Surprised 6.7%
Sad 2.2%
Happy 1.1%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 73.4%
Calm 77.4%
Surprised 7.3%
Fear 6.4%
Sad 5.5%
Happy 5.2%
Angry 3.7%
Disgusted 2.5%
Confused 1.2%

AWS Rekognition

Age 23-33
Gender Male, 92.2%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 28-38
Gender Male, 76.9%
Calm 54.7%
Surprised 12.7%
Fear 12.1%
Sad 10.1%
Confused 9.7%
Happy 1.5%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 51-59
Gender Male, 74.6%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Male, 95.8%
Calm 96.9%
Surprised 6.3%
Fear 5.9%
Sad 2.8%
Happy 0.4%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 16-24
Gender Female, 61.9%
Surprised 39.9%
Calm 38%
Angry 23.1%
Confused 6.4%
Fear 6.2%
Sad 2.9%
Happy 1.9%
Disgusted 0.7%

AWS Rekognition

Age 36-44
Gender Female, 80.2%
Calm 31.3%
Angry 28.8%
Fear 10.1%
Sad 9.8%
Surprised 7.9%
Happy 7.2%
Confused 6.9%
Disgusted 3%

AWS Rekognition

Age 39-47
Gender Male, 94.8%
Calm 77.5%
Sad 18.8%
Surprised 6.8%
Fear 6%
Happy 3.2%
Confused 0.6%
Disgusted 0.6%
Angry 0.3%

AWS Rekognition

Age 24-34
Gender Female, 98.6%
Fear 92.3%
Calm 17.7%
Surprised 6.6%
Sad 2.4%
Happy 1.2%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 81.5%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 64%
Happy 14.8%
Disgusted 10.7%
Surprised 8%
Fear 6.5%
Sad 3.3%
Confused 2.3%
Angry 0.5%

AWS Rekognition

Age 27-37
Gender Male, 78.6%
Calm 91%
Surprised 6.9%
Fear 6.1%
Sad 2.6%
Happy 2.3%
Angry 1.8%
Disgusted 1.1%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Male, 89.1%
Calm 97.8%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.7%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 34-42
Gender Female, 99.4%
Sad 100%
Fear 7.3%
Surprised 6.7%
Calm 4.5%
Angry 1.7%
Confused 1.4%
Disgusted 0.8%
Happy 0.5%

AWS Rekognition

Age 16-22
Gender Male, 92.8%
Calm 96.5%
Surprised 6.3%
Fear 5.9%
Sad 2.8%
Happy 1%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Male, 80%
Happy 78.8%
Sad 11%
Surprised 7.5%
Fear 6.3%
Calm 2.4%
Disgusted 2%
Angry 0.9%
Confused 0.4%

AWS Rekognition

Age 39-47
Gender Female, 94.6%
Calm 84.3%
Fear 9.5%
Surprised 8.1%
Sad 2.4%
Disgusted 1.4%
Happy 1.3%
Angry 0.7%
Confused 0.5%

AWS Rekognition

Age 36-44
Gender Male, 97.8%
Surprised 26.7%
Calm 17.2%
Fear 14.1%
Confused 11.3%
Sad 10.8%
Happy 10.6%
Angry 9.5%
Disgusted 5.3%

AWS Rekognition

Age 38-46
Gender Female, 100%
Happy 51.6%
Calm 34.1%
Surprised 12.3%
Fear 6%
Sad 2.3%
Confused 2%
Disgusted 1.6%
Angry 1.3%

AWS Rekognition

Age 42-50
Gender Female, 73.8%
Happy 61.4%
Surprised 15.9%
Fear 8.3%
Calm 7.7%
Sad 6.1%
Confused 3%
Angry 1.3%
Disgusted 1.3%

AWS Rekognition

Age 29-39
Gender Male, 97.8%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 99%
Fear 52.6%
Happy 24.1%
Surprised 17.9%
Confused 6.4%
Calm 6.2%
Sad 3.1%
Disgusted 2%
Angry 1.9%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Calm 69.1%
Surprised 16.1%
Happy 9.3%
Fear 6.3%
Sad 4%
Angry 2.2%
Confused 1%
Disgusted 0.6%

AWS Rekognition

Age 38-46
Gender Female, 78.8%
Calm 92.8%
Surprised 6.9%
Fear 5.9%
Sad 3%
Confused 2.7%
Happy 0.3%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Female, 99.8%
Surprised 76.9%
Happy 17.9%
Fear 17.1%
Confused 6.8%
Angry 3.6%
Calm 3.3%
Sad 3.3%
Disgusted 2.2%

AWS Rekognition

Age 37-45
Gender Female, 76.1%
Calm 93.4%
Fear 7.9%
Surprised 6.4%
Sad 2.4%
Happy 0.3%
Disgusted 0.3%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 16-24
Gender Female, 99%
Happy 81.2%
Fear 8.2%
Surprised 7.1%
Calm 4%
Sad 3.8%
Angry 2.7%
Disgusted 0.6%
Confused 0.2%

AWS Rekognition

Age 14-22
Gender Male, 99.7%
Fear 97%
Surprised 6.4%
Calm 5.8%
Sad 2.3%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 35-43
Gender Male, 93.7%
Calm 92.8%
Surprised 7.3%
Fear 6.1%
Sad 2.5%
Confused 1.5%
Disgusted 0.9%
Happy 0.8%
Angry 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Calm 81%
Fear 13.4%
Surprised 6.7%
Happy 3.1%
Sad 2.3%
Disgusted 0.7%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 89.1%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 35-43
Gender Female, 99.1%
Sad 97.2%
Calm 44.5%
Surprised 6.5%
Fear 6.1%
Confused 1.2%
Happy 1%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Male, 96.2%
Fear 56.6%
Calm 40.5%
Sad 7.8%
Surprised 6.5%
Happy 2.5%
Angry 0.9%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 35-43
Gender Male, 87.6%
Calm 97.9%
Fear 6.4%
Surprised 6.3%
Sad 2.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Female, 92.7%
Surprised 69.4%
Fear 49.7%
Angry 8.8%
Calm 4.8%
Sad 2.7%
Happy 1.1%
Confused 1%
Disgusted 0.6%

AWS Rekognition

Age 33-41
Gender Female, 69.6%
Calm 54.8%
Happy 16%
Surprised 9.3%
Sad 8.5%
Fear 8.2%
Angry 6.1%
Disgusted 1.4%
Confused 1.2%

AWS Rekognition

Age 28-38
Gender Female, 64.1%
Surprised 82.2%
Happy 44.4%
Fear 6%
Confused 3.1%
Sad 2.3%
Calm 1.8%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 25-35
Gender Male, 93.9%
Calm 96.9%
Surprised 6.4%
Fear 6%
Sad 2.6%
Happy 0.6%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Female, 93.5%
Calm 86.1%
Fear 9.6%
Surprised 7.4%
Sad 2.8%
Angry 0.5%
Happy 0.5%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 20-28
Gender Male, 96.5%
Fear 98.1%
Surprised 6.3%
Sad 2.1%
Calm 0.1%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 14-22
Gender Male, 54.4%
Calm 86.1%
Fear 6.7%
Surprised 6.4%
Sad 5%
Happy 4.4%
Confused 0.4%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 77.5%
Calm 62.9%
Happy 29.1%
Surprised 6.5%
Fear 6.2%
Sad 3.6%
Angry 1.6%
Confused 0.9%
Disgusted 0.5%

AWS Rekognition

Age 20-28
Gender Male, 98.5%
Calm 90.1%
Surprised 11%
Fear 6.3%
Sad 2.4%
Confused 0.2%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Male, 92%
Calm 48.3%
Disgusted 22.3%
Happy 11.9%
Surprised 8%
Fear 7.2%
Angry 5.5%
Sad 3.5%
Confused 2.2%

AWS Rekognition

Age 18-26
Gender Male, 98.1%
Sad 48.9%
Calm 28.5%
Angry 22.7%
Happy 10.8%
Fear 8.8%
Surprised 7.1%
Confused 1.8%
Disgusted 1.8%

AWS Rekognition

Age 6-12
Gender Male, 99.7%
Calm 69.4%
Sad 18.1%
Surprised 7%
Angry 6.7%
Fear 6.3%
Confused 2%
Happy 1.9%
Disgusted 1.4%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Calm 94.6%
Surprised 6.4%
Fear 5.9%
Sad 3.3%
Angry 1.1%
Confused 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 89.9%
Surprised 7.9%
Fear 6.3%
Sad 2.5%
Disgusted 1.9%
Happy 1.6%
Confused 0.8%
Angry 0.6%

AWS Rekognition

Age 21-29
Gender Female, 80.6%
Sad 71.8%
Calm 59.1%
Surprised 6.6%
Fear 6.3%
Happy 1.7%
Confused 1.5%
Angry 1.5%
Disgusted 1%

AWS Rekognition

Age 33-41
Gender Male, 51.3%
Disgusted 60.8%
Surprised 20.2%
Calm 14.6%
Fear 7%
Sad 3%
Confused 1.8%
Happy 1.1%
Angry 1%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 87.1%
Happy 8.4%
Fear 6.5%
Surprised 6.4%
Sad 2.6%
Confused 0.7%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 16-24
Gender Male, 96.1%
Calm 55.9%
Sad 13.3%
Fear 12.1%
Surprised 8.5%
Happy 6.5%
Confused 5.3%
Angry 2.4%
Disgusted 0.7%

AWS Rekognition

Age 18-26
Gender Male, 77.1%
Fear 58.2%
Surprised 34.7%
Calm 16.4%
Happy 4.5%
Disgusted 3.2%
Sad 2.9%
Angry 2.6%
Confused 0.9%

AWS Rekognition

Age 22-30
Gender Male, 99%
Sad 61.3%
Happy 38%
Calm 27.4%
Surprised 6.6%
Fear 6.2%
Angry 1.5%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 29-39
Gender Male, 89.3%
Calm 93.5%
Surprised 6.7%
Fear 6%
Happy 4.1%
Sad 2.3%
Disgusted 0.4%
Angry 0.4%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Female, 99.2%
Calm 63.8%
Disgusted 9.2%
Sad 8.8%
Happy 8.4%
Surprised 8.1%
Fear 6.7%
Angry 2.6%
Confused 0.4%

AWS Rekognition

Age 14-22
Gender Male, 100%
Sad 49.6%
Fear 38.9%
Calm 21.1%
Angry 10%
Surprised 6.7%
Happy 4.6%
Disgusted 1.2%
Confused 1%

AWS Rekognition

Age 6-16
Gender Male, 97.5%
Calm 37.8%
Sad 21.9%
Fear 17.2%
Happy 14.5%
Surprised 7.8%
Angry 4.2%
Confused 3.3%
Disgusted 1.6%

AWS Rekognition

Age 20-28
Gender Male, 94.2%
Calm 93%
Surprised 7%
Fear 6.1%
Sad 2.8%
Confused 1.8%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%

Feature analysis

Amazon

Person 95.3%
Adult 95.3%
Male 95.3%
Man 95.3%
Female 93.4%
Woman 93.4%
Bride 92.8%
Boy 86%
Child 86%
Car 57.4%

Categories

Imagga

nature landscape 89.6%
paintings art 5.8%
streetview architecture 3.2%

Text analysis

Amazon

College
and
Art
Fellows
Museums)
(Harvard
of
University
Harvard
President
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4518.0005
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4518.0005
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4518.0005