Human Generated Data

Title

Untitled (Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4518.4

Human Generated Data

Title

Untitled (Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4518.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Crowd 99.4
Person 96.2
Adult 96.2
Male 96.2
Man 96.2
Person 95.5
Adult 95.5
Bride 95.5
Female 95.5
Wedding 95.5
Woman 95.5
Person 93.2
Adult 93.2
Male 93.2
Man 93.2
Person 91
Audience 90.2
Person 90.2
Adult 90.2
Bride 90.2
Female 90.2
Woman 90.2
Person 87.7
Person 87.4
Person 86.2
Person 85.6
Male 85.6
Boy 85.6
Child 85.6
Face 85.3
Head 85.3
Person 83.4
Person 81.4
Person 80.3
People 79.2
Person 79.1
Person 77.4
Bridegroom 77.1
Person 74.6
Person 73.5
Person 72.4
Person 70.3
Person 70.3
Person 68.4
Person 67.7
Person 67.4
Person 67.1
Person 66.8
Person 66.3
Person 65.6
Person 65.4
Person 65.3
Person 65
Person 63.9
Person 62.7
Person 62.5
Person 60.3
Person 59.2
Person 57.3
Clothing 57.1
Dress 57.1
Fashion 57.1
Formal Wear 57.1
Gown 57.1
Person 57
Wedding Gown 56.1
Person 55.8
Person 55

Clarifai
created on 2018-05-10

people 100
many 99.8
group 99
group together 99
crowd 98.7
adult 97.8
man 96.1
leader 95.1
woman 92.1
administration 91.9
monochrome 85.8
child 82.9
spectator 81.8
war 78.2
chair 77.1
wear 75
audience 74.6
ceremony 73.9
street 70.2
theater 68.8

Imagga
created on 2023-10-06

snow 50.7
winter 41.7
cold 31.8
season 24.9
forest 22.6
park 22.2
frost 22.1
snowy 21.4
tree 20.8
landscape 19.3
trees 18.7
ice 17.9
frozen 16.2
weather 15.6
old 15.3
negative 14.9
drawing 14.4
outdoors 14.2
covered 13.6
storm 13.5
city 13.3
outdoor 13
scene 13
grunge 12.8
black 12.6
vintage 12.5
texture 12.5
building 12.5
film 12.3
architecture 11.7
woods 11.5
snowing 10.8
antique 10.4
art 10.3
house 10
sketch 10
snowfall 9.8
freeze 9.7
seasonal 9.6
path 9.4
garden 9.2
aged 9
scenery 9
retro 9
cemetery 9
history 8.9
sky 8.9
pattern 8.9
structure 8.8
decoration 8.7
wood 8.3
branch 8.2
road 8.1
mountain 8
holiday 7.9
day 7.8
frosty 7.8
travel 7.7
pine 7.6
plant 7.5
light 7.3
design 7.3
photographic paper 7.3
rough 7.3
dirty 7.2
cool 7.1
man 7
scenic 7

Google
created on 2018-05-10

people 95.9
photograph 95.4
black and white 90.8
social group 90.6
photography 80.1
monochrome photography 79.1
crowd 73.6
monochrome 66.3
tree 57.4
fun 57.3
recreation 56.1
history 55.8
family 54.2
girl 50.5

Microsoft
created on 2018-05-10

person 94.3
group 81.2
posing 77.1
white 60.3
crowd 0.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-57
Gender Male, 57%
Calm 93%
Surprised 7.6%
Fear 6.5%
Sad 2.4%
Happy 0.9%
Disgusted 0.5%
Confused 0.5%
Angry 0.4%

AWS Rekognition

Age 41-49
Gender Female, 98.8%
Happy 96.9%
Surprised 6.4%
Fear 6%
Sad 2.4%
Calm 1.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 93.5%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Fear 89.8%
Sad 29.3%
Surprised 6.7%
Confused 1.5%
Happy 1.1%
Angry 0.9%
Disgusted 0.8%
Calm 0.6%

AWS Rekognition

Age 33-41
Gender Male, 64.8%
Calm 96.2%
Surprised 6.8%
Fear 6.1%
Sad 2.4%
Confused 0.5%
Happy 0.5%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.2%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Female, 65.1%
Calm 46.3%
Sad 15%
Fear 14.4%
Surprised 12.9%
Angry 6.8%
Happy 4.5%
Confused 2.5%
Disgusted 1.2%

AWS Rekognition

Age 23-33
Gender Female, 72.7%
Fear 54.8%
Happy 26.9%
Surprised 16.7%
Calm 8%
Sad 3.1%
Angry 2.1%
Confused 2%
Disgusted 1.4%

AWS Rekognition

Age 25-35
Gender Female, 65.4%
Sad 54.7%
Angry 25%
Calm 12.3%
Fear 11.3%
Happy 9.9%
Surprised 9.2%
Confused 7%
Disgusted 2.3%

AWS Rekognition

Age 21-29
Gender Female, 97.3%
Sad 73.5%
Fear 21.3%
Calm 19.5%
Angry 10.6%
Surprised 9.7%
Confused 4%
Disgusted 2.9%
Happy 1.8%

AWS Rekognition

Age 29-39
Gender Male, 98.6%
Calm 59.6%
Sad 18%
Confused 10%
Surprised 8.2%
Fear 6.8%
Disgusted 3.7%
Happy 3.5%
Angry 1.3%

AWS Rekognition

Age 21-29
Gender Male, 91.1%
Surprised 85.9%
Fear 20.1%
Sad 11.4%
Angry 7.4%
Calm 3.6%
Disgusted 1.3%
Confused 1.1%
Happy 1%

AWS Rekognition

Age 19-27
Gender Female, 100%
Sad 98.2%
Calm 17.2%
Happy 12.9%
Surprised 10.8%
Fear 8.7%
Disgusted 0.6%
Angry 0.6%
Confused 0.6%

AWS Rekognition

Age 35-43
Gender Male, 86.8%
Calm 95.1%
Surprised 6.4%
Fear 6%
Sad 2.3%
Angry 1.4%
Confused 1%
Happy 0.7%
Disgusted 0.6%

AWS Rekognition

Age 35-43
Gender Female, 91%
Calm 73.6%
Fear 9%
Disgusted 8.6%
Surprised 6.8%
Happy 6.4%
Sad 2.8%
Confused 1%
Angry 0.6%

AWS Rekognition

Age 14-22
Gender Female, 56.4%
Sad 54.5%
Calm 46.5%
Happy 8.6%
Disgusted 8.4%
Surprised 6.8%
Fear 6.5%
Angry 4.2%
Confused 1.7%

AWS Rekognition

Age 34-42
Gender Female, 94.8%
Calm 75.7%
Fear 17.5%
Surprised 6.6%
Sad 3.7%
Confused 0.5%
Disgusted 0.4%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 18-24
Gender Male, 99.8%
Confused 62.8%
Calm 17.3%
Sad 12.2%
Surprised 7%
Fear 6.1%
Angry 2.2%
Disgusted 1.5%
Happy 1.3%

AWS Rekognition

Age 27-37
Gender Male, 58%
Calm 23.6%
Surprised 23.5%
Fear 19.3%
Disgusted 19.1%
Confused 7.7%
Happy 7.5%
Angry 2.7%
Sad 2.7%

AWS Rekognition

Age 45-51
Gender Female, 99.4%
Fear 92.8%
Happy 10.1%
Surprised 6.9%
Calm 4.8%
Sad 3%
Confused 1.1%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 96.1%
Surprised 6.4%
Fear 6.1%
Sad 2.9%
Happy 0.4%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 93.5%
Calm 94.7%
Surprised 6.5%
Fear 5.9%
Sad 3.1%
Happy 1%
Angry 0.4%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 11-19
Gender Male, 79.5%
Calm 94.1%
Surprised 6.8%
Fear 6.1%
Sad 2.4%
Angry 1.1%
Confused 1%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 35-43
Gender Male, 73.7%
Disgusted 49.6%
Happy 32.2%
Surprised 8.4%
Fear 6.9%
Calm 4.2%
Sad 4.2%
Angry 2.3%
Confused 0.5%

AWS Rekognition

Age 31-41
Gender Female, 89.5%
Sad 50.9%
Calm 33.4%
Happy 21%
Angry 8.7%
Surprised 8.6%
Fear 6.8%
Disgusted 2.9%
Confused 0.7%

AWS Rekognition

Age 14-22
Gender Female, 98.3%
Angry 38%
Happy 32.2%
Fear 18.3%
Surprised 6.6%
Calm 4.2%
Sad 3.9%
Disgusted 1.3%
Confused 0.2%

AWS Rekognition

Age 26-36
Gender Male, 82.7%
Calm 97.5%
Surprised 6.6%
Fear 6%
Sad 2.3%
Confused 0.4%
Happy 0.3%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Male, 97.3%
Sad 99.3%
Calm 14.8%
Fear 10.9%
Surprised 7%
Disgusted 5.6%
Angry 2.7%
Confused 2.6%
Happy 1.1%

AWS Rekognition

Age 29-39
Gender Male, 83.1%
Calm 89.3%
Surprised 6.7%
Fear 6.5%
Happy 3.9%
Sad 2.4%
Disgusted 2.2%
Confused 0.9%
Angry 0.4%

AWS Rekognition

Age 23-33
Gender Male, 92.5%
Happy 57.7%
Surprised 16.1%
Sad 11.1%
Fear 6.8%
Disgusted 5.4%
Calm 4.2%
Angry 3.7%
Confused 2.3%

AWS Rekognition

Age 16-22
Gender Female, 83.8%
Calm 68%
Fear 15.1%
Sad 7%
Surprised 7%
Confused 2.9%
Happy 2.1%
Angry 0.9%
Disgusted 0.5%

AWS Rekognition

Age 27-37
Gender Male, 98.7%
Calm 87.2%
Angry 7%
Fear 6.9%
Surprised 6.9%
Sad 2.5%
Confused 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 19-27
Gender Female, 98.4%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 69.5%
Calm 74.2%
Happy 20.6%
Surprised 6.6%
Fear 6%
Sad 2.3%
Disgusted 1.7%
Angry 1.4%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 83.1%
Sad 9.2%
Surprised 6.5%
Fear 6.1%
Confused 2.7%
Angry 1.2%
Disgusted 0.8%
Happy 0.7%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Calm 73.7%
Fear 15%
Surprised 6.5%
Angry 3.3%
Sad 3.3%
Happy 2.5%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 77.5%
Fear 12.7%
Surprised 7%
Disgusted 2.9%
Sad 2.5%
Angry 1.9%
Happy 1.4%
Confused 1.3%

AWS Rekognition

Age 18-24
Gender Female, 90.4%
Happy 87.5%
Surprised 6.6%
Fear 6.6%
Sad 4.4%
Angry 1.3%
Calm 1.2%
Disgusted 1.2%
Confused 1%

AWS Rekognition

Age 14-22
Gender Female, 96.7%
Fear 91.5%
Calm 17.2%
Surprised 6.6%
Sad 2.8%
Angry 2%
Confused 0.6%
Disgusted 0.5%
Happy 0.4%

Feature analysis

Amazon

Person 96.2%
Adult 96.2%
Male 96.2%
Man 96.2%
Bride 95.5%
Female 95.5%
Woman 95.5%
Boy 85.6%
Child 85.6%

Categories

Imagga

paintings art 73.6%
nature landscape 17.3%
streetview architecture 5.8%
text visuals 2.4%

Text analysis

Amazon

College
and
Art
Fellows
(Harvard
Museums)
of
Harvard
University
President
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4518.0004
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4518.0004
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4518.0004