Human Generated Data

Title

Untitled (Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4518.2

Human Generated Data

Title

Untitled (Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4518.2

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Crowd 100
People 99.8
Person 96.9
Boy 96.9
Child 96.9
Male 96.9
Person 96.7
Baby 96.7
Person 96
Boy 96
Child 96
Male 96
Person 95.9
Boy 95.9
Child 95.9
Male 95.9
Audience 95.8
Person 95.4
Person 95.3
Person 95.1
Person 93.9
Boy 93.9
Child 93.9
Male 93.9
Person 93.9
Baby 93.9
Person 93.9
Person 93.9
Face 93.8
Head 93.8
Person 93.5
Person 92.7
Person 92.4
Person 92.1
Person 92
Boy 92
Child 92
Male 92
Person 91.6
Person 91.4
Person 91.3
Person 91
Person 90.8
Person 90.2
Person 89.9
Person 89.7
Person 89.5
Person 87.8
Person 87.3
Person 86.6
Boy 86.6
Child 86.6
Male 86.6
Person 85.4
Person 85.2
Person 85
Person 84.5
Person 83.5
Person 83.4
Person 82.5
Person 82
Person 81.4
Person 81.3
Person 80.9
Person 80.8
Person 79.2
Person 77.8
Person 77.7
Person 77
Person 76.6
Person 75.1
Person 74.3
Person 74.3
Person 74
Person 73
Person 72.3
Person 71.1
Person 70.9
Person 69.3
Person 69.2
Person 68.6
Person 67.6
Person 62.8
Person 61.8
Person 61.7
Concert 57.1

Clarifai
created on 2018-05-10

people 99.9
many 99.6
group 98.9
crowd 98.6
child 98.6
group together 96.5
man 96.1
adult 95.1
monochrome 93.3
boy 90.5
woman 89.3
portrait 89.3
leader 89.3
administration 89.2
war 88.1
son 80.4
wear 80
retro 79
military 78.7
education 78.6

Imagga
created on 2023-10-06

people 19.5
pedestrian 17
art 16.7
old 16.7
man 16.2
religion 14.3
person 14.2
culture 11.9
black 11.4
statue 11.4
travel 11.2
sculpture 10.7
costume 10.5
couple 10.4
ancient 10.4
portrait 10.3
traditional 10
history 9.8
human 9.7
face 9.2
male 9.2
god 8.6
architecture 8.6
stone 8.5
grunge 8.5
spectator 8.5
historical 8.5
head 8.4
color 8.3
love 7.9
party 7.7
men 7.7
religious 7.5
tourism 7.4
world 7.4
business 7.3
child 7.2
life 7.2
romantic 7.1

Google
created on 2018-05-10

people 97.9
crowd 95.5
photograph 94.8
social group 90.7
black and white 90.6
audience 84.2
child 75.7
monochrome photography 75.4
product 74.1
fan 69.9
monochrome 69.3
team 62.2
recreation 58
style 52.2

Microsoft
created on 2018-05-10

person 99.7
group 91.8
black 91.6
posing 91.5
white 71.5
old 43.2
crowd 38.1
team 30.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Female, 99.1%
Happy 52.4%
Fear 18.3%
Sad 13.6%
Surprised 8%
Calm 5.1%
Angry 3.5%
Confused 2%
Disgusted 1.1%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Happy 64.1%
Calm 11.8%
Surprised 9.5%
Fear 8.1%
Sad 4.9%
Angry 3%
Confused 2.8%
Disgusted 2.1%

AWS Rekognition

Age 50-58
Gender Female, 85.6%
Surprised 77.3%
Calm 26.8%
Happy 12.8%
Fear 6.6%
Sad 3.6%
Confused 3.3%
Disgusted 3.2%
Angry 2.8%

AWS Rekognition

Age 22-30
Gender Female, 58.7%
Calm 98.2%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Confused 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Female, 53.3%
Calm 76.9%
Sad 9.1%
Happy 7.2%
Surprised 6.8%
Fear 6%
Angry 1.4%
Disgusted 1.4%
Confused 1%

AWS Rekognition

Age 48-56
Gender Male, 89.6%
Sad 92.3%
Calm 53.6%
Surprised 6.3%
Fear 6%
Disgusted 1.3%
Angry 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 84.2%
Calm 97.6%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Female, 84.7%
Calm 97.1%
Surprised 6.4%
Fear 6%
Sad 2.2%
Happy 1.3%
Disgusted 0.3%
Confused 0.3%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Male, 90.7%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Female, 52.5%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 97%
Calm 96%
Surprised 6.8%
Fear 5.9%
Sad 2.7%
Happy 0.6%
Disgusted 0.3%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 93.8%
Calm 56%
Sad 18.6%
Fear 9.3%
Disgusted 7.9%
Happy 7%
Surprised 6.9%
Angry 2.9%
Confused 1.1%

AWS Rekognition

Age 25-35
Gender Male, 57.5%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 91.8%
Calm 55.2%
Happy 29.9%
Surprised 7.6%
Fear 6.9%
Sad 3.5%
Angry 2.8%
Confused 1.9%
Disgusted 1.5%

AWS Rekognition

Age 43-51
Gender Female, 99.6%
Happy 74.5%
Angry 10.8%
Surprised 6.6%
Fear 6.1%
Sad 5.2%
Disgusted 3.3%
Confused 2.7%
Calm 0.9%

AWS Rekognition

Age 23-31
Gender Female, 61.1%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 26-36
Gender Female, 98.2%
Calm 78.5%
Surprised 23%
Fear 6.3%
Sad 2.5%
Angry 0.7%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 45-53
Gender Male, 93.8%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 49-57
Gender Male, 79.5%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 43-51
Gender Male, 59.1%
Calm 56.5%
Angry 16%
Surprised 10.4%
Fear 9%
Happy 8.4%
Sad 2.8%
Disgusted 2.7%
Confused 1.4%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Happy 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 25-35
Gender Female, 61.7%
Calm 97.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.9%
Disgusted 0.5%
Confused 0.5%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Female, 91.4%
Sad 86.6%
Calm 26%
Happy 18.4%
Surprised 7.7%
Fear 6.6%
Angry 4.5%
Disgusted 3.5%
Confused 3.4%

AWS Rekognition

Age 28-38
Gender Female, 98.9%
Sad 54.9%
Calm 49.9%
Confused 8.3%
Surprised 7.3%
Fear 7.1%
Angry 5%
Happy 2.3%
Disgusted 1.4%

AWS Rekognition

Age 49-57
Gender Male, 98.5%
Calm 78.9%
Surprised 8.7%
Happy 8.4%
Fear 7%
Disgusted 2.4%
Sad 2.4%
Confused 2.2%
Angry 0.6%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 92.5%
Calm 97.9%
Surprised 6.4%
Fear 6.1%
Sad 2.2%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 47-53
Gender Female, 86.4%
Calm 64.3%
Happy 17.1%
Surprised 7.4%
Fear 7%
Confused 5.2%
Angry 3.9%
Sad 3%
Disgusted 2.2%

AWS Rekognition

Age 48-56
Gender Female, 96.9%
Calm 89.2%
Angry 7.9%
Surprised 6.5%
Fear 6%
Sad 2.5%
Confused 0.6%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 28-38
Gender Male, 89.3%
Sad 99.5%
Surprised 14.5%
Angry 8%
Fear 6.8%
Disgusted 4.6%
Happy 4.5%
Calm 4.3%
Confused 1.4%

AWS Rekognition

Age 27-37
Gender Male, 98.3%
Calm 97.5%
Surprised 6.4%
Fear 6.2%
Sad 2.2%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Male, 81.3%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Male, 69.2%
Calm 79.3%
Happy 11.1%
Surprised 6.7%
Fear 6.2%
Sad 3.5%
Confused 1.8%
Disgusted 1.7%
Angry 0.9%

AWS Rekognition

Age 25-35
Gender Male, 99.4%
Sad 61.1%
Calm 40.4%
Angry 10%
Fear 8.4%
Surprised 7.7%
Happy 7.3%
Confused 2.1%
Disgusted 1.8%

AWS Rekognition

Age 33-41
Gender Female, 99.2%
Calm 93.6%
Surprised 6.9%
Fear 6%
Happy 2.8%
Sad 2.3%
Disgusted 0.8%
Angry 0.7%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Male, 55.1%
Calm 97.5%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Confused 0.8%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 48-54
Gender Male, 93.8%
Calm 83.6%
Sad 10.4%
Surprised 6.5%
Fear 6%
Confused 1.5%
Angry 1.1%
Happy 0.7%
Disgusted 0.5%

AWS Rekognition

Age 14-22
Gender Female, 96.9%
Sad 54%
Confused 26.2%
Calm 14.1%
Surprised 10.2%
Fear 8%
Happy 7.7%
Angry 7.6%
Disgusted 5.4%

AWS Rekognition

Age 47-53
Gender Male, 65%
Angry 85.7%
Surprised 6.8%
Fear 6.3%
Calm 4.6%
Sad 3.7%
Happy 1.7%
Disgusted 1.4%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Female, 61.1%
Calm 56.1%
Happy 33.3%
Fear 7.6%
Surprised 7%
Sad 3%
Disgusted 0.9%
Angry 0.8%
Confused 0.8%

AWS Rekognition

Age 29-39
Gender Male, 77.6%
Sad 100%
Calm 11.9%
Surprised 6.8%
Fear 6.1%
Confused 2.1%
Disgusted 1.3%
Angry 0.7%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 37-45
Gender Male, 98.7%
Calm 95.6%
Surprised 6.4%
Fear 6%
Sad 3.1%
Angry 0.4%
Disgusted 0.4%
Happy 0.4%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Female, 60.2%
Calm 97%
Fear 6.5%
Surprised 6.5%
Sad 2.2%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Female, 99.3%
Fear 80.2%
Calm 24.4%
Surprised 9.1%
Sad 3.2%
Angry 1.6%
Disgusted 1.6%
Happy 1.4%
Confused 1.2%

AWS Rekognition

Age 34-42
Gender Female, 99.2%
Calm 72.8%
Surprised 7.4%
Fear 6.9%
Angry 6.9%
Sad 5.5%
Confused 4.4%
Happy 2.9%
Disgusted 1.6%

AWS Rekognition

Age 25-35
Gender Male, 79%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.6%
Angry 0.4%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 37-45
Gender Male, 73%
Calm 88.2%
Happy 8%
Surprised 6.7%
Fear 5.9%
Sad 2.6%
Confused 0.8%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 26-36
Gender Male, 76.4%
Happy 51.6%
Sad 24%
Calm 12.5%
Angry 10%
Surprised 7.7%
Fear 6.6%
Disgusted 1.5%
Confused 1.3%

AWS Rekognition

Age 31-41
Gender Male, 93.4%
Sad 41.1%
Fear 24.3%
Happy 20%
Calm 14.3%
Angry 10.7%
Surprised 7.8%
Confused 2.2%
Disgusted 1.4%

AWS Rekognition

Age 47-53
Gender Female, 64.9%
Calm 92%
Surprised 7.7%
Fear 6.1%
Sad 2.4%
Confused 1.6%
Disgusted 1%
Happy 0.8%
Angry 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.2%
Happy 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 99.1%
Surprised 6.3%
Fear 6%
Sad 2.2%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 22-30
Gender Female, 95.3%
Sad 91.9%
Calm 22.2%
Fear 20.9%
Surprised 7.1%
Happy 5.3%
Angry 2.1%
Confused 1.9%
Disgusted 1.7%

Feature analysis

Amazon

Person 96.9%
Boy 96.9%
Child 96.9%
Male 96.9%
Baby 96.7%

Text analysis

Amazon

College
and
Art
Fellows
(Harvard
Museums)
of
President
Harvard
University
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4518.0002
©

Google

© President and Fellows of Harvard College (Harvard University Art Museums) P1970.4518.0002
©
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4518.0002