Human Generated Data

Title

Untitled (Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5075

Human Generated Data

Title

Untitled (Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5075

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 100
Furniture 99.2
Table 99.2
Crowd 97.2
Person 97
Person 96.4
Adult 96.4
Male 96.4
Man 96.4
Person 95.6
Pottery 94.6
Person 94
Adult 94
Male 94
Man 94
Person 93.7
Person 93.5
Adult 93.5
Male 93.5
Man 93.5
Person 93.4
Person 92.9
Baby 92.9
Person 92.7
Person 92.2
Face 91.8
Head 91.8
Person 90.4
Person 90
Person 89.8
Person 89.6
Person 87.6
Child 87.6
Female 87.6
Girl 87.6
Architecture 85.8
Building 85.8
Classroom 85.8
Indoors 85.8
Room 85.8
School 85.8
Person 84.6
Adult 84.6
Male 84.6
Man 84.6
Person 84.3
Person 83.8
Person 81.1
Person 80.8
Person 80.6
Person 80
Person 77.9
Person 77.9
Audience 76.1
Potted Plant 76.1
Person 75.5
Person 75.3
Person 71.7
Plant 70.7
Person 67.5
Person 67.3
Person 62.4
Jar 57.6
Clothing 56.9
Hat 56.9
Tabletop 56.6
Food 56.3
Fruit 56.3
Produce 56.3
Art 55.2
Collage 55.2

Clarifai
created on 2018-05-10

people 99.8
child 99.1
many 98.7
group 97.3
boy 96.2
group together 94.2
crowd 91.2
woman 89.8
education 88.6
portrait 87.3
adult 87
recreation 86.4
sit 85.3
man 83.7
school 81.8
uniform 79.4
sitting 78.3
war 77
military 75.6
administration 71

Imagga
created on 2023-10-06

group 31.4
spectator 29.1
people 28.4
men 28.3
silhouette 24
man 21.9
male 20.5
team 18.8
crowd 16.3
business 15.8
black 14.4
person 14.4
travel 14.1
success 13.7
businessman 13.2
happy 13.1
leisure 12.4
teamwork 12
work 11.8
sport 11
mountain 10.7
photographer 10.6
sky 10.2
art 9.8
outdoors 9.8
together 9.6
standing 9.6
women 9.5
professional 9.5
activity 8.9
staff 8.7
silhouettes 8.7
walk 8.6
outline 8.5
adult 8.5
city 8.3
tourism 8.2
vacation 8.2
landscape 8.2
lifestyle 7.9
corporate 7.7
executive 7.7
outdoor 7.6
beach 7.6
field 7.5
human 7.5
action 7.4
training 7.4
uniform 7.4
many 7.4
suit 7.4
street 7.4
competition 7.3
businesswoman 7.3
celebration 7.2
recreation 7.2
holiday 7.2
worker 7.1
day 7.1

Google
created on 2018-05-10

photograph 95.2
black and white 88.5
human behavior 74.9
team 67.8
monochrome photography 67.8
crew 66.5
history 64.4
monochrome 58.2
stock photography 53.8

Microsoft
created on 2018-05-10

text 90.7
posing 77.2
group 55.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Sad 77.9%
Calm 31.5%
Confused 22.3%
Fear 9.6%
Surprised 6.4%
Angry 1.5%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 16-22
Gender Female, 99.7%
Sad 98.8%
Calm 39.1%
Surprised 6.4%
Fear 6%
Confused 1.6%
Angry 0.5%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 73.1%
Sad 14.1%
Fear 8.9%
Surprised 6.5%
Confused 3.2%
Angry 1.1%
Disgusted 0.9%
Happy 0.6%

AWS Rekognition

Age 14-22
Gender Female, 96.8%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-31
Gender Female, 99.1%
Calm 95.2%
Surprised 6.6%
Fear 6.1%
Sad 2.7%
Disgusted 0.7%
Angry 0.5%
Happy 0.5%
Confused 0.5%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Sad 97.6%
Calm 42.2%
Fear 7.6%
Surprised 6.3%
Angry 0.3%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 73.3%
Happy 44.4%
Calm 22.7%
Sad 17.5%
Surprised 7.3%
Angry 6.9%
Fear 6.5%
Confused 4.5%
Disgusted 2.1%

AWS Rekognition

Age 13-21
Gender Male, 81.6%
Calm 95.4%
Surprised 7.2%
Fear 6%
Sad 2.7%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 56-64
Gender Male, 88.2%
Sad 65.7%
Angry 21.3%
Confused 18.3%
Calm 12.4%
Fear 11.7%
Surprised 7.3%
Happy 2%
Disgusted 1.5%

AWS Rekognition

Age 7-17
Gender Female, 96.2%
Calm 90.6%
Surprised 6.8%
Fear 6.2%
Sad 3.7%
Happy 2.7%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 11-19
Gender Male, 99.9%
Calm 87.9%
Sad 10.4%
Surprised 6.3%
Fear 5.9%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 92.8%
Sad 100%
Surprised 6.3%
Calm 6%
Fear 6%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Female, 95.6%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 0.2%
Confused 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.8%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 4-10
Gender Female, 100%
Sad 99.9%
Calm 18%
Surprised 6.8%
Fear 6.3%
Happy 1.5%
Confused 1.4%
Angry 1.3%
Disgusted 0.7%

AWS Rekognition

Age 22-30
Gender Female, 100%
Surprised 96.7%
Calm 15.6%
Fear 7.3%
Angry 3.9%
Sad 2.6%
Happy 1.9%
Confused 1.5%
Disgusted 1.4%

AWS Rekognition

Age 21-29
Gender Female, 86.1%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.4%
Confused 0.3%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Sad 100%
Fear 8.2%
Calm 6.7%
Surprised 6.4%
Confused 0.7%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 14-22
Gender Female, 100%
Sad 100%
Surprised 6.6%
Fear 6.6%
Confused 2.2%
Calm 1.4%
Happy 1.2%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 11-19
Gender Male, 86.8%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 3.4%
Confused 0.3%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 95.5%
Calm 69.1%
Sad 44.5%
Surprised 6.6%
Fear 6.2%
Confused 1.7%
Angry 1.5%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Confused 53.4%
Calm 18.1%
Surprised 10.5%
Fear 9.1%
Sad 8.8%
Disgusted 1.9%
Angry 1.6%
Happy 1%

AWS Rekognition

Age 29-39
Gender Male, 99.4%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 69%
Sad 95.1%
Calm 51.8%
Surprised 6.3%
Fear 6%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 16-24
Gender Female, 50.1%
Sad 100%
Calm 13.5%
Surprised 6.3%
Fear 6%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Female, 75.3%
Calm 98.4%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 96.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.3%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 62
Gender Female

Microsoft Cognitive Services

Age 84
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Adult 96.4%
Male 96.4%
Man 96.4%
Baby 92.9%
Child 87.6%
Female 87.6%
Girl 87.6%
Plant 70.7%

Categories

Imagga

paintings art 75.7%
interior objects 10.6%
nature landscape 8.4%
pets animals 1.1%