Human Generated Data

Title

Untitled (Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5070

Human Generated Data

Title

Untitled (Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5070

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 99.8
Crowd 99.4
Face 99.3
Head 99.3
Person 98.1
Boy 98.1
Child 98.1
Male 98.1
Person 97.1
Person 97.1
Person 95.6
Person 95.5
Person 95.4
Male 95.4
Adult 95.4
Man 95.4
Person 95.1
Child 95.1
Female 95.1
Girl 95.1
Person 94.1
Baby 94.1
Person 93.9
Person 93.7
Photography 93.6
Portrait 93.6
Person 93.5
Person 93.3
Person 92.7
Person 92.6
Person 92.1
Person 92
Person 91.9
Person 91
Person 90.3
Person 90.3
Baby 90.3
Person 90.2
Person 89.9
Person 88
Person 86.9
Audience 86.9
Person 85.1
Person 82.7
Person 81.8
Person 78.4
Person 78
Architecture 70.3
Building 70.3
Classroom 70.3
Indoors 70.3
Room 70.3
School 70.3
Person 66.2

Clarifai
created on 2018-05-10

people 99.9
many 99.8
child 99.7
group 99.6
portrait 98.3
group together 97.4
crowd 96.7
boy 96.6
education 92.9
woman 92.4
man 92.2
school 91.1
adult 89
facial expression 89
music 88.2
adolescent 87.2
retro 86.1
war 85.2
son 85
military 80.5

Imagga
created on 2023-10-06

kin 43.3
people 39
man 34.9
group 32.2
male 30.5
happy 30
person 27.3
adult 24.6
smiling 23.1
men 22.3
together 21
couple 20.9
portrait 20.7
buddy 20.4
friends 19.7
20s 18.3
women 18.2
family 17.8
businessman 17.6
business 16.4
smile 16.4
team 16.1
love 15.8
30s 15.4
happiness 14.9
child 14.8
businesswoman 14.5
senior 14
fun 13.5
friendship 13.1
cheerful 12.2
boy 12.2
sitting 12
student 12
camera 12
mother 11.8
lifestyle 11.6
meeting 11.3
spectator 11
room 10.7
face 10.6
twenties 10.5
businesspeople 10.4
celebration 10.4
father 10.3
classroom 10.3
girls 10
park 9.9
outdoors 9.7
looking 9.6
corporate 9.4
holiday 9.3
teamwork 9.3
indoor 9.1
children 9.1
black 9
new 8.9
40s 8.8
diversity 8.6
party 8.6
females 8.5
home 8
indoors 7.9
daughter 7.8
work 7.8
60s 7.8
colleagues 7.8
son 7.7
staff 7.7
attractive 7.7
four 7.7
old 7.7
casual 7.6
two 7.6
vintage 7.6
school 7.5
executive 7.4
life 7.4
aged 7.2
success 7.2
celebrate 7.2
office 7.2
night 7.1
husband 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 96.6
posing 92.7
group 70.8
black 67.5
old 56.3
crowd 5.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 100%
Sad 100%
Surprised 6.4%
Fear 6.4%
Calm 5.1%
Angry 3.7%
Confused 0.8%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 100%
Sad 92%
Calm 34.4%
Angry 11.1%
Surprised 7%
Fear 6.3%
Confused 5.6%
Disgusted 1.9%
Happy 0.7%

AWS Rekognition

Age 6-14
Gender Male, 98.4%
Calm 95.6%
Surprised 6.3%
Fear 5.9%
Sad 3.9%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 30-40
Gender Female, 99.6%
Calm 66.4%
Sad 18.8%
Fear 14.4%
Surprised 6.3%
Angry 1%
Confused 0.8%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 99.9%
Sad 99.9%
Confused 15.1%
Calm 8.8%
Surprised 6.3%
Fear 6.3%
Angry 0.9%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 16-24
Gender Female, 99.6%
Calm 96.9%
Surprised 6.3%
Fear 5.9%
Sad 3.2%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 7-17
Gender Male, 71.8%
Sad 100%
Fear 6.4%
Surprised 6.3%
Calm 5.5%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 14-22
Gender Male, 98.4%
Sad 100%
Angry 11.1%
Surprised 6.3%
Fear 6%
Calm 0.9%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 54.7%
Sad 43.2%
Fear 11.9%
Surprised 6.5%
Angry 4.4%
Disgusted 2.7%
Confused 0.8%
Happy 0.7%

AWS Rekognition

Age 47-53
Gender Female, 86%
Confused 60.5%
Angry 14.1%
Sad 9.8%
Disgusted 8%
Surprised 7.9%
Fear 6.5%
Calm 1%
Happy 0.6%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 96.5%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Confused 2.1%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Confused 66.7%
Calm 24.6%
Surprised 6.5%
Fear 6%
Sad 4.8%
Disgusted 0.9%
Angry 0.8%
Happy 0.3%

AWS Rekognition

Age 16-24
Gender Female, 98.5%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.7%
Disgusted 0.6%
Confused 0.3%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Female, 98.7%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.7%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Sad 99.7%
Calm 23.8%
Surprised 6.5%
Fear 6.2%
Disgusted 3.1%
Angry 2.3%
Confused 1.7%
Happy 0.4%

AWS Rekognition

Age 11-19
Gender Female, 58%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.4%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 57-65
Gender Female, 97.7%
Sad 95.9%
Calm 34.1%
Fear 9.1%
Surprised 8.5%
Confused 4.7%
Angry 0.8%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 71.6%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Female, 65.2%
Sad 100%
Fear 6.4%
Surprised 6.3%
Calm 2%
Confused 0.3%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 18-26
Gender Male, 98.9%
Calm 89.8%
Surprised 6.8%
Fear 6%
Sad 3.8%
Confused 2.1%
Disgusted 1.2%
Angry 0.8%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Female, 98.8%
Calm 98.2%
Fear 6.4%
Surprised 6.3%
Sad 2.2%
Happy 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 51-59
Gender Female, 99.9%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Male, 85.7%
Happy 43.1%
Calm 33.5%
Surprised 9.1%
Fear 7.8%
Sad 7.6%
Angry 2.4%
Disgusted 1.4%
Confused 1.2%

AWS Rekognition

Age 18-24
Gender Female, 54.1%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 84.2%
Surprised 10%
Fear 6.7%
Confused 3.2%
Sad 2.8%
Angry 1.9%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Female, 70.8%
Sad 99.7%
Calm 22.5%
Fear 8.2%
Surprised 7%
Confused 2.6%
Angry 0.9%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Calm 94.3%
Surprised 6.3%
Fear 5.9%
Sad 4%
Happy 0.6%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Boy 98.1%
Child 98.1%
Male 98.1%
Adult 95.4%
Man 95.4%
Female 95.1%
Girl 95.1%
Baby 94.1%

Categories

Imagga

paintings art 91.6%
interior objects 5.7%