Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5078

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5078

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Person 99
Adult 99
Bride 99
Female 99
Wedding 99
Woman 99
Person 98
Person 97.8
Person 93.6
Person 91.9
Adult 91.9
Male 91.9
Man 91.9
Person 88.9
Clothing 88.3
Costume 88.3
Person 86
Person 86
Hat 79.9
Person 78.6
Person 78.2
Performer 78
Crowd 75.9
Person 73
Clown 70.9
Person 65.5
Person 60.4
Person 59
Person 58.8
Carnival 57.1
People 57
Mime 56.2
Alien 55.9
Hippie 55.6
Parade 55.5

Clarifai
created on 2018-05-10

people 99.9
child 98.3
group 97.5
woman 93.3
man 93.2
wear 92.9
administration 92.5
adult 91
boy 89.9
group together 89.7
portrait 89.6
recreation 86
facial expression 82.1
family 81.6
lid 81.1
actor 81.1
veil 81.1
war 81.1
outfit 79.6
monochrome 78.1

Imagga
created on 2023-10-07

mask 100
covering 84.5
disguise 75.6
mascot 51.7
attire 50.5
clothing 33.3
person 25.2
man 23.5
portrait 22
comedian 21.2
black 19.2
face 17.8
performer 17.7
people 17.3
costume 17
consumer goods 16.4
male 15.6
carnival 15.6
entertainer 13.7
ski mask 12.8
fun 12.7
dark 12.5
face mask 12.2
dress 11.7
art 11.7
horror 11.7
scary 11.6
adult 11
make 10.9
holiday 10.7
happy 10.7
ball 10.4
eyes 10.3
colorful 10
spooky 9.8
party 9.5
head 9.2
protection 9.1
danger 9.1
attractive 9.1
masquerade 8.9
decoration 8.8
evil 8.8
celebration 8.8
hair 8.7
death 8.7
pretty 8.4
color 8.3
traditional 8.3
entertainment 8.3
teen 8.3
hat 8.2
fantasy 8.1
lady 8.1
smiling 8
venetian 7.9
boy 7.8
soldier 7.8
theater 7.8
culture 7.7
studio 7.6
hand 7.6
teenager 7.3
group 7.3
season 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 88.4
posing 79.5
old 52.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 98.6%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 6-16
Gender Female, 97%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 2.2%
Calm 0.2%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Female, 50.2%
Calm 95.9%
Surprised 6.6%
Fear 6%
Sad 2.4%
Confused 1.7%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 16-22
Gender Female, 65.6%
Sad 99.3%
Confused 19.1%
Fear 9.7%
Surprised 8.3%
Disgusted 3.3%
Calm 3.3%
Angry 0.8%
Happy 0.7%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 89.4%
Surprised 6.6%
Fear 6%
Sad 6%
Confused 1.3%
Disgusted 0.3%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 98.8%
Calm 82.7%
Sad 15.4%
Surprised 6.4%
Fear 6.1%
Confused 0.7%
Angry 0.6%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 94.1%
Happy 85.3%
Calm 10.2%
Surprised 6.4%
Fear 6.1%
Sad 2.8%
Confused 0.8%
Disgusted 0.5%
Angry 0.2%

AWS Rekognition

Age 19-27
Gender Male, 63.6%
Surprised 99.3%
Confused 8.7%
Fear 6.3%
Sad 2.2%
Calm 0.4%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 12-20
Gender Female, 98.8%
Calm 73.6%
Sad 21.6%
Fear 7.7%
Surprised 6.5%
Confused 2.8%
Happy 0.5%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 34-42
Gender Female, 95.5%
Happy 96.5%
Surprised 6.3%
Fear 6%
Sad 2.4%
Calm 1.4%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 16-24
Gender Female, 73.5%
Calm 65.8%
Sad 33.5%
Surprised 6.8%
Fear 6.5%
Confused 4.5%
Disgusted 2.4%
Angry 1.7%
Happy 1.1%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Adult 99%
Bride 99%
Female 99%
Woman 99%
Male 91.9%
Man 91.9%

Categories