Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5084

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5084

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Adult 98.5
Bride 98.5
Female 98.5
Person 98.5
Wedding 98.5
Woman 98.5
Adult 98.1
Bride 98.1
Female 98.1
Person 98.1
Woman 98.1
People 97.8
Person 96.9
Boy 96.9
Child 96.9
Male 96.9
Photography 96.8
Face 96.6
Head 96.6
Portrait 96.6
Person 96.5
Person 96.4
Person 94.6
Clothing 93.6
Hat 93.6
Accessories 93.4
Sunglasses 93.4
Person 93
Person 92.8
Crowd 89.3
Person 87.9
Person 87.6
Person 83
Person 82.3
Person 77.5
Costume 75
Person 74.4
Person 71.3
Hippie 62.2
Parade 61.9
Dress 57.6
Protest 56.2
Carnival 56
Person 55.8
Festival 55.5
Electrical Device 55.4
Microphone 55.4
Performer 55.2

Clarifai
created on 2018-05-10

people 99.9
many 95.8
group 95.6
woman 95.1
crowd 94.5
adult 94.2
child 93.3
audience 89.6
administration 86.7
man 86.1
group together 85.6
music 83.7
wear 82.5
education 76.7
veil 75.7
recreation 73.9
leader 73.2
military 73.1
spectator 72.9
adolescent 70.5

Imagga
created on 2023-10-06

snow 32.8
winter 27.2
people 25.1
person 24.1
cold 20.6
portrait 19.4
world 17.7
man 17.5
black 15.2
fashion 15.1
happy 15
outdoor 14.5
adult 14.3
weather 13.9
dress 13.5
ice 13.5
male 13.5
clothing 13.4
face 12.8
landscape 12.6
hair 11.9
mask 11.6
tree 11.5
human 11.2
negative 11.1
women 11.1
outdoors 10.7
travel 10.6
sun 10.5
forest 10.4
wall 10.4
eyes 10.3
clothes 10.3
model 10.1
film 10.1
active 10
spectator 10
smile 10
old 9.7
fun 9.7
outside 9.4
cute 9.3
holiday 9.3
cheerful 8.9
cool 8.9
costume 8.9
sexy 8.8
together 8.8
scene 8.6
walking 8.5
youth 8.5
head 8.4
pretty 8.4
park 8.3
hat 8.3
blond 8.1
smiling 8
couple 7.8
season 7.8
snowy 7.8
fountain 7.8
men 7.7
attractive 7.7
frost 7.7
art 7.7
sky 7.6
walk 7.6
one 7.5
looking 7.2
trees 7.1
scarf 7.1
day 7.1
happiness 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.5
person 92.8
posing 84.8
group 82.5
people 79.2
standing 79.1
old 68.5
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-10
Gender Female, 99.8%
Calm 97.6%
Surprised 6.3%
Fear 5.9%
Sad 2.9%
Confused 0.1%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 1-7
Gender Male, 84.2%
Calm 72.8%
Sad 30%
Surprised 7.9%
Fear 6.5%
Confused 1.1%
Disgusted 0.4%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Female, 85.4%
Calm 50.1%
Disgusted 20.4%
Surprised 18.3%
Confused 7.1%
Fear 7%
Angry 3%
Sad 2.5%
Happy 1.4%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 77.7%
Happy 16.2%
Surprised 7%
Fear 6.1%
Sad 2.7%
Confused 1.6%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Calm 55.3%
Sad 42.5%
Fear 16%
Surprised 6.7%
Confused 0.9%
Disgusted 0.8%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 95.5%
Calm 65.3%
Fear 33%
Surprised 6.5%
Sad 3%
Confused 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Calm 52.3%
Surprised 30.6%
Fear 8.2%
Happy 7%
Sad 5.6%
Disgusted 2.8%
Confused 2.5%
Angry 1.1%

AWS Rekognition

Age 27-37
Gender Female, 57.9%
Surprised 98.5%
Calm 7.2%
Fear 7.2%
Happy 5.6%
Sad 2.8%
Disgusted 1.1%
Angry 0.9%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Female, 88.5%
Calm 63.7%
Sad 14.1%
Surprised 12.2%
Fear 8.4%
Happy 3.1%
Angry 2.3%
Confused 1.3%
Disgusted 1.3%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Sad 100%
Calm 11.1%
Surprised 6.3%
Fear 5.9%
Happy 0.7%
Confused 0.4%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 22-30
Gender Male, 68.8%
Sad 97.9%
Calm 20%
Fear 7.2%
Happy 7%
Surprised 6.9%
Confused 6.7%
Disgusted 4.3%
Angry 3.7%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.5%
Bride 98.5%
Female 98.5%
Person 98.5%
Woman 98.5%
Boy 96.9%
Child 96.9%
Male 96.9%