Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5129

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5129

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Plant 99.4
Potted Plant 99.4
Garden 99.2
Nature 99.2
Outdoors 99.2
Person 98.5
Baby 98.5
Person 98.5
Child 98.5
Female 98.5
Girl 98.5
Person 97.8
Person 97.7
Child 97.7
Female 97.7
Girl 97.7
Person 97.5
Person 95.7
Child 95.7
Boy 95.7
Male 95.7
Person 92.9
Food 92.6
Fruit 92.6
Produce 92.6
Leaf 82.7
People 78.5
Backyard 65
Yard 65
Gardening 57.4
Apple 57.3
Clothing 57
Dress 57
Basket 56.5
Flower 56.2
Vegetation 56
Citrus Fruit 55.4
Grapefruit 55.4
Jar 55.2

Clarifai
created on 2018-05-10

people 100
child 99.7
group 99.7
many 98.1
several 96.4
adult 95.2
five 94.9
son 93.1
group together 93
offspring 93
family 92.5
home 92.1
boy 91.8
facial expression 90.5
woman 90.2
sit 89.7
sibling 89.4
wear 88.8
man 88.4
war 86.9

Imagga
created on 2023-10-06

kin 59.7
mother 37.8
child 35.8
parent 35.4
father 35.1
family 31.1
happy 30.7
dad 29.3
male 28.8
people 27.9
outdoors 27.8
smiling 26
grandfather 25.6
man 25.5
together 25.4
park 23.9
happiness 21.2
couple 20.9
portrait 20.1
lifestyle 18.8
fun 18.7
daughter 18.7
smile 17.8
home 17.6
adult 16.9
boy 16.5
women 15.8
love 15.8
person 15.5
old 15.3
husband 15.3
togetherness 15.1
senior 15
cheerful 14.6
girls 14.6
children 14.6
summer 13.5
kid 13.3
group 12.9
outside 12.8
garden 12.6
childhood 12.5
son 12.4
enjoying 12.3
outdoor 12.2
mature 12.1
casual 11.9
grandma 11.8
cute 11.5
autumn 11.4
grass 11.1
two 11
day 11
sibling 10.6
wife 10.4
sitting 10.3
men 10.3
healthy 10.1
little 9.7
life 9.7
females 9.5
friends 9.4
horizontal 9.2
joy 9.2
leisure 9.1
bench 9.1
fall 9
30s 8.7
elderly 8.6
brother 8.5
friendship 8.4
tree 7.9
holiday 7.9
parents 7.8
sister 7.8
face 7.8
season 7.8
ancient 7.8
having 7.7
kids 7.5
enjoyment 7.5
room 7.4
countryside 7.3
playing 7.3
blond 7.2
juvenile 7.2
hair 7.1
rural 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

old 81.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Female, 100%
Calm 88.9%
Surprised 6.8%
Fear 6.4%
Confused 6.3%
Sad 2.6%
Angry 0.7%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 2-8
Gender Male, 67.5%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 2.7%
Calm 1%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 2-8
Gender Male, 96.4%
Sad 100%
Surprised 7%
Calm 6.4%
Fear 6.2%
Confused 1.8%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 2-8
Gender Male, 91.2%
Calm 94.1%
Fear 6.4%
Surprised 6.4%
Sad 3.3%
Confused 0.5%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 1-7
Gender Male, 65.5%
Sad 100%
Calm 14.1%
Surprised 6.7%
Fear 6.2%
Confused 1.3%
Angry 0.9%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 6-12
Gender Female, 99.8%
Sad 100%
Surprised 6.6%
Fear 6.2%
Happy 6.1%
Calm 3.9%
Disgusted 0.7%
Angry 0.7%
Confused 0.4%

AWS Rekognition

Age 29-39
Gender Male, 60.8%
Calm 83.1%
Happy 11.8%
Surprised 6.4%
Fear 5.9%
Sad 3.4%
Confused 0.6%
Disgusted 0.4%
Angry 0.3%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Baby 98.5%
Child 98.5%
Female 98.5%
Girl 98.5%
Boy 95.7%
Male 95.7%

Categories

Imagga

paintings art 94.6%
people portraits 2.7%

Captions