Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)
Date

March 3, 1960-March 13, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5412

Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5412

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.7
Human 99.7
Person 99.5
Person 99.1
Clothing 97.9
Dress 97.9
Apparel 97.9
Person 97.8
Face 97.2
Person 94.5
People 91.4
Female 89
Teen 88.7
Baby 87.8
Person 81.8
Newborn 80.3
Child 80.1
Kid 80.1
Girl 77.6
Woman 71.8
Photo 71.7
Photography 71.7
Portrait 70.4
Texture 68.2
Person 66.5
Family 65.5
Hair 62.1
Couch 58.2
Furniture 58.2

Clarifai
created on 2018-03-23

child 100
people 99.7
son 99.6
group 99.5
three 99.2
sibling 98.9
two 98.6
offspring 97.8
four 97.7
family 96.2
facial expression 96
boy 95.1
wear 93.3
baby 90.4
girl 89.8
adult 89.3
daylight 88.8
five 87.5
adolescence 86.4
group together 85.9

Imagga
created on 2018-03-23

mother 100
parent 89.1
child 59.8
family 56.1
father 44.3
daughter 37.7
happy 37.6
love 36.3
male 36
together 34.2
home 31.9
people 31.3
dad 30.7
man 29.6
son 29
happiness 28.2
couple 25.3
boy 25.2
kid 24.8
children 24.6
smiling 24.6
smile 23.5
brother 23.1
fun 21.7
portrait 21.4
adult 21.4
loving 21
cute 20.8
sitting 20.6
casual 20.4
lifestyle 20.3
pajama 18.4
togetherness 18
kids 17.9
baby 17.8
little 17.7
laughing 17
husband 16.2
mom 15.5
hug 15.5
attractive 15.4
childhood 15.2
indoors 15
parents 14.7
cheerful 14.6
playing 14.6
affectionate 14.5
30s 13.5
generation 13.5
wife 13.3
kin 13.1
nightwear 12.8
two 12.7
boys 12.6
holding 12.4
clothing 12.3
adorable 12
outdoors 12
girls 11.9
couch 11.6
affection 11.6
toddler 11.5
group 11.3
senior 11.3
youth 11.1
life 11
joy 10.9
grandmother 10.8
grandfather 10.8
parenthood 10.8
embracing 10.8
care 10.7
relationship 10.3
mature 10.2
house 10
park 9.9
cuddling 9.9
mum 9.8
their 9.8
40s 9.7
women 9.5
enjoying 9.5
day 9.4
offspring 9.3
room 9.1
pretty 9.1
old 9.1
cuddle 8.9
sister 8.8
thirties 8.8
infant 8.7
comfort 8.7
diversity 8.7
play 8.6
outside 8.6
friends 8.5
indoor 8.2
teenager 8.2
person 8.1
interior 8
generations 7.9
sibling 7.9
hugging 7.8
men 7.7
companion 7.7
elderly 7.7
living 7.6
adults 7.6
friendship 7.5
camera 7.4
emotion 7.4
grandma 7.4
lady 7.3

Google
created on 2018-03-23

people 97.7
child 97.1
white 96.2
photograph 95.8
black 95.7
person 94.4
facial expression 94.2
social group 94
black and white 92.1
day 89.7
girl 89.5
smile 87.3
monochrome photography 85.5
emotion 82.3
snapshot 81.8
sitting 80.2
photography 79.5
standing 76.7
fun 74.4
human 73.1

Microsoft
created on 2018-03-23

person 100
pajama 48

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-7
Gender Female, 99.9%
Angry 5.1%
Calm 84.5%
Happy 4%
Disgusted 1%
Surprised 3.1%
Sad 1.4%
Confused 0.9%

AWS Rekognition

Age 4-7
Gender Female, 70.4%
Angry 1.4%
Sad 1.3%
Calm 94.1%
Confused 0.6%
Surprised 1.3%
Happy 0.5%
Disgusted 0.7%

AWS Rekognition

Age 9-14
Gender Female, 99.1%
Sad 16%
Surprised 1.9%
Calm 78.3%
Happy 0.6%
Angry 1.5%
Disgusted 0.2%
Confused 1.5%

AWS Rekognition

Age 2-5
Gender Female, 99.8%
Disgusted 0.3%
Surprised 0.2%
Angry 1.4%
Sad 13.6%
Confused 0.7%
Happy 0.3%
Calm 83.4%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

people portraits 98.9%
paintings art 0.5%
events parties 0.2%
pets animals 0.1%
nature landscape 0.1%
food drinks 0.1%

Captions

Microsoft
created on 2018-03-23

a black and white photo of a baby 73.4%
a man holding a baby 50.9%
a person holding a baby 50.8%