Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)
Date

March 3, 1960-March 13, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5427

Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5427

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Furniture 100
Infant Bed 100
Baby 97.9
Person 97.9
Person 97.4
Boy 97.4
Child 97.4
Male 97.4
Baby 97.2
Person 97.2
Face 96.5
Head 96.5
Crib 96.4
Bed 88
Accessories 86.9
Bag 86.9
Handbag 86.9
Person 85.4
Male 85.4
Adult 85.4
Man 85.4
Architecture 60.8
Building 60.8
Hospital 60.8
Cradle 56

Clarifai
created on 2018-05-10

child 99.9
baby 99.3
people 99.3
cage 97.8
one 95.7
two 95.3
indoors 95.1
little 95
family 95
son 92.8
innocence 92.4
cute 91.4
fun 91.2
girl 91.1
love 91
portrait 91
group 90.6
step 89.9
play 88.6
newborn 88

Imagga
created on 2023-10-06

crib 100
baby bed 100
furniture 100
furnishing 73.7
child 48.1
kid 40.8
baby 35.6
boy 30.4
family 29.3
cute 28
little 27.4
happy 26.3
children 24.6
childhood 24.2
infant 24.1
love 23.7
people 23.4
home 23.1
face 21.3
adorable 21.2
mother 20.6
newborn 20.4
bed 19.9
lifestyle 19.5
person 19.1
indoors 17.6
male 17.4
parent 17.4
happiness 17.2
play 17.2
innocent 16.5
fun 16.5
kids 16
portrait 15.5
son 15.3
toddler 15.3
looking 15.2
smiling 15.2
care 14.8
cheerful 14.6
father 14.6
loving 14.3
adult 14.2
together 14
indoor 13.7
playing 13.7
casual 13.6
smile 13.5
man 13.4
sweet 13.4
pretty 13.3
youth 12.8
mom 12.6
holding 12.4
domestic 11.8
motherhood 11.7
innocence 11.5
playful 11.3
couple 11.3
attractive 11.2
joy 10.9
daughter 10.5
one 10.4
enjoy 10.3
eyes 10.3
hair 10.3
life 10.2
offspring 10.1
lie 9.7
sleep 9.7
mid adult 9.6
leisure 9.1
room 9.1
interior 8.8
parenthood 8.8
boys 8.7
bedroom 8.7
carefree 8.7
husband 8.6
expression 8.5
lying 8.5
head 8.4
joyful 8.3
shopping 8.3
1 2 years 7.9
look 7.9
standing 7.8
living 7.6
laughing 7.6
healthy 7.6
togetherness 7.5
relationship 7.5
inside 7.4
dress 7.2
clothing 7.2
lovely 7.1

Google
created on 2018-05-10

photograph 95.9
black 95.4
black and white 94.5
day 89.7
child 88.9
monochrome photography 88.3
photography 82.2
snapshot 81.8
product 79.9
monochrome 75
cage 63.7
toddler 60.3
girl 50.8
infant 50.6

Microsoft
created on 2018-05-10

fence 100
outdoor 85.1
boy 85
cage 80.2
gate 68.1
railing 62.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 100%
Calm 97.6%
Surprised 6.9%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 2-8
Gender Male, 87.6%
Calm 84.9%
Sad 8.8%
Surprised 7.8%
Fear 6.1%
Confused 0.6%
Disgusted 0.4%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 1-7
Gender Female, 80.2%
Sad 78.1%
Calm 34.5%
Fear 14.2%
Surprised 8.4%
Confused 5.5%
Happy 3.1%
Disgusted 1.5%
Angry 1.4%

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Baby
Person
Boy
Child
Male
Crib
Handbag
Adult
Man
Baby 97.9%
Baby 97.2%
Person 97.9%
Person 97.4%
Person 97.2%
Person 85.4%
Boy 97.4%
Child 97.4%
Male 97.4%
Male 85.4%
Crib 96.4%
Handbag 86.9%
Adult 85.4%
Man 85.4%

Captions

Microsoft
created on 2018-05-10

a young boy in a cage 86.2%
a little boy in a cage 85.3%
a small child in a cage 85.2%