Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)

Date

March 3, 1960-March 13, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5439

Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5439

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Face 98.8
Head 98.8
Photography 98.8
Portrait 98.8
Person 98.5
Child 98.5
Female 98.5
Girl 98.5
Person 98.4
Baby 98.4
Person 98.3
Baby 98.3
Person 98.2
Baby 98.2
Person 97.8
Child 97.8
Female 97.8
Girl 97.8
Person 97.5
Baby 97.5
Kindergarten 93.7
Furniture 91.1
Table 91.1
Indoors 82.2
Person 82
People 69.9
Ball 64.9
Football 64.9
Soccer 64.9
Soccer Ball 64.9
Sport 64.9
Person 60
Architecture 57.9
Building 57.9
Classroom 57.9
Room 57.9
School 57.9
Dining Table 57.4
Reading 56.8
Body Part 56.3
Finger 56.3
Hand 56.3

Clarifai
created on 2018-05-10

child 100
son 99.2
baby 98.5
family 98.5
little 98.2
cute 98.1
people 97.6
sit 95.8
indoors 95.7
sibling 95.6
fun 95
offspring 93.9
education 93.1
boy 92.4
innocence 92.1
room 91.7
group 91.4
togetherness 89.5
toddler 89.2
curiosity 87.4

Imagga
created on 2023-10-07

parent 54.8
mother 52.9
child 48.2
father 34.8
couple 34
love 33.2
man 32.3
dad 32.1
happy 31.4
family 28.5
lifestyle 28.2
home 27.9
male 27.9
people 26.8
happiness 26.7
brother 26.6
together 24.6
nurse 24.2
sibling 24
adult 22.7
smiling 22.4
indoors 20.2
boy 18.3
husband 18.1
spa 18
lying 17.9
smile 17.8
attractive 17.5
two 17
relationship 16.9
kid 16.8
baby 16.2
children 15.5
boyfriend 15.4
girlfriend 15.4
daughter 15.1
cheerful 14.6
women 14.2
relaxation 14.2
20s 13.8
sitting 13.8
relaxing 13.7
portrait 13.6
casual 13.6
fun 13.5
loving 13.4
care 13.2
room 13.1
cute 12.9
pretty 12.6
bed 12.4
son 12
treatment 12
house 11.7
joy 11.7
hug 11.6
30s 11.5
massage 11.5
wife 11.4
living 11.4
adults 11.4
indoor 11
relax 11
playing 10.9
childhood 10.8
mom 10.7
face 10.7
brunette 10.5
togetherness 10.4
relaxed 10.3
holding 9.9
two people 9.7
little 9.7
life 9.7
affectionate 9.7
person 9.7
couch 9.7
body 9.6
kids 9.4
youth 9.4
leisure 9.1
laptop 9.1
romantic 8.9
closeness 8.9
computer 8.8
bedroom 8.7
affection 8.7
comfort 8.7
comfortable 8.6
men 8.6
luxury 8.6
skin 8.5
enjoyment 8.5
rest 8.4
color 8.3
back 8.3
lady 8.1
companion 8.1
lover 7.8
motherhood 7.8
hugging 7.8
newborn 7.8
married 7.7
health 7.7
therapy 7.5
adorable 7.4
emotion 7.4
group 7.3
sexy 7.2
looking 7.2
school 7.2
romance 7.2

Google
created on 2018-05-10

child 96.6
people 96.1
photograph 95.6
black and white 92.8
person 92.6
day 88.7
monochrome photography 83
snapshot 81.8
sitting 79.2
toddler 69.2
monochrome 68.1
human behavior 63.4
family 63
infant 62.9
smile 59.8
product 57.8
girl 56.7

Microsoft
created on 2018-05-10

person 100
indoor 96.5
child 94.9
baby 72.1
bedroom 49.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 97.5%
Sad 100%
Surprised 6.3%
Fear 6.1%
Calm 1.4%
Confused 1.1%
Angry 0.3%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-4
Gender Male, 99.7%
Angry 94%
Surprised 6.5%
Fear 6.1%
Sad 2.8%
Calm 1.5%
Confused 1.1%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 0-6
Gender Female, 95.7%
Sad 76.2%
Calm 43.2%
Surprised 26.7%
Fear 6.1%
Angry 0.7%
Disgusted 0.4%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 1-7
Gender Female, 100%
Sad 100%
Surprised 6.4%
Fear 6.1%
Calm 1.9%
Angry 1.2%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 0-4
Gender Female, 97.2%
Sad 53.8%
Calm 48.5%
Angry 15.1%
Surprised 6.8%
Fear 6.3%
Happy 2.9%
Confused 2.3%
Disgusted 1.2%

AWS Rekognition

Age 1-7
Gender Male, 92.3%
Calm 81.6%
Surprised 9%
Fear 6.2%
Sad 5.5%
Confused 3.5%
Angry 1.8%
Disgusted 0.8%
Happy 0.2%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Child 98.5%
Female 98.5%
Girl 98.5%
Baby 98.4%
Soccer Ball 64.9%

Categories

Text analysis

Amazon

J