Human Generated Data

Title

Untitled (woman with two babies)
Date

c. 1920
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.747

Human Generated Data

Title

Untitled (woman with two babies)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.5
Human 98.5
Furniture 96.9
Person 96.2
Person 95.6
Newborn 92.2
Baby 92.2
Face 84.8
Portrait 64.6
Photography 64.6
Photo 64.6
Finger 61.9
Female 61.1
People 56.8
Crib 56.7
Kid 55.2
Child 55.2

Imagga
created on 2022-01-08

child 78.3
family 67.7
parent 62.3
mother 61.6
sibling 56.7
father 53.1
kin 51
son 41.3
children 41.1
baby 40.6
happy 40.2
daughter 40.1
love 39.5
boy 39.2
kid 39.1
male 38.2
happiness 36.9
together 35.1
dad 33.6
childhood 32.3
people 30.2
fun 30
smiling 29
little 28.3
cute 28
home 25.6
adult 24.6
kids 24.5
cheerful 23.6
mom 23.3
portrait 22.7
couple 22.7
man 22.2
togetherness 21.8
husband 21
brother 20.4
adorable 20.3
joy 20.1
lifestyle 19.6
two 19.5
loving 19.1
casual 18.7
sister 18.6
smile 17.9
holding 17.4
toddler 17.2
parenthood 16.6
playing 15.5
girls 15.5
infant 15.5
four 15.4
wife 15.2
offspring 15.1
face 14.9
embracing 14.7
sitting 14.6
laughing 14.2
relationship 14.1
care 14
blond 13.8
boys 13.6
affectionate 13.6
indoors 13.2
person 13.1
play 13
group 12.9
youth 12.8
30s 12.5
friends 12.2
men 12
bonding 11.7
hugging 11.7
leisure 11.6
hug 11.6
women 11.1
indoor 11
mum 10.8
parents 10.8
grandma 10.7
newborn 10.7
studio 9.9
generations 9.9
cuddling 9.9
motherhood 9.8
outdoors 9.7
black 9.6
living 9.5
enjoyment 9.4
expression 9.4
park 9.1
clothing 9
cuddle 8.9
affection 8.7
friendship 8.4
attractive 8.4
old 8.4
summer 8.4
color 8.4
toy 8.3
joyful 8.3
room 8.2
domestic 8.2
daddy 7.9
mommy 7.9
bond 7.9
life 7.8
embrace 7.8
pretty 7.7
generation 7.7
married 7.7
enjoying 7.6
females 7.6
looking 7.2
handsome 7.1
day 7.1

Google
created on 2022-01-08

Hairstyle 95.1
Picture frame 90.3
Gesture 85.3
Baby 82.7
Happy 82.1
Toddler 82
Rectangle 74.4
Art 71.9
Vintage clothing 71.5
Monochrome photography 69.7
Monochrome 67.1
Child 66.8
Stock photography 65.6
Event 64.5
Sitting 63.2
Room 60.1
Fun 59.7
Portrait 57.3
Portrait photography 55.2
Love 53.3

Microsoft
created on 2022-01-08

person 99.7
human face 98.1
toddler 97.6
indoor 96.6
child 93.7
clothing 89
smile 70.9
baby 70.2
text 69.9
boy 55.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 58.6%
Angry 72.1%
Happy 12.6%
Calm 7.2%
Surprised 2.9%
Confused 2.5%
Disgusted 1.6%
Sad 0.8%
Fear 0.3%

AWS Rekognition

Age 0-3
Gender Male, 67.4%
Surprised 62%
Happy 23%
Calm 11.2%
Disgusted 1.2%
Angry 1%
Confused 0.7%
Fear 0.6%
Sad 0.4%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Angry 60.3%
Happy 36.1%
Calm 1.3%
Sad 0.7%
Confused 0.5%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

Microsoft Cognitive Services

Age 0
Gender Male

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a person holding a baby 83.8%
a person holding a baby 69.5%
a person holding a baby 69.4%

Text analysis

Amazon

Drugtion