Human Generated Data

Title

Untitled (grandmother and boy)
Date

c. 1910
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.745

Human Generated Data

Title

Untitled (grandmother and boy)

People

Artist: Martin Schweig, American 20th century

Date

c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.745

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 97.8
Face 94.5
Female 89.2
Baby 85.3
People 83.4
Photography 78.4
Photo 78.4
Dress 78.2
Clothing 78.2
Apparel 78.2
Portrait 77.7
Woman 75
Teen 73.1
Kid 72.7
Child 72.7
Girl 70.6
Painting 70.3
Art 70.3
Family 58.1
Man 57.4

Clarifai
created on 2023-10-25

people 99.9
sepia 99.7
portrait 99.6
child 99.4
son 99
two 99
baby 97.3
adult 97.2
monochrome 97
retro 96.3
offspring 96.2
man 96
family 95.9
girl 95.7
affection 95.2
nostalgia 95
woman 94.7
facial expression 94.1
wear 93.2
art 92.5

Imagga
created on 2022-01-08

child 67.5
grandma 49.3
family 46.3
mother 39.9
parent 37.4
kid 33.7
male 33.5
home 31.9
happy 30.7
baby 29.1
people 29
childhood 28.7
boy 27.8
father 26.6
little 25.6
daughter 25.3
fun 24.7
love 22.9
together 22.8
cute 22.3
kin 21.7
son 21.1
children 21
man 20.9
portrait 20.7
smile 20.7
happiness 20.4
face 19.9
smiling 19.5
joy 19.2
person 19.2
grandfather 17.9
casual 17.8
blond 17.2
old 16.7
indoors 16.7
two 16.1
senior 15.9
adult 15.6
playing 15.5
dad 15.5
lifestyle 15.2
youth 14.5
couple 13.9
cheerful 13.8
sitting 12.9
girls 12.8
sibling 12.6
holding 12.4
laughing 12.3
kids 12.3
play 12.1
adorable 12
room 11.9
retired 11.6
interior 11.5
elderly 11.5
husband 11.5
life 11
grandmother 10.8
care 10.7
newborn 10.7
infant 10.6
mature 10.2
leisure 10
health 9.7
medical 9.7
mom 9.7
domestic 9.7
looking 9.6
toddler 9.6
loving 9.5
wife 9.5
human 9
active 9
couch 8.7
illness 8.6
house 8.4
innocent 8.1
brother 8
women 7.9
grandparent 7.9
affectionate 7.7
games 7.7
attractive 7.7
innocence 7.7
expression 7.7
married 7.7
offspring 7.6
studio 7.6
one 7.5
joyful 7.4
new 7.3
aged 7.3
day 7.1
pretty 7

Google
created on 2022-01-08

Gesture 85.2
Baby 77.5
Toddler 76.4
Vintage clothing 73.2
Child 69
Art 68.3
Classic 67
Sitting 66
Lap 63.9
Event 63
Stock photography 62.9
Room 62.8
Smile 62.7
One-piece garment 59
Portrait 57.8
Retro style 54.8
Family 53.7
Visual arts 51.1

Microsoft
created on 2022-01-08

wall 99.9
person 99.2
baby 99
toddler 97.6
human face 97.6
indoor 96.6
clothing 96.5
text 95.7
child 89.9
smile 88.1
boy 50.7
picture frame 6.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Female, 99.7%
Calm 98.9%
Sad 0.7%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 0-4
Gender Male, 96.9%
Happy 96.9%
Calm 1.8%
Confused 0.7%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 70.3%

Categories

Imagga

paintings art 56.1%
people portraits 43.5%

Captions

Microsoft
created on 2022-01-08

a person holding a baby 64.1%
a person holding a baby 42.2%
a person holding a baby 42.1%