Human Generated Data

Title

Untitled (portrait of man holding baby on knee)
Date

c. 1940
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12523

Human Generated Data

Title

Untitled (portrait of man holding baby on knee)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Face 99.4
Human 99.4
Person 98.7
Person 97.5
Smile 96.4
Furniture 96
Couch 96
Baby 93.9
Newborn 90.4
Portrait 82.8
Photo 82.8
Photography 82.8
Female 80.3
Shoe 80.2
Footwear 80.2
Clothing 80.2
Apparel 80.2
People 77.4
Cushion 74.4
Pillow 70.9
Indoors 69.8
Man 68.3
Kid 66.6
Child 66.6
Glasses 64.2
Accessory 64.2
Accessories 64.2
Woman 63.5
Chair 62
Selfie 61.2
Bed 60.9
Room 59.9
Living Room 59.9
Teen 58.6
Girl 58.3
Bedroom 55.9

Imagga
created on 2022-01-29

child 38
couple 35.7
home 34.3
male 33.8
people 32.9
man 32.3
family 32
happy 32
mother 30.9
love 30.8
together 27.2
smiling 26
parent 24.5
portrait 23.9
husband 22.1
person 21.6
senior 21.6
grandma 21.4
grandfather 21.3
father 21.1
adult 20.8
happiness 20.4
wife 18
kid 16.8
room 16.8
mature 16.7
lifestyle 16.6
boy 16.5
daughter 16.2
sitting 15.5
cheerful 15.4
relationship 15
sibling 14.8
dad 14.6
looking 14.4
married 14.4
elderly 14.4
loving 14.3
fun 14.2
face 14.2
couch 13.5
son 13.2
kin 12.6
bed 12.3
indoors 12.3
casual 11.9
two 11.9
old 11.8
baby 11.6
retired 11.6
care 11.5
cute 11.5
smile 11.4
blond 11.2
pretty 11.2
hair 11.1
indoor 11
childhood 10.7
affectionate 10.6
brother 10.6
little 10.6
sofa 10.5
enjoying 10.4
togetherness 10.4
men 10.3
women 10.3
relaxing 10
dress 9.9
grandmother 9.8
parents 9.8
affection 9.7
bride 9.6
youth 9.4
hospital 9.1
children 9.1
human 9
life 8.9
70s 8.9
interior 8.8
relaxed 8.4
leisure 8.3
fashion 8.3
wedding 8.3
lady 8.1
romance 8
retirement 7.7
females 7.6
house 7.5
joy 7.5
camera 7.4
inside 7.4
joyful 7.4
playing 7.3
sexy 7.2
black 7.2
holiday 7.2
handsome 7.1
romantic 7.1
day 7.1

Google
created on 2022-01-29

Smile 92.5
Black 89.6
Black-and-white 86
Style 84
Art 82.3
Happy 80.1
Monochrome 78.1
Monochrome photography 76.9
Baby 73.4
Vintage clothing 66.9
Room 66.7
T-shirt 65.9
Photo caption 65.7
Sitting 65.1
Stock photography 64.3
Toddler 59.9
Laugh 58.2
Fun 57.8
Portrait 57.2
Picture frame 54.6

Microsoft
created on 2022-01-29

wall 99.6
human face 99.1
text 98.7
person 97.2
clothing 95.4
smile 93.5
man 93.1
black 69.4
baby 63.8

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 95.7%
Happy 97.7%
Surprised 1.5%
Calm 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 13-21
Gender Female, 85.4%
Happy 78.1%
Surprised 19.5%
Calm 1.5%
Disgusted 0.3%
Angry 0.3%
Sad 0.2%
Fear 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Shoe 80.2%

Captions

Microsoft

a man sitting on a bed 72.8%
an old photo of a man 72.7%
a man posing for a photo 72.6%

Text analysis

Amazon

5
a
49
41
have
XXXXXX