Human Generated Data

Title

Untitled (seated woman holding infant)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.15

Human Generated Data

Title

Untitled (seated woman holding infant)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Baby 99.9
Human 99.9
Newborn 97.8
Person 94.4
Face 92.8
Painting 82.5
Art 82.5
Photo 76.2
Photography 76.2
Portrait 76.2
People 69.8
Clothing 64.2
Apparel 64.2
Female 58.5

Imagga
created on 2022-01-08

parent 68.9
child 67.7
father 63.1
dad 54.2
mother 51.9
family 47.2
son 42.6
male 42.6
home 38.3
happy 34.5
love 30.8
baby 29.6
adult 28.5
kid 27.5
happiness 27.5
daughter 26.5
cute 25.9
people 25.7
man 25.6
indoors 22.9
couch 21.3
childhood 20.6
casual 20.4
together 20.2
smiling 19.6
portrait 19.4
couple 19.2
boy 19.2
holding 19
joy 18.4
husband 18.2
affectionate 17.4
fun 17.2
offspring 17.2
smile 17.1
interior 16.8
little 16.8
brother 16.7
lifestyle 16.6
children 16.4
sitting 16.3
affection 15.5
face 14.9
domestic 14.8
looking 14.4
cheerful 13.8
person 13.7
attractive 13.3
wife 13.3
room 13
house 12.6
loving 12.4
living 12.3
adorable 12
indoor 11.9
darling 11.8
bonding 11.7
newborn 11.7
sofa 11.6
care 11.5
females 11.4
relationship 11.3
expression 11.1
leisure 10.8
color 10.6
adults 10.4
kids 10.4
black 10.2
blond 9.9
parents 9.8
half length 9.8
30s 9.6
toddler 9.6
women 9.5
mature 9.3
clothing 9.3
20s 9.2
furniture 9.1
girls 9.1
old 9.1
parenthood 8.8
life 8.8
chair 8.8
boys 8.7
mom 8.7
hug 8.7
infant 8.7
youth 8.5
laughing 8.5
head 8.4
hand 8.4
human 8.3
playing 8.2
handsome 8
generations 7.9
living room 7.8
pretty 7.7
married 7.7
break 7.6
bed 7.6
togetherness 7.6
relaxed 7.5
hold 7.4
toy 7.4
joyful 7.4
relaxing 7.3
active 7.2
cradle 7.2
hair 7.1

Google
created on 2022-01-08

Baby 84.3
Toddler 75.8
Vintage clothing 73.6
Tints and shades 73.4
Art 67.1
Sitting 65.8
Lap 65
Stock photography 63.6
Room 60.7
Child 56.7
History 56.4
Retro style 54.1
Picture frame 51.1

Microsoft
created on 2022-01-08

person 99.5
baby 99
wall 98.7
text 98.1
human face 97.2
toddler 96.1
clothing 92.2
child 82
black 81.8
old 77
white 61.7
smile 55.7
vintage 32.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-48
Gender Female, 100%
Confused 78.2%
Calm 16.3%
Surprised 1.9%
Fear 1.3%
Sad 0.8%
Disgusted 0.7%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 0-3
Gender Female, 99.6%
Calm 63.9%
Confused 19%
Angry 7.9%
Fear 2.6%
Sad 2.2%
Happy 1.8%
Surprised 1.5%
Disgusted 1.1%

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Baby 99.9%
Person 94.4%
Painting 82.5%

Captions

Microsoft

a vintage photo of a person holding a teddy bear 62.8%
a vintage photo of a teddy bear 62.7%
a vintage photo of a person holding a baby 62.6%