Human Generated Data

Title

Untitled (two children)
Date

1920s
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.821

Human Generated Data

Title

Untitled (two children)

People

Artist: Bachrach Studios, founded 1868

Date

1920s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.9
Person 99.3
Human 99.3
Person 98.1
Shelf 87.2
Room 87.2
Indoors 87.2
Bookcase 85.9
Dog 80.2
Mammal 80.2
Animal 80.2
Canine 80.2
Pet 80.2
Interior Design 74.1
Bed 69
Wood 57.9
Couch 57.4

Imagga
created on 2022-01-09

child 63.6
home 49.6
father 47.4
family 47.2
parent 42.8
male 39
mother 36.9
dad 36.1
baby 35.9
happy 33.9
people 33
indoors 30.8
nurse 30.5
happiness 29.8
man 29.6
hospital 29.1
love 28.5
kid 28.4
smiling 28.3
together 27.2
boy 27
adult 26
couple 25.3
son 25
daughter 23.8
couch 23.2
lifestyle 23.2
living 22.8
casual 22.1
room 22.1
children 21.9
sitting 21.5
husband 21
fun 21
childhood 20.6
little 19.5
cheerful 18.7
cute 18.7
portrait 18.2
domestic 17.8
leisure 17.5
indoor 17.4
smile 17.1
wife 17.1
neonate 17.1
two 17
kin 16.3
person 16.3
face 15.7
mid adult 15.5
30s 15.4
joy 15.1
holding 14.9
living room 14.7
playing 14.6
relaxing 14.6
mom 14.6
togetherness 14.2
sofa 13.4
interior 13.3
care 13.2
senior 13.1
sibling 13
offspring 12.9
clothing 12.6
elderly 12.5
kids 12.3
relaxed 12.2
mature 12.1
adorable 12
grandfather 11.9
blond 11.7
laughing 11.4
relationship 11.3
play 11.2
life 11
house 10.9
parents 10.8
two people 10.7
color 10.6
loving 10.5
reading 10.5
old 10.5
one 10.5
brother 10.5
sit 10.4
looking 10.4
day 10.2
chair 10.2
horizontal 10.1
relaxation 10.1
retired 9.7
affectionate 9.7
women 9.5
book 9.2
good mood 8.8
parenthood 8.8
infant 8.7
only 8.6
armchair 8.3
20s 8.3
girls 8.2
computer 8
generations 7.9
sister 7.8
bonding 7.8
middle aged 7.8
newborn 7.8
hug 7.8
men 7.7
innocence 7.7
expression 7.7
enjoying 7.6
enjoy 7.5
enjoyment 7.5
attractive 7

Google
created on 2022-01-09

Photograph 94.2
Smile 93.2
Baby 80
Bookcase 78.9
Shelf 78.2
People 77.7
Curtain 75.9
Toddler 75.3
Snapshot 74.3
Vintage clothing 71.4
Room 71.1
Child 70.7
Monochrome photography 70.5
Monochrome 69.4
Art 69.1
Happy 68.8
Sitting 65
Fun 64.3
Publication 63.4
Picture frame 58

Microsoft
created on 2022-01-09

sitting 98.3
person 97.1
toddler 96.3
baby 95.8
indoor 94.1
text 94
boy 93.5
child 90.8
human face 80.3
clothing 64.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Male, 98%
Calm 100%
Confused 0%
Sad 0%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 0-6
Gender Male, 88.2%
Calm 93.1%
Happy 4.9%
Surprised 0.7%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Dog 80.2%

Captions

Microsoft

a young boy sitting next to a window 56.9%
a little boy sitting in front of a window 56.8%
a little boy that is sitting in front of a window 52.8%

Text analysis

Amazon

Bechreeh

Google

DHIC
DHIC