Human Generated Data

Title

Untitled (portrait of boy in baby blue suit)

Date

c. 1970

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.537

Human Generated Data

Title

Untitled (portrait of boy in baby blue suit)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.3
Person 98.7
Human 98.7
Apparel 91
Clothing 91
Wood 83.5
Sitting 71.5
Hardwood 71.3
Finger 60.1
Armchair 56.6
Couch 55.9

Imagga
created on 2022-02-26

toilet 62
child 50.4
home 35.9
sitting 31.8
family 31.2
kid 30.2
people 28.5
armchair 28.5
happy 27.6
male 26.9
smiling 26.8
person 26.2
chair 25.6
boy 25.2
children 24.6
cute 24.4
childhood 24.2
seat 23.7
happiness 23.5
indoors 22.9
little 22.1
casual 22.1
adult 22
portrait 20.7
cheerful 20.3
room 20.3
fun 19.5
lifestyle 18.8
interior 17.7
sofa 17.7
man 17.5
couch 17.4
kids 17
mother 16.8
joy 16.7
love 16.6
baby 16.4
daughter 15.6
looking 15.2
living 15.2
father 14.3
husband 14.3
couple 14
adorable 13.9
expression 13.7
smile 13.6
support 13.5
face 13.5
leisure 13.3
together 13.2
senior 13.1
mature 13
one 12.7
son 12.5
elderly 12.5
toddler 12.4
wife 12.3
sit 12.3
furniture 12.2
play 12.1
domestic 12
hair 11.9
indoor 11.9
girls 11.9
house 11.7
youth 11.1
blond 11
playing 11
care 10.7
attractive 10.5
grandfather 10.4
women 10.3
relaxing 10
offspring 10
parent 9.8
boys 9.7
innocence 9.6
enjoyment 9.4
relax 9.3
brother 9.3
rocking chair 9.2
device 9
outdoors 9
preschooler 8.8
retired 8.7
eyes 8.6
learning 8.5
pretty 8.4
old 8.4
rest 8.2
computer 8.1
innocent 8
clothing 7.9
sweet 7.9
grandmother 7.8
laptop 7.8
mom 7.8
outside 7.7
togetherness 7.6
enjoy 7.5
holding 7.4
technology 7.4
joyful 7.4
color 7.2
active 7.2
lovely 7.1
working 7.1

Google
created on 2022-02-26

Product 90.8
Textile 87.4
Sleeve 87.2
Chair 86.7
Wood 85.3
Picture frame 85
Rectangle 78.6
Art 76.8
Toddler 75.1
Room 72.7
Vintage clothing 71.8
Sitting 69
Visual arts 67.2
Stock photography 64.1
Portrait 61.5
Portrait photography 58.9
Child 58.2
Illustration 57.2
Painting 56.8
Baby 52.8

Microsoft
created on 2022-02-26

wall 99.5
sitting 99.4
clothing 97.4
human face 97.1
person 97.1
indoor 94.2
child 71.4
boy 65.4
baby 53
toddler 31.8
picture frame 8.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 97.1%
Calm 99.8%
Sad 0.1%
Angry 0.1%
Fear 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Couch 55.9%

Captions

Microsoft

a little boy sitting on a bench 67.1%
a little boy that is sitting on a bench 61.8%
a small child sitting on a bench 61.7%