Human Generated Data

Title

Untitled (children with grandmother on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17479

Human Generated Data

Title

Untitled (children with grandmother on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.9
Person 98.9
Person 98.7
Furniture 98.6
Chair 97.3
Apparel 94.4
Clothing 94.4
Baby 91.7
Face 91.2
Smile 79.8
Shorts 79.2
Child 75.6
Kid 75.6
Couch 74.1
Person 73.8
Room 70.9
Living Room 70.9
Indoors 70.9
Photo 70.2
Photography 70.2
Portrait 70.2
Boy 70
Play 67.7
People 63.9
Newborn 58.2
Female 56.3
Monitor 55.3
Electronics 55.3
Screen 55.3
Display 55.3

Imagga
created on 2022-02-26

man 30.2
child 24.1
people 23.4
home 23.1
male 22.7
adult 22.3
person 22.2
happy 20.7
sitting 18
smiling 17.4
house 15
dad 14.3
interior 14.1
indoors 14.1
chair 14
attractive 14
couple 13.9
room 13.8
cheerful 13.8
father 13.1
lifestyle 13
television 12.7
smile 12.1
women 11.9
love 11.8
parent 11.8
kid 11.5
human 11.2
fun 11.2
portrait 11
cute 10.8
holding 10.7
family 10.7
couch 10.6
boy 10.4
happiness 10.2
blond 10.1
leisure 10
pretty 9.8
black 9.6
senior 9.4
cup 9.3
sofa 9.1
fashion 9
dress 9
one 9
lady 8.9
wife 8.5
adults 8.5
youth 8.5
joy 8.4
student 8.3
indoor 8.2
sexy 8
kin 8
together 7.9
brunette 7.8
education 7.8
model 7.8
furniture 7.7
men 7.7
life 7.6
lying 7.5
floor 7.4
technology 7.4
20s 7.3
girls 7.3
computer 7.2
looking 7.2
brother 7.2
working 7.1
telecommunication system 7

Google
created on 2022-02-26

Black 89.6
Black-and-white 83.9
Style 83.8
Comfort 74.7
Toddler 74.4
Eyewear 73.3
Monochrome photography 71.9
Baby 71.6
Picture frame 70.4
Fun 69.6
Monochrome 69.5
Vintage clothing 69.4
Sitting 69.3
T-shirt 69.1
Room 65.6
Art 64.4
Child 63.2
Visual arts 59.7
Photographic paper 55.8
Font 54

Microsoft
created on 2022-02-26

person 96.1
text 93.9
clothing 93
toddler 84.4
baby 67.8
furniture 62

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 92.4%
Calm 96.5%
Sad 1.1%
Fear 0.9%
Surprised 0.9%
Disgusted 0.2%
Angry 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Female, 93.9%
Calm 97.6%
Sad 1.9%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Couch 74.1%

Captions

Microsoft

a person sitting on a bed 71.4%
a man and a woman sitting on a bed 52.9%
a young man sitting on a bed 52.8%

Text analysis

Amazon

28A
KODAKSTA

Google

A2-XAGO
A2-XAGO