Human Generated Data

Title

Untitled (two little girls on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16803

Human Generated Data

Title

Untitled (two little girls on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.9
Person 98.9
Furniture 97.7
Person 94.4
Face 93.3
Plant 92.4
Tree 87.2
Room 84
Living Room 84
Indoors 84
Apparel 82.4
Clothing 82.4
Kid 70.9
Child 70.9
Teen 68.5
Woman 68.5
Female 68.5
Blonde 68.5
Girl 68.5
Play 68.1
Couch 64.2
Portrait 62.9
Photography 62.9
Photo 62.9
Inflatable 59.6
Smile 55.1

Imagga
created on 2022-02-26

adult 35.8
happy 35.7
sitting 31.8
man 30.3
people 29.6
smiling 28.2
home 27.1
male 26.7
smile 26.4
couple 26.1
couch 25.1
lifestyle 24.6
child 24.6
sofa 24.3
happiness 23.5
kin 23.5
person 22.5
family 22.2
portrait 22
together 21.9
attractive 21
mother 20.6
parent 20.4
relaxing 19.1
casual 18.6
father 17.8
computer 17.7
pretty 17.5
leisure 17.4
sea 17.2
cheerful 17.1
laptop 16.7
vacation 16.4
beach 16.1
love 15.8
dad 15.5
looking 15.2
room 15.1
daughter 15
women 15
fun 15
indoor 13.7
holiday 13.6
handsome 13.4
kid 13.3
living 13.3
indoors 13.2
relaxation 12.6
house 12.5
grandfather 12.2
senior 12.2
grandma 12
ocean 11.9
groom 11.9
relax 11.8
outdoor 11.5
enjoy 11.3
two 11
day 11
summer 10.9
joy 10.9
childhood 10.7
outdoors 10.7
technology 10.4
men 10.3
20s 10.1
water 10
husband 9.9
life 9.9
living room 9.8
resting 9.5
work 9.4
friends 9.4
youth 9.4
cute 9.3
mature 9.3
active 9
color 8.9
group 8.9
interior 8.8
television 8.6
wife 8.5
business 8.5
rest 8.5
relationship 8.4
modern 8.4
communication 8.4
one 8.2
playing 8.2
sexy 8
working 8
clothing 7.9
model 7.8
mom 7.8
luxury 7.7
comfort 7.7
comfortable 7.6
adults 7.6
togetherness 7.6
relaxed 7.5
alone 7.3
girls 7.3
confident 7.3
sand 7.2
coast 7.2
professional 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 98.6
flower 62
person 60.3
clothing 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Happy 58.2%
Surprised 26.5%
Calm 11.5%
Disgusted 1.2%
Confused 1.1%
Fear 0.7%
Angry 0.5%
Sad 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Couch 64.2%

Captions

Microsoft

a group of people sitting in front of a window 76.8%
an old photo of a boy 74.7%
a group of people sitting on a couch 74.6%

Text analysis

Amazon

٢٥Д

Google

TOA YT37A2- XAGON
YT37A2-
TOA
XAGON