Human Generated Data

Title

Untitled (child playing with doll on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16404

Human Generated Data

Title

Untitled (child playing with doll on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Furniture 100
Person 99.2
Human 99.2
Cushion 95.6
Couch 95.4
Pillow 94.1
Living Room 66.2
Indoors 66.2
Room 66.2
Bed 64.1
Home Decor 59.3
Child 55.8
Kid 55.8

Imagga
created on 2022-02-11

snow 34.9
sled 33.1
bobsled 30.7
winter 30.6
happy 28.8
person 28.5
people 27.9
cold 27.5
adult 26.3
fun 23.2
man 22.8
male 22.8
vehicle 22.6
lifestyle 20.9
child 20.4
smiling 18.8
leisure 18.3
portrait 18.1
smile 17.8
home 17.5
happiness 17.2
vacation 17.2
sitting 17.2
joy 16.7
together 15.8
couple 15.7
season 15.6
attractive 14.7
active 14.5
clothing 14.3
grandfather 14
outdoor 13.8
sport 13.2
outdoors 12.7
love 12.6
youth 11.9
casual 11.9
room 11.7
couch 11.6
mountain 11.6
cheerful 11.4
seat 11.2
play 11.2
outside 11.1
camera 11.1
sky 10.8
freeze 10.8
ottoman 10.8
holiday 10.7
family 10.7
conveyance 10.4
looking 10.4
cute 10
house 10
pretty 9.8
kid 9.7
snowy 9.7
one 9.7
bed 9.6
lying 9.4
sofa 9.3
mother 9.1
life 9.1
dress 9
childhood 9
activity 8.9
model 8.6
down 8.5
enjoy 8.5
travel 8.4
ice 8.4
weather 8.4
indoor 8.2
patient 8.1
recreation 8.1
bedroom 7.8
boy 7.8
slide 7.8
men 7.7
frost 7.7
frozen 7.6
laughing 7.6
cap 7.5
human 7.5
landscape 7.4
action 7.4
hat 7.4
sports 7.4
speed 7.3
alone 7.3
relaxing 7.3
romantic 7.1
women 7.1
face 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

man 92.7
person 91.7
text 87.2
human face 86.1
outdoor 85.1
clothing 81.1
bed 55.3

Face analysis

Amazon

Google

AWS Rekognition

Age 10-18
Gender Male, 92%
Calm 85%
Sad 14.2%
Confused 0.4%
Angry 0.3%
Surprised 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Couch 95.4%

Captions

Microsoft

a man riding a snowboard down the side of a window 47.9%
a man taking a selfie in the snow 47.8%
a man riding on the snow 47.7%

Text analysis

Amazon

14
KODAK-S.VEELA

Google

YT3HA
14
14 YT3HA 2 XAGON
2
XAGON