Human Generated Data

Title

Untitled (children playing with toys on couch)
Date

1957
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17506

Human Generated Data

Title

Untitled (children playing with toys on couch)

People

Artist: Lucian and Mary Brown, American

Date

1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 100
Couch 99.5
Human 99.4
Person 99.4
Person 98.9
Person 98.2
Person 97.9
Person 97.8
Person 97.6
Clothing 97.1
Apparel 97.1
Indoors 91.4
Living Room 91.4
Room 91.4
Interior Design 84.1
Bed 81.5
Person 74.6
Screen 72.8
Electronics 72.8
Monitor 70.1
Display 70.1
Shelf 63.2
Table Lamp 60.2
Lamp 60.2
Hat 60.2
Sitting 59.9
Meal 57.5
Food 57.5
Dish 57.5
People 56.6

Clarifai
created on 2019-11-16

people 99.7
child 99.3
family 99
room 98.7
furniture 97.7
group 97.2
adult 95.5
man 94.7
seat 94.2
woman 93.6
boy 93.5
indoors 92.9
two 92.8
sit 92.6
music 92.2
portrait 90.9
sofa 90.4
three 90.3
chair 89.5
musician 87.9

Imagga
created on 2019-11-16

home 43.1
room 36.8
couch 35.8
man 30.2
adult 29.1
indoors 29
happy 28.2
father 27.1
people 26.2
couple 26.1
dad 25.4
smiling 25.3
family 24.9
male 23.6
sitting 23.2
bedroom 22.4
happiness 21.9
parent 21.4
casual 21.2
indoor 21
armchair 21
sofa 21
house 20.9
interior 20.3
cheerful 20.3
child 20.3
person 18.9
love 18.1
lifestyle 18.1
together 17.5
chair 17.5
mother 17.2
fun 16.5
loving 16.2
living 16.1
smile 15
relaxing 14.6
jeans 14.3
comfortable 14.3
bed 14.2
kin 13.7
brother 13.2
20s 12.8
living room 12.7
women 12.7
attractive 12.6
adults 12.3
boy 12.2
playing 11.9
pillow 11.9
domestic 11.8
portrait 11.6
kid 11.5
husband 11.4
females 11.4
joy 10.9
daughter 10.5
togetherness 10.4
two 10.2
joyful 10.1
face 9.9
comfort 9.6
son 9.6
apartment 9.6
resting 9.5
life 9.5
laughing 9.5
relationship 9.4
clothing 9.3
children 9.1
holding 9.1
cup 9
cushion 9
cushions 8.9
looking 8.8
patient 8.8
bonding 8.8
full length 8.7
furniture 8.7
grandfather 8.6
break 8.6
men 8.6
sit 8.5
pretty 8.4
color 8.3
leisure 8.3
inside 8.3
one 8.2
cute 7.9
seat 7.9
chairs 7.8
rest 7.7
expression 7.7
health 7.6
wife 7.6
kids 7.5
enjoyment 7.5
beverage 7.2
childhood 7.2
bright 7.1
covered couch 7.1
handsome 7.1

Google
created on 2019-11-16

Photograph 97.2
Snapshot 89.9
Black-and-white 87.9
Room 87.3
Monochrome 79.4
Photography 79.1
Sitting 78
Stock photography 68.5
Family 63.2
Monochrome photography 57.8
Child 52
Style 51

Microsoft
created on 2019-11-16

wall 99.9
indoor 99.2
clothing 96.2
person 94.5
human face 91.6
toddler 88.4
baby 85.8
family 58.7
black and white 54.9
boy 53.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 54.2%
Fear 50.3%
Angry 45.1%
Sad 46%
Happy 45.1%
Calm 47.9%
Confused 45.2%
Surprised 45.1%
Disgusted 45.3%

AWS Rekognition

Age 2-8
Gender Female, 50.6%
Happy 45.1%
Sad 46.5%
Disgusted 45.3%
Calm 51.8%
Angry 45.2%
Surprised 45.5%
Fear 45.4%
Confused 45.3%

AWS Rekognition

Age 0-3
Gender Male, 53%
Disgusted 45.1%
Fear 45.1%
Surprised 45.6%
Angry 45.3%
Calm 53.5%
Happy 45.2%
Confused 45.1%
Sad 45.1%

AWS Rekognition

Age 2-8
Gender Female, 52.7%
Fear 47.2%
Surprised 45.5%
Confused 45.1%
Sad 46%
Disgusted 45%
Happy 45.8%
Calm 50.2%
Angry 45.1%

AWS Rekognition

Age 3-11
Gender Female, 53.9%
Calm 45%
Fear 48.2%
Happy 45.1%
Angry 45%
Surprised 45.1%
Disgusted 45%
Sad 51.5%
Confused 45%

AWS Rekognition

Age 39-57
Gender Female, 54.4%
Calm 45.1%
Fear 46.5%
Confused 45.1%
Surprised 45%
Angry 46.4%
Happy 45.1%
Sad 51.7%
Disgusted 45.1%

AWS Rekognition

Age 28-44
Gender Female, 54.7%
Disgusted 45.1%
Confused 45.1%
Sad 47.1%
Calm 45.1%
Angry 45.1%
Fear 45.7%
Surprised 45%
Happy 51.8%

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Couch 99.5%
Person 99.4%

Captions

Microsoft

a group of people sitting on a bed 74.1%
a person sitting on a bed 74%
a group of people sitting in a bedroom 73.9%