Human Generated Data

Title

Untitled (little boy and girl playing on couch)
Date

1953, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.152

Human Generated Data

Title

Untitled (little boy and girl playing on couch)

People

Artist: Lucian and Mary Brown, American

Date

1953, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.152

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 100
Living Room 98.1
Indoors 98.1
Room 98.1
Person 98.1
Human 98.1
Person 97.9
Baby 89.5
Couch 89
Person 75
People 73.1
Bed 72.4
Face 68.5
Interior Design 64.4
Kid 64
Child 64
Clothing 60.3
Apparel 60.3
Portrait 59.1
Photography 59.1
Photo 59.1
Newborn 57.7

Clarifai
created on 2023-10-26

people 99.5
portrait 98.7
two 98.6
family 98.5
couple 98.3
room 98.3
girl 97.4
collage 97.2
monochrome 97.1
woman 96.5
sofa 95.7
furniture 93.8
adult 93.5
indoors 93.5
child 92.8
man 92.2
smile 92
three 90.2
beautiful 89.2
sepia 88.9

Imagga
created on 2022-01-23

home 43.9
room 43.7
television 38.3
man 28.9
sofa 27.9
groom 27.9
smiling 27.5
happiness 27.4
couch 27
couple 27
lifestyle 26.7
adult 26.7
sitting 26.6
interior 26.5
indoors 26.3
happy 25.7
people 25.6
house 25.1
telecommunication system 24.9
living 23.7
person 22.4
indoor 21.9
comfortable 21
smile 20.7
together 20.1
cheerful 19.5
bed 19.5
family 18.7
casual 17.8
full length 17.4
male 17.1
relaxation 16.7
love 16.6
comfort 16.4
apartment 16.3
portrait 16.2
women 15.8
leisure 15.8
bedroom 15.8
fun 15.7
domestic 15.7
furniture 15
pillow 14.7
lying 14.1
laptop 13.7
relaxing 13.6
relax 13.5
attractive 13.3
enjoyment 13.1
floor 13
inside 12.9
looking 12.8
living room 12.7
resting 12.4
adults 12.3
window 12.1
luxury 12
mother 11.9
child 11.8
new 11.3
kin 11.3
computer 11.2
rest 11.1
20s 11
holding 10.7
color 10.6
loving 10.5
table 10.5
modern 9.8
pretty 9.8
life 9.8
chair 9.6
estate 9.5
parent 9.5
togetherness 9.4
relationship 9.4
two 9.3
communication 9.2
father 9.2
one 9
light 8.7
boyfriend 8.7
girlfriend 8.7
holiday 8.6
business 8.5
girls 8.2
buddy 8.2
cup 8.1
group 8.1
dad 8
romance 8
romantic 8
decor 8
leisure activity 7.8
brown hair 7.8
two people 7.8
laying 7.8
hug 7.7
men 7.7
youth 7.7
jeans 7.6
hotel 7.6
real 7.6
enjoy 7.5
relaxed 7.5
technology 7.4
coffee 7.4
decoration 7.2
childhood 7.2
face 7.1
kid 7.1
daughter 7

Google
created on 2022-01-23

Hairstyle 95.1
Facial expression 93.2
Vertebrate 92.4
Picture frame 89.7
Comfort 89.5
Rectangle 87.3
Mammal 86.2
Style 83.8
Black-and-white 82.6
Tints and shades 76.6
Monochrome 73.8
Monochrome photography 73.1
Vintage clothing 70.7
Room 69.6
Sitting 69.2
Stock photography 64.4
Happy 61.5
Linens 61.1
Photographic paper 61.1
Child 58.7

Microsoft
created on 2022-01-23

wall 99
indoor 93.6
couch 90.5
text 89.6
black and white 89.3
furniture 87.7
person 82.9
human face 76.2
clothing 72.9
house 65.9
bed 60.4
pillow 50.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 99.8%
Calm 83.4%
Sad 9.1%
Happy 3.6%
Surprised 1.3%
Disgusted 0.8%
Confused 0.8%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 1-7
Gender Male, 59.8%
Calm 84%
Surprised 5.3%
Sad 2.6%
Confused 2%
Angry 1.7%
Happy 1.6%
Disgusted 1.5%
Fear 1.4%

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Couch 89%

Captions

Microsoft
created on 2022-01-23

a person sitting on a bed 73.3%
a man and a woman sitting on a bed 53.2%
a person sitting on a bed 53.1%