Human Generated Data

Title

Untitled (family portrait on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16899

Human Generated Data

Title

Untitled (family portrait on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Chair 99.9
Furniture 99.9
Person 99
Human 99
Person 98.8
Face 98.7
Person 98.3
Interior Design 96.4
Indoors 96.4
Clothing 96.3
Apparel 96.3
Person 95.5
Couch 95.4
Person 94
Baby 92
Shorts 90.4
Person 89.6
Accessories 89.1
Accessory 89.1
Glasses 89.1
Room 85.8
Kid 84.3
Child 84.3
Boy 83.8
Food 80.1
Meal 80.1
Portrait 78.8
Photography 78.8
Photo 78.8
Living Room 76.3
Female 75.6
Dress 74.9
Costume 73.5
Sitting 72.5
People 72.4
Dish 69.5
Table 68.6
Icing 65.1
Dessert 65.1
Cake 65.1
Cream 65.1
Creme 65.1
Suit 63.8
Overcoat 63.8
Coat 63.8
Man 63.8
Door 61.2
Floor 59.7
Curtain 58.3
Girl 58.1
Dining Table 57.1
Woman 55.1

Imagga
created on 2022-02-26

adult 27.5
people 25.1
person 24.6
brass 24
teacher 21.7
sexy 20.9
man 20.8
wind instrument 20
male 19.9
portrait 19.4
attractive 18.2
women 16.6
men 16.3
musical instrument 16.2
pretty 16.1
fashion 15.8
kin 15.7
lady 15.4
couple 14.8
happy 14.4
human 14.2
black 13.8
smiling 13.7
educator 13.1
lifestyle 13
body 12.8
love 12.6
model 12.4
clothing 12.3
group 12.1
fun 12
hair 11.9
style 11.9
sensual 11.8
professional 11.7
cap 11
dress 10.8
cornet 10.8
bathing cap 10.5
happiness 10.2
casual 10.2
girls 10
gorgeous 10
life 10
face 9.9
studio 9.9
friendship 9.4
elegance 9.2
makeup 9.1
indoors 8.8
together 8.8
look 8.7
married 8.6
cute 8.6
blond 8.6
lips 8.3
headdress 8.3
leisure 8.3
holding 8.2
child 8.2
make 8.2
sibling 8.2
music 8
world 7.9
brunette 7.8
sitting 7.7
bride 7.7
skin 7.6
erotic 7.6
club 7.5
passion 7.5
senior 7.5
cheerful 7.3
sensuality 7.3
stylish 7.2
smile 7.1
posing 7.1
cool 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 98.8
person 90.8
clothing 86.3
human face 77.5
posing 72.9
old 51.1

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 96.9%
Happy 94.4%
Calm 4%
Surprised 0.4%
Angry 0.3%
Sad 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 81.2%
Happy 88.6%
Sad 7.5%
Calm 1.5%
Angry 0.8%
Disgusted 0.5%
Fear 0.4%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Male, 93.3%
Happy 46%
Surprised 44.2%
Angry 3.5%
Disgusted 1.9%
Sad 1.4%
Fear 1.3%
Confused 0.9%
Calm 0.9%

AWS Rekognition

Age 1-7
Gender Female, 81%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Male, 64.6%
Happy 90.9%
Surprised 2.9%
Confused 2.3%
Sad 1.2%
Disgusted 0.9%
Calm 0.7%
Fear 0.6%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people posing for a photo 96.9%
a group of people posing for the camera 96.8%
a group of people posing for a picture 96.7%

Text analysis

Amazon

3
21
YТ37A°-O

Google

3 YT37A°2-XA
3
YT37A°2-XA