Human Generated Data

Title

Untitled (woman holding baby, looking into mirror)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16388

Human Generated Data

Title

Untitled (woman holding baby, looking into mirror)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99
Human 99
Apparel 98.2
Clothing 98.2
Person 97.9
Person 96.7
Face 94
Baby 79.3
Floor 77.7
Female 74.6
Home Decor 73.3
Meal 71.9
Food 71.9
People 71.8
Child 71.6
Kid 71.6
Portrait 66.1
Photography 66.1
Photo 66.1
Head 65.8
Girl 65.1
Door 64.4
Dish 61.9
Costume 59.4
Hat 59.1
Creme 58.9
Icing 58.9
Dessert 58.9
Cake 58.9
Cream 58.9
Indoors 58.5
Dress 56.8
Screen 55.5
Electronics 55.5

Imagga
created on 2022-02-11

salon 56.3
shower cap 54.4
cap 42.9
headdress 32.6
senior 30.9
man 30.9
person 28.8
clothing 27.5
people 27.3
adult 26.6
happy 26.3
mature 26
portrait 25.2
elderly 23.9
male 23.4
grandma 21.9
indoors 21.1
couple 20.9
home 20.7
room 20.4
smiling 19.5
old 18.8
looking 18.4
retirement 18.2
lifestyle 16.6
smile 16.4
hair 15.8
women 15.8
face 15.6
retired 15.5
health 15.3
medical 15
love 14.2
sitting 13.7
casual 13.5
happiness 13.3
attractive 13.3
hospital 13.2
human 12.7
modern 12.6
interior 12.4
nurse 12.4
doctor 12.2
consumer goods 12.2
patient 12.1
professional 12
covering 11.9
house 11.7
holding 11.5
wife 11.4
pretty 11.2
men 11.2
camera 11.1
alone 11
gray 10.8
grandmother 10.8
care 10.7
family 10.7
hand 10.6
color 10.6
cheerful 10.6
lady 10.5
indoor 10
hairdresser 9.9
one 9.7
together 9.6
work 9.4
older 8.7
life 8.6
husband 8.6
uniform 8.5
expression 8.5
togetherness 8.5
horizontal 8.4
clinic 8.3
blond 8.3
occupation 8.2
window 8.2
office 8.1
worker 8.1
medicine 7.9
business 7.9
look 7.9
furniture 7.8
eyes 7.7
affection 7.7
aged 7.2
computer 7.2
romance 7.1
handsome 7.1
romantic 7.1
working 7.1
day 7.1

Google
created on 2022-02-11

Mirror 88.5
Black-and-white 85.3
Gesture 85.3
Style 84
Art 79.6
Smile 79.5
Window 79.4
Monochrome 77.5
Monochrome photography 76.9
Room 70.3
Event 68.5
Visual arts 67.6
Stock photography 63.1
Glass 61.1
Fun 59.3
Child 58.3
Toddler 57.8
Illustration 56.7
Shadow 56
Still life photography 53.9

Microsoft
created on 2022-02-11

wall 96.9
text 96
human face 95.2
clothing 93.5
person 91.3
toddler 86.7
baby 83.1
black and white 80.7
smile 63.7

Face analysis

Amazon

Google

AWS Rekognition

Age 4-12
Gender Male, 82.7%
Calm 68.9%
Surprised 27.3%
Fear 1.2%
Happy 0.8%
Sad 0.7%
Angry 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 49-57
Gender Female, 78.3%
Happy 95.3%
Surprised 4%
Sad 0.2%
Fear 0.2%
Calm 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

an old photo of a person 51.1%

Text analysis

Amazon

18

Google

4
4