Human Generated Data

Title

Untitled (parents, boy, and baby)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17320

Human Generated Data

Title

Untitled (parents, boy, and baby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17320

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Person 99.3
Person 98.1
Person 97.7
Clothing 97.5
Apparel 97.5
People 93.2
Person 88.9
Female 75.1
Pants 70.8
Face 70
Suit 69.3
Coat 69.3
Overcoat 69.3
Family 65.8
Photography 61
Photo 61
Girl 60.4
Crowd 59.8
Kid 58.9
Child 58.9
Outdoors 58.3
Furniture 56.9

Clarifai
created on 2023-10-29

people 99.9
group 99.4
man 98.3
group together 97.7
child 95.6
adult 94.9
leader 94.3
family 91.3
woman 91.3
administration 90.9
several 89.4
four 86.7
three 86.1
wear 85.4
five 83.6
many 82.6
elderly 79.5
portrait 78.2
son 76.1
music 75.3

Imagga
created on 2022-02-26

senior 42.2
couple 35.7
elderly 35.4
happy 35.1
male 34.1
man 33.6
kin 32.3
people 31.2
together 28.9
mature 28.8
person 25.3
smiling 23.1
love 22.9
adult 22.4
child 21.6
old 21.6
retirement 21.1
grandma 20.6
family 20.4
portrait 20
husband 20
outdoors 19.6
retired 19.4
married 19.2
wife 18.9
lifestyle 18.8
smile 18.5
older 17.5
women 17.4
happiness 17.2
grandfather 17
park 16.5
fun 16.5
affection 16.4
enjoying 16.1
active 15.3
casual 15.2
home 15.1
camera 14.8
mother 14.2
joy 14.2
sibling 13.9
vacation 13.9
grandmother 13.7
cap 13.4
70s 12.8
summer 12.2
men 12
health 11.8
60s 11.7
leisure 11.6
looking 11.2
sitting 11.2
day 11
holiday 10.7
medical 10.6
attractive 10.5
laughing 10.4
friends 10.3
clothing 10.3
friendship 10.3
aged 9.9
outdoor 9.9
romance 9.8
cheerful 9.7
half length 9.7
hair 9.5
marriage 9.5
relationship 9.4
two 9.3
girls 9.1
human 9
lady 8.9
gray hair 8.9
indoors 8.8
affectionate 8.7
aging 8.6
loving 8.6
age 8.6
blond 8.5
world 8.4
headdress 8.3
gray 8.1
romantic 8
nurse 7.9
seniors 7.9
boy 7.8
daughter 7.8
beach 7.6
adults 7.6
healthy 7.6
professional 7.5
school 7.5
care 7.4
emotion 7.4
teacher 7.3
shower cap 7.3
group 7.3
father 7.2
face 7.1
look 7

Google
created on 2022-02-26

Black 89.8
Gesture 85.3
Black-and-white 84.4
Style 83.9
People 78
Art 73.5
Monochrome photography 72.1
Monochrome 71.4
Event 70.7
Font 67.2
Vintage clothing 67.2
Fun 65.8
Stock photography 64.9
Visual arts 64.9
Room 62.6
History 59
Sitting 58.6
Child 55
Photographic paper 52.4
Photography 52.2

Microsoft
created on 2022-02-26

text 98.7
person 93.8
clothing 85.6
black and white 69
man 59.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 87.9%
Surprised 8.9%
Sad 0.8%
Angry 0.7%
Disgusted 0.6%
Happy 0.4%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 41-49
Gender Female, 67.7%
Happy 68.1%
Calm 13.7%
Sad 9.4%
Surprised 3.3%
Angry 2.2%
Disgusted 2%
Confused 0.7%
Fear 0.6%

AWS Rekognition

Age 7-17
Gender Male, 92.9%
Calm 86.3%
Surprised 9.5%
Sad 2.8%
Angry 0.4%
Happy 0.3%
Fear 0.3%
Disgusted 0.3%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.3%
Person 98.1%
Person 97.7%
Person 88.9%

Captions

Microsoft
created on 2022-02-26

an old photo of a man 74.9%
a group of people posing for a photo 69.8%
a group of people around each other 64.9%

Text analysis

Amazon

4
NAGOY
19742