Human Generated Data

Title

Untitled (man holding baby)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17118

Human Generated Data

Title

Untitled (man holding baby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 97.7
Apparel 97.7
Human 97.2
Person 95.4
Person 95.4
Couch 87.7
Furniture 87.7
Baby 84.5
Coat 82.5
Overcoat 82.5
Suit 82.5
Face 79.1
Sitting 77.4
Finger 73.3
Indoors 64.3
Newborn 62
Sleeve 61.8
Long Sleeve 57.1
Photography 56.9
Photo 56.9
Head 55.7
Chair 55.3
Female 55.3
Person 46.8

Imagga
created on 2022-02-26

groom 100
bride 44.3
person 35.9
wedding 35.9
couple 34.8
love 31.5
people 27.9
bouquet 27.8
happiness 27.4
dress 27.1
happy 25.1
married 24.9
man 24.2
adult 22.4
male 22
flowers 21.7
marriage 20.9
gown 18.1
two 17.8
celebration 17.5
senior 16.9
portrait 16.2
veil 15.7
smile 15
bridal 14.6
holiday 14.3
romance 14.3
ceremony 13.6
human 13.5
day 13.3
flower 13.1
cheerful 13
looking 12.8
wed 12.8
women 12.6
romantic 12.5
family 12.5
elderly 12.4
husband 12.4
wife 12.3
smiling 12.3
new 12.1
old 11.8
suit 11.7
together 11.4
men 11.2
life 11.2
hair 11.1
event 11.1
engagement 10.6
fashion 10.5
outdoors 10.4
joy 10
face 9.9
holding 9.9
lady 9.7
older 9.7
party 9.5
rose 9.4
mature 9.3
attractive 9.1
summer 9
newly 8.9
kiss 8.8
females 8.5
pair 8.5
elegance 8.4
pretty 8.4
handsome 8
businessman 7.9
look 7.9
commitment 7.9
hands 7.8
youth 7.7
outdoor 7.6
hand 7.6
traditional 7.5
future 7.4
care 7.4
aged 7.2
clothing 7.1

Google
created on 2022-02-26

Black 89.6
Gesture 85.3
Black-and-white 84.1
Style 83.9
Art 73.5
Monochrome photography 73.2
Comfort 73.1
Monochrome 72
Event 71.7
Sitting 68.1
Fun 64.9
Stock photography 64.7
Room 62.9
Vintage clothing 61.9
T-shirt 61.1
Conversation 60.5
Picture frame 55.1
Still life photography 53.4
Visual arts 51.4

Microsoft
created on 2022-02-26

wall 98
person 96.4
text 92

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 81.2%
Calm 86.7%
Happy 10.3%
Sad 1.6%
Disgusted 0.4%
Confused 0.4%
Fear 0.3%
Surprised 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.4%

Captions

Microsoft

a group of people sitting in chairs 64.9%
a group of people sitting in a chair 59.5%
a man sitting on a table 43.9%

Text analysis

Amazon

RODAAA