Human Generated Data

Title

Untitled (man with baby standing between his legs)

Date

1962

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16499

Human Generated Data

Title

Untitled (man with baby standing between his legs)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Apparel 99.7
Clothing 99.7
Person 98.1
Human 98.1
Footwear 96.1
Shoe 96.1
Chair 93.5
Furniture 93.5
Shorts 92.1
Face 83.1
Sleeve 73.5
Female 69.9
Photography 69
Portrait 69
Photo 69
Baby 64.8
Home Decor 64.6
People 63.8
Dress 61.9
Girl 61.3
Floor 60.5
Door 60.5
Kid 55.3
Child 55.3
Shoe 51.2

Imagga
created on 2022-02-11

people 27.9
adult 25.3
man 24.2
person 22.1
male 19.3
brass 17
professional 16.2
portrait 16.2
wedding 15.6
hospital 15.3
clothing 15.1
face 14.9
bride 14.6
home 14.3
medical 14.1
attractive 14
health 13.9
groom 13.8
lifestyle 13.7
worker 13.7
dress 13.5
work 13.3
happiness 13.3
indoors 13.2
men 12.9
smile 12.8
wind instrument 12.8
room 12.7
happy 12.5
care 12.3
fashion 11.3
doctor 11.3
one 11.2
pretty 11.2
women 11.1
love 11
casual 11
smiling 10.8
holding 10.7
working 10.6
device 10.5
looking 10.4
equipment 10.2
child 10.1
musical instrument 9.9
medicine 9.7
sexy 9.6
couple 9.6
profession 9.6
occupation 9.2
black 9.1
human 9
job 8.8
window 8.8
vertical 8.7
hair 8.7
standing 8.7
hands 8.7
nurse 8.7
clinic 8.6
cute 8.6
clothes 8.4
mask 8.3
life 8.1
celebration 8
hat 7.8
veil 7.8
surgery 7.8
ventilator 7.7
research 7.6
shower cap 7.6
single 7.4
cheerful 7.3
covering 7.2
childhood 7.2
surgeon 7.1
lovely 7.1
science 7.1

Google
created on 2022-02-11

Sleeve 87.2
Gesture 85.3
Headgear 81.2
Snapshot 74.3
Hat 73.8
Monochrome photography 71.7
Room 71.5
Monochrome 70.9
Vintage clothing 66.6
Stock photography 64
Pattern 60.5
Knee 60.4
History 56.5
Visual arts 56.4
Arch 55.8
Sitting 54.8
Hoodie 50.9
Toddler 50.7
T-shirt 50.6
Photo caption 50.3

Microsoft
created on 2022-02-11

text 95.7
clothing 94.3
human face 93.4
person 93
toddler 89.2
baby 82.3
posing 50.3

Face analysis

Amazon

AWS Rekognition

Age 16-22
Gender Male, 99.3%
Happy 96.3%
Surprised 1.1%
Angry 0.7%
Sad 0.7%
Disgusted 0.4%
Fear 0.4%
Confused 0.3%
Calm 0.2%

Feature analysis

Amazon

Person 98.1%
Shoe 96.1%

Captions

Microsoft

a man standing in front of a window 72.1%
a man standing next to a window 69.9%
a man and a woman standing in front of a window 51%

Text analysis

Amazon

2
6
MJ17--YT37°--

Google

37A°2-
-AGO
MJ17--YT 37A°2- -AGO
MJ17--YT