Human Generated Data

Title

Untitled (boy wearing fur hat)

Date

1951

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17829

Human Generated Data

Title

Untitled (boy wearing fur hat)

People

Artist: Lucian and Mary Brown, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.3
Clothing 99.3
Person 98.4
Human 98.4
Sleeve 95.4
Face 79.5
Coat 69.6
Long Sleeve 69.2
Female 65.9
Finger 63.6
Photography 60.2
Photo 60.2
Portrait 60.2
Home Decor 58.4
Food 58.1
Dessert 58.1
Creme 58.1
Cake 58.1
Icing 58.1
Cream 58.1
Veil 56.5
Door 55.9

Imagga
created on 2022-02-26

blond 48.4
portrait 40.1
person 38.4
bow tie 32.7
face 31.3
hair 30.1
people 27.9
child 27.6
smile 26.4
pretty 25.9
necktie 25.3
happy 25.1
looking 23.2
cute 22.3
clothing 21.8
one 20.9
adult 20.1
smiling 19.5
lifestyle 18.8
lady 18.7
attractive 17.5
girls 16.4
garment 16
human 15.8
senior 15
eyes 14.6
fashion 14.3
happiness 14.1
mature 14
youth 13.6
hat 13.4
old 13.2
model 13.2
boy 13.1
bonnet 13
world 12.8
teenager 12.8
women 12.7
outdoors 11.9
casual 11.9
children 11.9
male 11.8
grandma 11.7
childhood 11.7
little 11.5
cheerful 11.4
elderly 10.5
look 10.5
expression 10.2
lips 10.2
skin 10.2
teen 10.1
natural 10
outdoor 9.9
park 9.9
kid 9.8
age 9.5
love 9.5
black 9.2
joy 9.2
family 8.9
posing 8.9
sexy 8.8
body 8.8
home 8.8
man 8.7
years 8.7
day 8.6
worker 8.6
headdress 8.5
innocent 8.5
head 8.4
mother 8.4
camera 8.3
friendly 8.2
businesswoman 8.2
life 8.2
aged 8.1
color 7.8
retired 7.8
retirement 7.7
health 7.6
two 7.6
thinking 7.6
hand 7.6
relaxation 7.5
care 7.4
alone 7.3
gorgeous 7.3
pose 7.2
sweater 7.2
lovely 7.1
summer 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

human face 99.4
person 98.5
clothing 95.7
smile 92.2
portrait 86
text 80.9
fashion accessory 67.1
woman 65.5

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 99.8%
Surprised 60%
Fear 17.2%
Happy 16.3%
Calm 3%
Sad 1.4%
Angry 0.9%
Disgusted 0.7%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a person standing in front of a window 88.4%
a person standing in front of a window 88.3%
a man and a woman standing in front of a window 72%