Human Generated Data

Title

Untitled (little girl eating birthday cake)
Date

1958
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16465

Human Generated Data

Title

Untitled (little girl eating birthday cake)

People

Artist: Lucian and Mary Brown, American

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Apparel 99.1
Clothing 99.1
Dress 99.1
Human 98.4
Person 98.4
Person 98.3
Woman 94.8
Teen 94.8
Girl 94.8
Kid 94.8
Blonde 94.8
Female 94.8
Child 94.8
Play 89.1
Face 86.9
Person 84.3
Chair 71.6
Furniture 71.6
People 69.6
Photography 69
Portrait 69
Photo 69
Room 59.2
Indoors 59.2
Baby 58
Pants 57.6
Hair 57.4
Person 52.5

Imagga
created on 2022-02-11

salon 73.2
people 32.4
home 28.7
person 26.7
adult 24
indoors 23.7
chair 23.7
man 22.9
shop 22.5
work 22
patient 21.9
male 21.3
hospital 20.5
barber chair 20
medical 19.4
smiling 18.1
working 17.7
professional 17
doctor 16.9
health 16.7
office 16.2
kitchen 16.1
job 15.9
interior 15.9
lifestyle 15.9
seat 15.7
clinic 15.5
room 15.1
women 15
medicine 15
house 14.2
mercantile establishment 14.2
computer 13.6
hairdresser 13.3
happy 13.2
dishwasher 13
cheerful 13
portrait 12.9
shoe shop 12.9
care 12.3
sitting 12
technology 11.9
indoor 11.9
appliance 11.7
worker 11.7
smile 11.4
business 10.9
holding 10.7
casual 10.2
barbershop 10.1
nurse 10.1
home appliance 10
modern 9.8
surgery 9.8
men 9.4
place of business 9.4
furniture 9.3
two 9.3
treatment 9.2
occupation 9.2
blond 9.1
one 9
white goods 8.9
looking 8.8
clothing 8.7
assistant 8.7
vertical 8.7
child 8.7
exam 8.6
profession 8.6
uniform 8.6
face 8.5
senior 8.4
attractive 8.4
laptop 8.2
team 8.1
sterile 7.9
dentist 7.9
housework 7.9
day 7.8
dental 7.8
table 7.8
equipment 7.7
mask 7.7
illness 7.6
desk 7.6
human 7.5
leisure 7.5
instrument 7.4
mature 7.4
domestic 7.4
inside 7.4
20s 7.3
device 7.1

Google
created on 2022-02-11

Black-and-white 85.3
Style 84.1
Art 76.3
Monochrome photography 76.1
Monochrome 75.2
Toddler 71.7
Vintage clothing 71.3
Room 69.3
Musical instrument 67.5
Visual arts 64.8
Sitting 64.4
Cooking 63.7
Stock photography 63.3
Pattern 60.2
Illustration 59.3
Picture frame 58.6
Still life photography 57.5
Office equipment 57.2
Photographic paper 54.4
Retro style 52.3

Microsoft
created on 2022-02-11

person 98.7
sink 96.1
text 95.8
bathroom 94.2
indoor 85.9
mirror 84.7
bathtub 70
toddler 68.4
clothing 67.7
plumbing fixture 55
baby 53

Face analysis

Amazon

Google

AWS Rekognition

Age 0-6
Gender Female, 98.2%
Calm 96.2%
Surprised 1.3%
Sad 1%
Fear 0.6%
Disgusted 0.3%
Angry 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 14-22
Gender Female, 51.9%
Calm 50.1%
Sad 22.3%
Surprised 9.8%
Fear 5.1%
Angry 3.9%
Happy 3.3%
Confused 3%
Disgusted 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a little girl sitting in front of a window 52.2%
a girl sitting in front of a window 52.1%
a boy and a girl sitting in front of a window 30.7%

Text analysis

Amazon

27
KODAK-ITW

Google

-YT3RA°2-
MJI7-
->AGON
MJI7- -YT3RA°2- ->AGON