Human Generated Data

Title

Untitled (boy with black eye)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16550

Human Generated Data

Title

Untitled (boy with black eye)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Human 97.1
Person 97.1
Head 93.8
Art 87.8
Sculpture 84.1
Face 77.9
Statue 62.6
Worship 58.7
Buddha 58.6
Furniture 58
Portrait 57.9
Photography 57.9
Photo 57.9
Figurine 55.2

Imagga
created on 2022-02-12

portrait 40.1
negative 33.9
adult 33.7
person 31.8
people 26.8
film 26.7
face 25.6
attractive 21.7
photographic paper 20.7
man 19.5
lady 19.5
fashion 18.1
clothing 17.9
expression 17.1
happy 16.9
wig 16.8
pretty 16.8
looking 16
senior 15.9
hair 15.9
blond 15.4
bride 15.3
health 15.3
doctor 15
smile 15
medical 14.1
photographic equipment 13.8
attire 13.5
one 13.4
mask 13
eyes 12.9
sexy 12.9
hairpiece 12.7
medicine 12.3
male 12.1
wedding 12
elegance 11.8
cap 11.6
smiling 11.6
cute 11.5
hairstyle 11.4
elegant 11.1
skin 11
nurse 11
hospital 10.6
women 10.3
mature 10.2
model 10.1
shower cap 10.1
gown 9.9
covering 9.9
veil 9.8
old 9.8
human 9.7
black 9.7
grandma 9.6
clinic 9.6
elderly 9.6
love 9.5
professional 9.4
happiness 9.4
mystic 9.2
holding 9.1
care 9.1
posing 8.9
look 8.8
winter 8.5
business 8.5
joy 8.4
sensual 8.2
romantic 8
surgery 7.8
art 7.8
humor 7.7
headdress 7.7
married 7.7
uniform 7.6
studio 7.6
hand 7.6
head 7.6
life 7.5
closeup 7.4
surgeon 7.4
cheerful 7.3
stylish 7.2
office 7.2
gray 7.2
team 7.2
world 7.1

Microsoft
created on 2022-02-12

human face 98.9
wall 98.8
text 98.2
man 95.6
person 94.7
clothing 82.3
portrait 78.1
smile 71.8

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 86.3%
Calm 21%
Surprised 20.3%
Happy 19.1%
Sad 10.7%
Fear 9.6%
Angry 8.5%
Confused 6.1%
Disgusted 4.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a man sitting on a table 81.8%
a man sitting at a table 81.7%
a man looking at the camera 81.6%

Text analysis

Amazon

20
COVELIA