Human Generated Data

Title

Untitled (boy with puppies)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17594

Human Generated Data

Title

Untitled (boy with puppies)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.8
Face 99.8
Person 98.5
Person 87.8
Portrait 75.9
Photography 75.9
Photo 75.9
Smile 75.5
Boy 71.2
Head 68.2
Man 66.5

Imagga
created on 2022-02-26

child 47.1
person 40.9
man 35
portrait 33.7
male 33.3
adult 31.7
juvenile 29.3
outdoors 28.4
people 26.8
happy 23.2
handsome 23.2
outdoor 21.4
face 21.3
smile 20.7
smiling 19.5
lifestyle 18.8
outside 17.1
day 16.5
black 15.9
love 15.8
looking 15.2
one 14.9
businessman 14.1
happiness 14.1
park 14
standing 13.9
couple 13.1
men 12.9
cheerful 12.2
attractive 11.9
hair 11.9
casual 11.9
guy 11.4
suit 10.9
family 10.7
boy 10.4
business 10.3
20s 10.1
cute 10
summer 9.6
look 9.6
forest 9.6
expression 9.4
senior 9.4
youth 9.4
model 9.3
children 9.1
pretty 9.1
human 9
kid 8.9
world 8.8
relationship 8.4
joy 8.4
fun 8.2
confident 8.2
healthy 8.2
closeup 8.1
office 8
eyes 7.7
affectionate 7.7
jacket 7.7
professional 7.6
laughing 7.6
mature 7.4
countryside 7.3
alone 7.3
body 7.2
childhood 7.2
romance 7.1
together 7

Microsoft
created on 2022-02-26

human face 99.2
person 97.6
text 96
man 95.3
clothing 93.8
smile 84.7
portrait 77

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 82.5%
Surprised 8.9%
Happy 4.3%
Disgusted 1.2%
Confused 1%
Angry 0.9%
Fear 0.7%
Sad 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a man smiling for the camera 94%
a man smiling for the picture 93.9%
a man smiling at the camera 92.3%

Text analysis

Amazon

SEX
YT37A8
VODHK

Google

SEr YT37A8 AA
SEr
YT37A8
AA