Human Generated Data

Title

Untitled (boy sitting on stairs)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17377

Human Generated Data

Title

Untitled (boy sitting on stairs)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.3
Person 99.3
Face 96
Clothing 93.7
Apparel 93.7
Boy 93.1
Water 86.5
Smile 80.9
Outdoors 76.3
Kid 74.9
Child 74.9
Photo 71.4
Portrait 71.4
Photography 71.4
Shorts 64
People 62.6
Finger 59.5
Mouth 56.4
Lip 56.4
Teeth 56.4

Imagga
created on 2022-02-26

person 28.4
smiling 28.2
adult 25.3
portrait 24.6
happy 23.2
face 22
people 19.5
smile 18.5
care 18.1
child 18.1
human 18
male 16.5
holding 16.5
lady 16.2
skin 16.2
man 16.1
clean 15.9
pretty 15.4
bath 15.2
home 15.2
computer 14.5
laptop 14
hair 13.5
women 13.4
health 13.2
sitting 12.9
bathroom 12.8
looking 12.8
body 12.8
one 12.7
technology 12.6
lifestyle 12.3
senior 12.2
blond 12.1
mature 12.1
eyes 12.1
black 12
relaxation 11.7
cute 11.5
bathtub 11.4
attractive 11.2
vessel 11.2
happiness 11
cheerful 10.6
indoors 10.5
elderly 10.5
old 10.4
work 9.4
water 9.3
leisure 9.1
device 9.1
tub 9
spa 9
wet 8.9
working 8.8
film 8.8
room 8.8
look 8.8
brunette 8.7
love 8.7
model 8.6
negative 8.6
fresh 8.5
relax 8.4
spatula 8.4
fashion 8.3
treatment 8.3
indoor 8.2
girls 8.2
healthy 8.2
sexy 8
office 8
little 7.9
boy 7.8
retirement 7.7
hygiene 7.6
head 7.6
shower 7.3
business 7.3

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.3
person 98.6
human face 97
toddler 95.1
black and white 91.2
clothing 90.1
boy 86.7
baby 78.5
smile 76.4
child 76.3
monochrome 51.3
posing 42.8

Face analysis

Amazon

Google

AWS Rekognition

Age 6-12
Gender Female, 54.1%
Happy 99%
Surprised 0.5%
Calm 0.2%
Sad 0.1%
Confused 0.1%
Fear 0%
Angry 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a person posing for the camera 93.5%
a person standing posing for the camera 87.6%
a boy posing for a photo 57.9%

Text analysis

Amazon

2
20
MJI7--YT37°--

Google

37A°2--AGON
MJI7--YT
20
MJI7--YT 37A°2--AGON 20