Human Generated Data

Title

Untitled (little girl and two boys standing outside)

Date

1962

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16513

Human Generated Data

Title

Untitled (little girl and two boys standing outside)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Apparel 100
Clothing 100
Human 99.7
Person 99.7
Person 99.6
Female 99.6
Person 99.3
Dress 98.5
Girl 97.1
Child 97.1
Blonde 97.1
Woman 97.1
Teen 97.1
Kid 97.1
Face 91
Pants 83.7
Outdoors 73.4
Portrait 69.7
Photography 69.7
Photo 69.7
People 69.3
Hand 65.5
Plant 65.2
Denim 64.3
Jeans 64.3
Skirt 64
Shoe 63.4
Footwear 63.4
Fence 58.3
Nature 57.9
Smile 56.8
Tree 55.7
Yard 55.3

Imagga
created on 2022-02-11

kin 57.1
people 26.8
smiling 26
happy 25.7
child 24.4
portrait 22
couple 21.8
male 21.5
grandma 20.8
adult 20.2
man 19.5
mother 18.9
happiness 18.8
sibling 18.4
parent 18.3
person 18.2
outdoors 17.9
smile 17.1
cheerful 17.1
family 16.9
together 16.6
lifestyle 16.6
love 16.6
attractive 16.1
pretty 15.4
fun 14.2
grandfather 14.1
senior 14
hair 13.5
lady 13
sexy 12.8
fashion 12.8
father 12.5
blond 12.5
old 11.8
dad 11.8
joy 11.7
leisure 11.6
kid 11.5
cute 11.5
standing 11.3
daughter 11
day 11
playing 10.9
model 10.9
dress 10.8
face 10.6
boy 10.4
body 10.4
sitting 10.3
outside 10.3
mature 10.2
casual 10.2
outdoor 9.9
childhood 9.8
summer 9.6
home 9.6
women 9.5
wife 9.5
brother 9.4
healthy 9.4
togetherness 9.4
holiday 9.3
park 9
vacation 9
human 9
posing 8.9
looking 8.8
men 8.6
husband 8.6
loving 8.6
enjoyment 8.4
little 7.9
sand 7.9
black 7.8
play 7.7
elderly 7.7
two 7.6
beach 7.6
enjoying 7.6
head 7.6
style 7.4

Google
created on 2022-02-11

Clothing 98.7
Outerwear 95.5
Shoe 94.5
Shorts 90.6
Standing 86.4
Gesture 85.3
Black-and-white 83.7
Grass 83.2
Adaptation 79.2
Tints and shades 76.6
Vintage clothing 76.6
Monochrome photography 76
Toddler 75.3
Snapshot 74.3
Monochrome 73.6
Pattern 69.8
Child 69.6
Baby 68.7
Room 66.9
Plant 66.3

Microsoft
created on 2022-02-11

clothing 96.8
outdoor 96
person 95.3
toddler 94.4
text 92.6
child 89.9
human face 88.4
baby 87.5
smile 84.3
boy 82.5
black 77.2
white 76
standing 75.2
old 74.4
footwear 72.4
posing 53.6
vintage 29.9

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 90.3%
Calm 48.2%
Surprised 38.9%
Sad 4.9%
Happy 3.8%
Angry 1.6%
Fear 1.1%
Disgusted 0.9%
Confused 0.6%

AWS Rekognition

Age 16-22
Gender Female, 99.2%
Surprised 81%
Happy 13.9%
Calm 3.7%
Sad 0.3%
Fear 0.3%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 13-21
Gender Female, 85%
Happy 93.7%
Calm 1.8%
Sad 1.6%
Surprised 1.6%
Confused 0.3%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Skirt 64%
Shoe 63.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 96.1%
a vintage photo of a group of people posing for a picture 96%
a group of people posing for a photo 95.9%

Text analysis

Amazon

e.E
NO
MUE-YT-

Google

NAGON
NAGON