Human Generated Data

Title

Untitled (two little girls)
Date

1978
People

Artist: Sharon Smith, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.2105

Human Generated Data

Title

Untitled (two little girls)

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Water 99.8
Ocean 99.8
Outdoors 99.8
Sea 99.8
Nature 99.8
Shoreline 99.7
Person 99.2
Human 99.2
Apparel 98.6
Clothing 98.6
Beach 98.4
Coast 98.4
Person 98.1
Shorts 96.7
Sand 90.6
Face 90
Female 85.1
Blonde 83.2
Woman 83.2
Kid 83.2
Girl 83.2
Teen 83.2
Child 83.2
Vacation 78.1
Hair 77.1
Photography 75.8
Photo 75.8
Portrait 75.8
Bay 69.3
Land 63.9
Boy 61.7
Sleeve 59.4
Swimwear 56.4

Imagga
created on 2022-02-26

beach 60.3
sea 43.8
vacation 40.9
ocean 35.4
sand 33.2
summer 32.2
water 30.7
holiday 27.2
happy 27
tropical 25.6
child 25.5
people 24
person 23.5
coast 23.4
lifestyle 23.1
travel 22.5
fun 22.5
bikini 22.2
relax 21.9
man 20.8
happiness 20.4
couple 20
garment 20
swimsuit 19.7
smile 18.5
clothing 18.5
shore 17.7
sun 17.7
outdoors 17.3
male 16.8
pretty 16.8
smiling 16.6
leisure 16.6
sky 16.6
love 16.6
sexy 16.1
relaxation 15.9
island 15.6
paradise 15.1
healthy 14.5
adult 14.4
portrait 14.2
snorkel 13.8
joy 13.4
model 13.2
body 12.8
attractive 12.6
brother 12.6
outdoor 12.2
boy 12.2
resort 12.2
girls 11.9
wet suit 11.7
tan 11.5
running 11.5
together 11.4
brunette 11.3
play 11.2
swimming trunks 11
covering 10.8
family 10.7
lady 10.6
parent 10.4
wave 10.4
coastline 10.3
breathing device 10.3
waves 10.2
playing 10
relaxing 10
one 9.7
hair 9.5
women 9.5
outside 9.4
vacations 9.4
youth 9.4
cute 9.3
sunglasses 9.2
holding 9.1
recreation 9
kid 8.9
sandy 8.7
sunny 8.6
device 8.6
seaside 8.5
walking 8.5
children 8.2
romance 8
romantic 8
world 8
mother 8
little 8
tanning 7.9
sunbathing 7.9
day 7.8
hands 7.8
pacific 7.7
float 7.7
pool 7.7
swimming 7.7
two 7.6
walk 7.6
adults 7.6
enjoyment 7.5
human 7.5
relationship 7.5
rest 7.4
fit 7.4
maillot 7.4
freedom 7.3
blond 7.3
tranquil 7.2
horizon 7.2
looking 7.2
childhood 7.2
wet 7.2
face 7.1

Google
created on 2022-02-26

Water 96
Shorts 90.3
Beach 89.2
Sky 88.4
People on beach 87
Gesture 85.3
Happy 83.1
People in nature 80.5
Aqua 80.4
Adaptation 79.2
T-shirt 72.8
Travel 72.1
Vintage clothing 69.9
Rectangle 67.8
Fun 66.4
Toddler 66
Sand 65.2
Ocean 63.6
Holiday 61
Leisure 58.3

Microsoft
created on 2022-02-26

beach 97.9
monitor 95.2
clothing 94
text 93.3
person 90.8
human face 85.4
water 83.4
posing 82.3
child 81.8
smile 78.7
boy 55.3
ocean 51.8
picture frame 41.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 100%
Angry 54.7%
Happy 38.5%
Confused 2.3%
Disgusted 1.9%
Sad 1.2%
Surprised 0.7%
Fear 0.4%
Calm 0.4%

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 99.6%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Calm 0.1%
Surprised 0.1%
Fear 0%

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a girl posing for a picture 83.9%
a man and a woman posing for a picture 68.3%
a man and woman posing for a picture 62.1%

Text analysis

Amazon

JAPAN