Human Generated Data

Title

Two Men, Cherry Grove

Date

1978

People

Artist: Sharon Smith, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.2106

Human Generated Data

Title

Two Men, Cherry Grove

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Back 99.3
Person 98.7
Human 98.7
Person 98.2
Person 97.7
Apparel 97.1
Clothing 97.1
Skin 94.8
Painting 91.6
Art 91.6
Swimwear 70.5
Text 62.7
Screen 62.7
Display 62.7
LCD Screen 62.7
Monitor 62.7
Electronics 62.7
Shorts 62.1
Advertisement 60.3
Poster 55.3
Bikini 55

Imagga
created on 2022-02-26

swimming trunks 97.6
swimsuit 92.7
garment 65.8
beach 60.2
clothing 43.3
vacation 42.6
sand 39.8
bikini 35.8
sea 35.2
man 34.3
summer 34.1
ocean 30.9
water 30.1
holiday 28.7
people 27.4
male 27
happy 27
fun 27
couple 24.4
tropical 23.9
covering 23.9
child 23.4
attractive 22.4
consumer goods 22.4
lifestyle 21
relaxing 21
sexy 20.9
resort 19.7
portrait 18.8
relax 18.6
person 18.5
relaxation 18.5
adult 18.1
happiness 18.1
outdoors 18
travel 17.6
leisure 17.5
smiling 17.4
swimming 17.3
body 16.8
boy 16.6
smile 16.4
sitting 16.4
love 15.8
together 15.8
guy 15.8
wet 15.2
family 15.2
enjoyment 15
dad 15
tan 14.5
pool 14.4
handsome 14.3
women 14.3
joy 14.2
healthy 13.9
boyfriend 12.6
girlfriend 12.5
kid 12.4
father 12.4
paradise 12.3
parent 12.2
exotic 11.9
health 11.8
tourism 11.6
cheerful 11.4
enjoy 11.3
two 11
girls 11
recreation 10.8
brother 10.7
outdoor 10.7
lying 10.4
sunny 10.3
relationship 10.3
shore 10.2
waves 10.2
hot 10.1
cute 10.1
romance 9.8
sit 9.5
men 9.5
idyllic 9.4
outside 9.4
friends 9.4
face 9.3
sensual 9.1
sky 8.9
sun 8.9
day 8.6
play 8.6
casual 8.5
horizontal 8.4
fit 8.3
playing 8.2
children 8.2
tranquil 8.2
mother 8.1
romantic 8
looking 8
clear 7.9
tanned 7.8
youth 7.7
seaside 7.6
holidays 7.5
rest 7.4
emotion 7.4
teenager 7.3
hat 7.3
blond 7.2
active 7.2
coast 7.2
hair 7.1
model 7
pretty 7

Google
created on 2022-02-26

Water 96.5
Shorts 95.1
Sky 92.5
Vertebrate 92.2
Muscle 91.9
Leg 90.9
Smile 90.5
Trunks 90.3
Beach 89.4
People on beach 88.7
Happy 84.3
Swimwear 83.6
Thigh 82.3
Travel 81.6
Leisure 81.3
Cool 81.3
Morning 79.5
Summer 78.9
Fun 78
Barechested 77.6

Microsoft
created on 2022-02-26

beach 99.8
swimwear 93.7
person 92.2
man 91.7
sand 63.9
sun tanning 61.1
woman 53.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 96%
Confused 2.3%
Happy 1.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Happy 100%
Confused 0%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%
Sad 0%
Calm 0%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 91.6%

Captions

Microsoft

a man sitting on a beach posing for the camera 92.8%
a man sitting on a beach 92.1%
a man sitting at a beach 92%

Text analysis

Amazon

I