Human Generated Data

Title

Jones Beach

Date

1978

People

Artist: Sharon Smith, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.2107

Human Generated Data

Title

Jones Beach

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Person 99.7
Person 98.8
Person 98.8
Person 98
Clothing 98
Apparel 98
Person 97.6
Person 96.9
Back 91.5
Chair 85.3
Furniture 85.3
Person 84.7
Vehicle 84.3
Airplane 84.3
Transportation 84.3
Aircraft 84.3
Shorts 84
LCD Screen 81.1
Screen 81.1
Electronics 81.1
Monitor 81.1
Display 81.1
Person 81
Airplane 78.6
Undershirt 77.2
Skin 77.1
Person 76.9
Swimwear 76.7
Person 74.3
Flooring 74.2
Airplane 73.7
Airplane 69.5
Bikini 68.7
Person 68.6
Finger 63.6
Person 63.5
Vacation 63.3
People 60.8
Airplane 59.5
Sitting 57.2
Wood 56
Person 50.3

Imagga
created on 2022-02-26

swimsuit 100
bikini 95.6
swimming trunks 79.3
garment 77.3
beach 74
clothing 73.5
vacation 52.4
covering 47
sand 44.7
ocean 43.5
summer 40.6
sea 39.9
tan 37.6
water 36.7
tropical 36.7
sexy 35.4
beachwear 35.1
holiday 34.4
travel 30.3
relaxing 29.1
body 28
relaxation 27.7
leisure 27.4
resort 26.4
consumer goods 26.2
relax 26.1
lifestyle 24.6
people 24
attractive 23.8
man 22.2
happy 21.3
happiness 21.2
paradise 20.7
coast 20.7
fun 19.5
couple 19.2
outdoors 18.7
sun 18.5
exotic 18.2
person 17.5
idyllic 17
pretty 16.8
model 16.4
sitting 16.3
sky 16
tourism 15.7
island 14.7
slim 13.8
sunny 13.8
sunbathing 13.8
gorgeous 13.6
hot 13.4
enjoyment 13.2
waves 13
smile 12.8
adult 12.8
sensual 12.7
recreational 12.6
recreation 12.6
lifestyles 12.3
smiling 12.3
male 12.1
hat 11.9
love 11.9
tranquil 11.8
day 11.8
pacific 11.6
pool 11.5
enjoy 11.3
lying 11.3
play 11.2
luxury 11.2
rest 11.1
health 11.1
women 11.1
portrait 11
wellness 11
outdoor 10.7
destinations 10.6
cheerful 10.6
maillot 10.5
shore 10.2
two 10.2
skin 10.2
chaise lounge 9.9
laying 9.7
together 9.6
swimming 9.6
sit 9.5
healthy 9.5
legs 9.4
coastline 9.4
sunshine 9.4
sunglasses 9.3
calm 9.2
seaside 8.9
tanning 8.9
seashore 8.8
tanned 8.8
brunette 8.7
chair 8.5
vacations 8.5
flower 8.5
destination 8.4
holidays 8.4
warm 8.3
back 8.3
one 8.2
girls 8.2
lady 8.1
activity 8.1
cute 7.9
bliss 7.8
turquoise 7.7
serene 7.5
joy 7.5
alone 7.3
blond 7.2
spa 7.2
hair 7.1
handsome 7.1

Google
created on 2022-02-26

Sky 95.9
People on beach 93
Beach 88.4
Travel 84.8
Swimwear 84.1
Body of water 83.6
Outdoor furniture 83
Leisure 81.3
Shorts 80.1
Tints and shades 76.6
Landscape 75.8
Sunlounger 75.2
Brassiere 74.8
Fun 74
Horizon 72.1
Event 71.2
Happy 70.8
Sand 70.3
Sun tanning 70.2
Comfort 69.4

Microsoft
created on 2022-02-26

beach 99.1
person 93.4
sand 89.4
man 67.8
text 66.4
clothing 62.5
swimwear 50.7
picture frame 9.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 61.1%
Confused 27%
Angry 6%
Disgusted 2.5%
Sad 1.1%
Calm 0.8%
Surprised 0.8%
Fear 0.7%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Happy 99%
Calm 0.5%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 98.1%
Calm 92.5%
Confused 1.9%
Surprised 1.8%
Fear 1.3%
Disgusted 0.7%
Happy 0.7%
Angry 0.6%
Sad 0.4%

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 85.3%
Airplane 84.3%

Captions

Microsoft

a group of people sitting at a beach 93.2%
a group of people on a beach 93.1%
a group of people on a beach posing for the camera 91.9%

Text analysis

Amazon

<<
SAN FERMA
and