Human Generated Data

Title

Untitled (children on diving board)

Date

c. 1961

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16326

Human Generated Data

Title

Untitled (children on diving board)

People

Artist: Lucian and Mary Brown, American

Date

c. 1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.8
Human 99.8
Person 99.8
Person 99.6
Person 99.5
Clothing 99.1
Apparel 99.1
Shorts 99.1
Outdoors 85.7
Nature 80.1
Female 75.3
Pool 71.9
Water 71.9
Plant 63.6
Swimwear 63
Swimming Pool 58.9
Tree 58.5
Face 58.4
Girl 56.4

Imagga
created on 2022-02-11

fountain 100
structure 76.2
grunge 20.4
old 20.2
building 20
architecture 18.7
vintage 18.2
city 15.8
dirty 14.5
water 14
retro 13.9
antique 13.8
art 13.8
snow 13.7
windowsill 12.9
landscape 11.9
texture 11.8
history 11.6
outdoor 11.5
black 11.4
urban 11.4
travel 11.3
ancient 11.2
wall 10.9
house 10.9
grungy 10.4
style 10.4
sill 10.3
park 10.3
balcony 10.1
aged 10
artistic 9.6
window 9.3
frame 9.2
summer 9
textured 8.8
light 8.7
man 8.7
chair 8.7
paper 8.6
old fashioned 8.6
space 8.5
tourism 8.2
brown 8.1
material 8
support 8
cool 8
sea 7.8
structural member 7.7
tree 7.7
roof 7.6
wood 7.5
grain 7.4
rough 7.3
bench 7.3
danger 7.3
fence 7.2
wet 7.2
season 7
sky 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 93.8
person 87.3
black and white 77.3
statue 65.5
man 62.6
old 47.8

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Male, 99.5%
Calm 90.6%
Surprised 3.3%
Happy 2.8%
Angry 1%
Sad 0.8%
Confused 0.7%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 6-16
Gender Male, 97.9%
Happy 88.4%
Calm 8.6%
Surprised 1.3%
Sad 0.6%
Angry 0.4%
Fear 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 94.7%
Calm 96.1%
Surprised 1.1%
Sad 0.9%
Happy 0.6%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 4-12
Gender Female, 94.1%
Calm 80.2%
Surprised 14.3%
Happy 1.7%
Sad 1.5%
Confused 0.9%
Disgusted 0.6%
Angry 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a person sitting on a bench 77.8%
a person sitting on a bench 77.7%
a boy sitting on a bench 46.4%

Text analysis

Amazon

5

Google

5 MJI7-- Y T37A°2 - - XAGO
MJI7--
T37A°2
5
XAGO
Y
-