Human Generated Data

Title

Untitled (two boys ice skating)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17313

Human Generated Data

Title

Untitled (two boys ice skating)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.8
Clothing 99.8
Human 99.2
Person 99.2
Person 98.4
Coat 97.3
Nature 91.4
Outdoors 73.8
Sleeve 65.6
Jacket 64.8
Overcoat 61.1
Raincoat 58.7
Plant 55.7
Tree 55.7

Imagga
created on 2022-02-26

fountain 100
structure 78.8
water 26.7
beach 26.3
man 24.9
silhouette 22.3
people 22.3
sea 20.3
person 20.2
ocean 19.2
dark 18.4
sun 17.8
light 17.8
summer 17.4
male 17
sky 16.6
sunset 16.2
sport 15.9
adult 15.9
travel 15.5
outdoor 15.3
landscape 14.9
blackboard 13.5
fun 12.7
outdoors 12.4
vacation 12.3
recreation 11.7
sand 11.5
couple 11.3
happy 11.3
park 10.7
color 10.6
walking 10.4
leisure 10
horizon 9.9
night 9.8
men 9.4
happiness 9.4
lifestyle 9.4
evening 9.3
sign 9
coast 9
wet 8.9
sunlight 8.9
body 8.8
boy 8.7
athlete 8.6
motion 8.6
laser 8.5
lake 8.5
enjoy 8.5
waves 8.4
freedom 8.2
environment 8.2
one 8.2
protection 8.2
danger 8.2
tranquil 8.1
symbol 8.1
sexy 8
scenic 7.9
black 7.9
bright 7.9
standing 7.8
splashes 7.8
destruction 7.8
rock 7.8
scene 7.8
model 7.8
portrait 7.8
explosion 7.7
clouds 7.6
relax 7.6
pleasure 7.5
serene 7.5
relaxation 7.5
free 7.5
sunrise 7.5
active 7.4
tourism 7.4
lights 7.4
world 7.4
natural 7.4
tourist 7.2
fitness 7.2
romantic 7.1
women 7.1
day 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

tree 99.1
outdoor 99
text 97.7
snow 96.5
water 88.9
clothing 87.3
person 74.1
black and white 71

Face analysis

Amazon

Google

AWS Rekognition

Age 6-16
Gender Male, 76.2%
Sad 87.9%
Calm 10.6%
Confused 0.6%
Happy 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a couple of people that are standing in the rain 66.6%
a group of people walking in the rain 66.5%
a group of people that are standing in the rain 65.8%

Text analysis

Amazon

35

Google

35
35