Human Generated Data

Title

Untitled (men playing baseball)

Date

c. 1960

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21611

Human Generated Data

Title

Untitled (men playing baseball)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.9
Person 99.9
Person 99.8
Person 99.2
Plant 99.1
Grass 99.1
Person 98.5
Person 97.4
Person 96.9
Person 96.7
Play 94
Outdoors 92.6
Person 91.8
Person 91.3
Tree 85.8
Park 84.4
Lawn 84.4
Vegetation 84
People 76.3
Clothing 73.6
Apparel 73.6
Meal 71.4
Food 71.4
Nature 71.2
Face 71.1
Female 70.5
Person 67.3
Leisure Activities 66.9
Sport 65.1
Sports 65.1
Person 62.8
Yard 58.9
Suit 58.8
Coat 58.8
Overcoat 58.8
Cricket 58.8
Toy 57.2
Frisbee 57.2
Photo 57.1
Photography 57.1
Girl 56.8
Shorts 56

Imagga
created on 2022-03-05

swing 34.5
mechanical device 33.6
people 25.1
mechanism 25
plaything 24.7
sport 24.5
outdoor 23.7
adult 22.7
person 22.4
fun 21.7
summer 20.6
man 20.2
happy 20.1
joy 19.2
outdoors 17.2
sports equipment 16.4
fountain 16.2
sky 15.9
active 15.3
lifestyle 15.2
dancer 15
grass 15
happiness 14.9
freedom 14.6
weapon 14.3
women 14.2
silhouette 13.2
smile 12.8
leisure 12.5
sexy 12
performer 11.9
pretty 11.9
sunset 11.7
portrait 11.6
cute 11.5
male 11.3
boy 11.3
sun 11.3
free 11.3
play 11.2
one 11.2
sunny 11.2
field 10.9
dress 10.8
sprinkler 10.8
park 10.7
vacation 10.6
run 10.6
clouds 10.1
joyful 10.1
athlete 10.1
teenager 10
structure 9.9
world 9.9
activity 9.9
jumping 9.7
hair 9.5
motion 9.4
youth 9.4
gymnastic apparatus 9.3
action 9.3
javelin 9.1
vaulting horse 9
child 9
recreation 9
ball 8.9
posing 8.9
cool 8.9
horse 8.8
urban 8.7
love 8.7
water 8.7
jump 8.6
walk 8.6
two 8.5
enjoy 8.5
travel 8.5
beach 8.4
relax 8.4
city 8.3
exercise 8.2
cheerful 8.1
meadow 8.1
weather 7.9
day 7.8
standing 7.8
black 7.8
entertainer 7.8
outside 7.7
walking 7.6
life 7.5
player 7.5
equipment 7.4
spear 7.3
girls 7.3
success 7.2
game 7.1
face 7.1
sword 7.1
sea 7
resort area 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

outdoor 99.7
tree 98.8
black and white 81.7
person 79.5
dance 70.6
text 69.7
man 69.4
clothing 58.7

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 98.5%
Calm 87.2%
Sad 6.5%
Confused 4.9%
Surprised 1%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 97.9%
Calm 96.8%
Happy 2.1%
Sad 0.5%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 85.4%
Calm 44.1%
Sad 30.5%
Happy 11.3%
Confused 5.7%
Angry 3.7%
Surprised 1.8%
Fear 1.6%
Disgusted 1.3%

AWS Rekognition

Age 33-41
Gender Male, 91.1%
Happy 39.1%
Calm 29.4%
Sad 13.6%
Angry 5.7%
Disgusted 4.7%
Fear 3.1%
Surprised 2.3%
Confused 2.1%

AWS Rekognition

Age 25-35
Gender Male, 85.7%
Sad 68.8%
Calm 23.9%
Confused 1.5%
Surprised 1.5%
Happy 1.3%
Fear 1%
Disgusted 0.9%
Angry 0.9%

AWS Rekognition

Age 18-26
Gender Female, 98.2%
Happy 85.8%
Sad 13%
Confused 0.4%
Calm 0.3%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 93.2%
Sad 58.5%
Calm 38.6%
Happy 1.1%
Disgusted 0.5%
Angry 0.5%
Fear 0.5%
Confused 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people playing a game of frisbee 44.2%
a group of people playing baseball on a field 44.1%
a group of people throwing a frisbee 44%

Text analysis

Amazon

82D