Human Generated Data

Title

Untitled (attempts at shoeing a mule)
Date

1900s
People

Artist: American Steel & Wire Co.,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3891

Human Generated Data

Title

Untitled (attempts at shoeing a mule)

People

Artist: American Steel & Wire Co.,

Date

1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3891

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 98.6
Human 98.6
Person 98.2
Person 97.8
Person 97.8
Person 97.3
Person 97.3
Person 96.4
Person 94.7
Person 93.9
Animal 92.9
Bull 92.9
Mammal 92.9
Cattle 92.5
Cow 92.5
Person 92.1
Person 88.4
Person 86.5
Horse 86
Person 79.7
Person 76.6
Person 72.7
People 63
Equestrian 57.7

Clarifai
created on 2019-11-10

people 99.8
group 98.2
adult 97.2
many 95
man 93.8
woman 92.4
cavalry 92.2
art 89.5
wear 89.2
group together 87.6
administration 87
mammal 84.6
one 84
crowd 83.5
military 76.5
child 74.8
exhibition 72.8
leader 71.7
sculpture 70.9
music 70.8

Imagga
created on 2019-11-10

animal 20.2
silhouette 18.2
travel 17.6
mammal 17
horse 14.2
people 13.4
tourism 12.4
water 11.3
life 11.1
sunset 10.8
man 10.5
wild 10.4
sea 10.2
bull 10.1
sand 10.1
wildlife 9.8
horses 9.7
black 9.7
beach 9.6
male 9.3
person 9.2
landscape 8.9
farm 8.9
sunlight 8.9
night 8.9
child 8.8
grass 8.7
ocean 8.5
outdoors 8.2
sculpture 8.1
sky 7.7
summer 7.7
safari 7.7
outdoor 7.6
piggy bank 7.6
musical instrument 7.5
cattle 7.4
brown 7.4
group 7.2
sun 7.2
cowboy 7.2
history 7.1

Google
created on 2019-11-10

Photograph 96.9
Snapshot 86.4
Photography 78.4
Stock photography 77.5
Black-and-white 68.3
Bovine 67.5
Working animal 63.6
Landscape 59.3
Square 55.4
Style 51
Livestock 50.4
Ox 50.4

Microsoft
created on 2019-11-10

text 97
horse 96.2
animal 91.2
person 86.5
mammal 86.3
standing 86.3
cattle 85.8
old 82.7
bull 79.3
white 72.2
working animal 63
elephant 59.4
man 56.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-40
Gender Male, 54.9%
Happy 51.9%
Confused 45%
Fear 45.1%
Angry 45.2%
Surprised 45.3%
Disgusted 45%
Calm 47.3%
Sad 45.1%

AWS Rekognition

Age 6-16
Gender Male, 54%
Calm 45.4%
Confused 45%
Surprised 45%
Happy 52.6%
Fear 45.2%
Angry 45.1%
Disgusted 45%
Sad 46.7%

AWS Rekognition

Age 25-39
Gender Female, 51.5%
Angry 53%
Fear 45.9%
Sad 45.1%
Calm 45.5%
Confused 45.1%
Surprised 45.4%
Disgusted 45.1%
Happy 45%

AWS Rekognition

Age 29-45
Gender Male, 54.7%
Sad 45%
Happy 46.1%
Angry 45%
Disgusted 45%
Calm 53.8%
Fear 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 39-57
Gender Male, 50.5%
Confused 49.5%
Angry 49.6%
Fear 49.5%
Happy 49.5%
Calm 50.4%
Surprised 49.5%
Disgusted 49.5%
Sad 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.5%
Calm 50.3%
Sad 49.6%
Fear 49.5%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 41-59
Gender Male, 54.9%
Disgusted 45.1%
Angry 48.1%
Surprised 45%
Calm 45.1%
Happy 45%
Fear 45.5%
Confused 45.1%
Sad 51%

AWS Rekognition

Age 26-40
Gender Male, 50.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Surprised 49.5%
Confused 49.5%
Calm 50.3%
Angry 49.6%
Sad 49.5%

AWS Rekognition

Age 24-38
Gender Male, 55%
Confused 45%
Happy 46.2%
Surprised 45.1%
Angry 47.1%
Fear 45.1%
Calm 51.1%
Disgusted 45.3%
Sad 45.1%

AWS Rekognition

Age 39-57
Gender Male, 53.5%
Disgusted 45%
Angry 50.6%
Fear 46%
Confused 45%
Happy 45%
Calm 46.2%
Sad 47%
Surprised 45%

AWS Rekognition

Age 25-39
Gender Male, 50.4%
Calm 50.5%
Happy 49.5%
Fear 49.5%
Angry 49.5%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 29-45
Gender Male, 54.3%
Fear 45.1%
Angry 45.4%
Disgusted 45.4%
Surprised 45.2%
Happy 51.7%
Sad 45.1%
Calm 47.1%
Confused 45.1%

AWS Rekognition

Age 33-49
Gender Male, 50.4%
Happy 49.6%
Surprised 49.5%
Sad 49.5%
Disgusted 49.6%
Angry 49.5%
Confused 49.5%
Fear 49.5%
Calm 50.3%

AWS Rekognition

Age 37-55
Gender Male, 50.4%
Fear 49.5%
Sad 49.5%
Happy 49.6%
Disgusted 49.5%
Confused 49.5%
Calm 50%
Surprised 49.8%
Angry 49.5%

AWS Rekognition

Age 51-69
Gender Male, 50.4%
Sad 49.7%
Angry 49.7%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.7%
Surprised 49.5%
Happy 49.8%

AWS Rekognition

Age 40-58
Gender Male, 54.9%
Angry 45%
Sad 45.3%
Disgusted 45.1%
Fear 45%
Surprised 45%
Confused 45%
Happy 45.6%
Calm 53.9%

AWS Rekognition

Age 19-31
Gender Female, 50.2%
Fear 49.5%
Calm 50%
Happy 49.9%
Confused 49.5%
Sad 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.1%
Surprised 49.5%
Happy 49.5%
Calm 49.6%
Fear 49.5%
Sad 49.5%
Disgusted 49.5%
Angry 50.4%
Confused 49.5%

Feature analysis

Amazon

Person 98.6%
Cow 92.5%