Human Generated Data

Title

Untitled (attempts at shoeing a mule)

Date

1900s

People

Artist: American Steel & Wire Co.,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3888

Human Generated Data

Title

Untitled (attempts at shoeing a mule)

People

Artist: American Steel & Wire Co.,

Date

1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3888

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 98.8
Person 98.8
Person 98.5
Person 97.8
Person 97.8
Person 97.3
Person 97.3
Horse 96.9
Animal 96.9
Mammal 96.9
Person 90.3
Person 89.9
Person 87.6
Andalusian Horse 85.2
Clothing 78.3
Apparel 78.3
Person 70.7
Person 70.4
Rodeo 65
Soil 62.9
Person 58.8
Stallion 57.4
Duel 57.3
Hat 55.9
Equestrian 55.8
Colt Horse 55.6

Clarifai
created on 2019-11-10

people 99.8
adult 96.5
cavalry 96.3
mammal 96.2
group 95.3
man 94.4
group together 91.6
wear 89.6
monochrome 86.8
many 84.6
military 84.4
woman 83.9
one 83.3
administration 82.4
seated 82.1
outfit 81.2
transportation system 78.6
cattle 78.5
vehicle 78.4
war 76.7

Imagga
created on 2019-11-10

cowboy 87.4
horse 66.7
animal 44.6
saddle 31.2
laborer 30.4
horses 28.3
riding 27.3
rider 25.6
stallion 23.5
ride 23.3
ranch 23.2
farm 23.2
camel 22.6
equine 20.9
mammal 20.9
horseback 20.7
equestrian 20.6
animals 20.4
outdoors 20.2
desert 18.5
sport 18.1
grass 17.4
jockey 15.8
wild 15.7
brown 14.7
field 14.2
dry 13.9
western 13.6
pasture 13.4
people 12.8
mare 12.8
mane 12.7
sand 12.4
rural 12.3
outdoor 12.2
seat 12.1
support 12
competition 11.9
bridle 11.6
pen 11.6
country 11.4
landscape 11.2
stock saddle 10.8
male 10.4
speed 10.1
countryside 10.1
tail 9.6
man 9.4
active 9
sky 8.9
enclosure 8.9
mammals 8.8
lifestyle 8.7
day 8.6
wilderness 8.5
travel 8.5
black 8.4
head 8.4
action 8.4
meadow 8.1
wildlife 8
gallop 7.9
hat 7.9
herd 7.9
racing 7.8
arid 7.8
sidesaddle 7.7
safari 7.7
outside 7.7
running 7.7
thoroughbred 7.6
fun 7.5
tourism 7.4
device 7.4
pet 7.4
sun 7.3
trees 7.1

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

cow 99.3
horse 99
ground 97.4
outdoor 96.9
animal 93.6
person 85
bull 84.2
text 83.1
mammal 79.3
working animal 68.6
clothing 67.8
man 66.1
rein 61.3
halter 60
mule 58
animal sports 57.1
livestock 55.2
wrangler 55
bridle 54.1
horse supplies 52.9
stallion 52.7
mare 50.2
cattle 41.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-67
Gender Male, 54.8%
Fear 45.1%
Happy 45.2%
Surprised 45%
Angry 45.1%
Confused 45%
Calm 53.3%
Disgusted 45%
Sad 46.3%

AWS Rekognition

Age 18-30
Gender Male, 55%
Disgusted 45%
Sad 45.1%
Happy 45%
Calm 54.1%
Fear 45%
Surprised 45%
Angry 45.6%
Confused 45%

AWS Rekognition

Age 33-49
Gender Male, 50.5%
Confused 49.5%
Surprised 49.6%
Fear 49.5%
Disgusted 49.5%
Angry 50%
Happy 49.5%
Sad 49.5%
Calm 49.8%

AWS Rekognition

Age 50-68
Gender Female, 50.3%
Disgusted 49.5%
Surprised 49.5%
Sad 50%
Angry 49.5%
Fear 49.5%
Happy 49.6%
Calm 49.9%
Confused 49.5%

AWS Rekognition

Age 36-52
Gender Male, 54.8%
Fear 45.7%
Happy 45.1%
Surprised 46.3%
Calm 50.3%
Sad 45.8%
Angry 46.6%
Disgusted 45.1%
Confused 45.2%

AWS Rekognition

Age 32-48
Gender Male, 50.1%
Surprised 49.5%
Happy 49.5%
Angry 49.9%
Disgusted 49.5%
Sad 49.8%
Calm 49.5%
Fear 49.6%
Confused 49.6%

AWS Rekognition

Age 27-43
Gender Female, 50.2%
Confused 49.5%
Surprised 49.6%
Fear 49.6%
Happy 49.5%
Disgusted 49.5%
Calm 49.5%
Sad 49.5%
Angry 50.2%

AWS Rekognition

Age 45-63
Gender Male, 53.6%
Fear 46%
Surprised 45.3%
Happy 49.5%
Sad 45.8%
Calm 47.7%
Disgusted 45.1%
Confused 45.1%
Angry 45.5%

AWS Rekognition

Age 39-57
Gender Male, 50.2%
Disgusted 49.5%
Surprised 49.5%
Sad 49.5%
Angry 50.4%
Fear 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 23-35
Gender Male, 50.1%
Surprised 49.5%
Happy 49.6%
Calm 50.1%
Fear 49.5%
Disgusted 49.6%
Sad 49.6%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 19-31
Gender Male, 50.4%
Sad 49.6%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%
Fear 49.5%
Confused 50.2%
Surprised 49.6%

AWS Rekognition

Age 28-44
Gender Male, 54.4%
Happy 45.2%
Disgusted 45%
Angry 45.1%
Sad 45.2%
Fear 45.3%
Surprised 45.7%
Confused 45%
Calm 53.3%

Feature analysis

Amazon

Person 98.8%
Horse 96.9%

Categories

Imagga

pets animals 72.8%
nature landscape 26.8%