Human Generated Data

Title

Untitled (attempts at shoeing a mule)

Date

1900s

People

Artist: American Steel & Wire Co.,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3887

Human Generated Data

Title

Untitled (attempts at shoeing a mule)

People

Artist: American Steel & Wire Co.,

Date

1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3887

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 95.6
Human 95.6
Horse 92.8
Animal 92.8
Mammal 92.8
Bull 92
Person 91.7
Person 90.3
Person 90.1
Person 85.6
Rodeo 81.5
Person 80.6
Person 74.7
Person 67.3
Person 67.2
Andalusian Horse 65.2
Person 61.8
Person 61.3
Colt Horse 57
Stallion 55.4
Bullfighter 55.2

Clarifai
created on 2019-11-10

people 99.6
cavalry 98.5
mammal 96.6
adult 93.5
group 91.8
man 90.5
one 88.5
woman 84
vintage 83
seated 82.6
transportation system 82.2
wear 82.2
cattle 81.9
military 81.4
many 81.3
group together 80.5
retro 80.2
competition 78.9
art 77.6
old 75

Imagga
created on 2019-11-10

horse 79.6
animal 32
stallion 29.4
ranch 28.6
pen 27.8
farm 26.8
horses 26.3
equine 24.9
wild 23.5
enclosure 22.5
mammal 22.4
bull 21.1
vaulting horse 20.8
running 19.2
cowboy 19.1
mane 18.6
thoroughbred 18.1
sport 17.3
brown 16.9
field 16.7
equestrian 16.7
pasture 15.3
grass 14.2
outdoors 14.2
animals 13.9
mare 13.7
bullring 12.9
gymnastic apparatus 12.5
black 12
pet 11.9
bullfighting 11.9
livestock 11.9
support 11.1
herd 10.8
meadow 10.8
mammals 10.7
male 10.4
cow 10.2
structure 10.1
rural 9.7
western 9.7
landscape 9.7
blood 9.7
country 9.7
device 9.6
saddle 9.5
outdoor 9.2
countryside 9.1
sky 8.9
arena 8.9
riding 8.8
ride 8.7
tail 8.6
bridle 8.5
sports equipment 8.5
free 8.4
horizontal 8.4
action 8.3
speed 8.2
domestic 8.1
wildlife 8
hoof 7.9
courage 7.9
rider 7.9
cultural 7.8
sand 7.7
run 7.7
power 7.6
desert 7.5
tradition 7.4
danger 7.3
beach 7.3
sunset 7.2
stirrup 7.1
hair 7.1
sea 7

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

horse 96.9
text 94.1
animal 90.4
bull 67.8
mammal 65.5
cattle 63.6
working animal 55.5
camel 50.1
mule 50.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-52
Gender Male, 53.1%
Surprised 45.2%
Sad 45.1%
Happy 52.3%
Calm 47.1%
Disgusted 45%
Fear 45.1%
Confused 45%
Angry 45%

AWS Rekognition

Age 57-75
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.5%
Angry 50.4%
Calm 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Confused 49.5%
Angry 49.5%
Calm 50.1%
Surprised 49.6%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 49.7%

AWS Rekognition

Age 23-35
Gender Male, 50.4%
Confused 49.5%
Angry 50.4%
Sad 49.6%
Happy 49.5%
Calm 49.5%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 22-34
Gender Female, 50.1%
Confused 49.5%
Sad 49.7%
Angry 49.6%
Surprised 49.5%
Happy 49.8%
Calm 49.8%
Fear 49.6%
Disgusted 49.5%

AWS Rekognition

Age 23-37
Gender Female, 51.6%
Angry 45.1%
Happy 45%
Sad 54.3%
Disgusted 45%
Fear 45.4%
Calm 45.1%
Surprised 45%
Confused 45%

AWS Rekognition

Age 50-68
Gender Male, 50.3%
Sad 50%
Confused 49.6%
Angry 49.7%
Disgusted 49.5%
Fear 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 21-33
Gender Male, 50.4%
Calm 50.3%
Sad 49.6%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Angry 49.6%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.3%
Fear 49.5%
Angry 49.8%
Disgusted 49.8%
Surprised 49.5%
Happy 49.5%
Sad 49.7%
Calm 49.7%
Confused 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.4%
Sad 49.9%
Angry 49.6%
Calm 49.7%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.6%
Surprised 49.5%

AWS Rekognition

Age 33-49
Gender Female, 50.1%
Angry 49.5%
Calm 49.5%
Fear 49.5%
Sad 50.4%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%

Feature analysis

Amazon

Person 95.6%
Horse 92.8%

Categories

Imagga

nature landscape 97.8%
pets animals 2.2%

Captions

Microsoft
created on 2019-11-10

a black and white photo of a horse 87.5%
an old photo of a horse 87.4%
a close up of a horse 87.3%