Human Generated Data

Title

Untitled (woman in corral with her horse)
Date

c. 1975
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1391

Human Generated Data

Title

Untitled (woman in corral with her horse)

People

Artist: Ken Whitmire Associates, American

Date

c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Horse 99.8
Mammal 99.8
Animal 99.8
Person 99.7
Human 99.7
Andalusian Horse 97.8
Person 95.8
Person 95.6
Person 95.4
Colt Horse 94.1
Person 93.5
Person 93.4
Person 92.4
Person 89.5
Person 85.5
Person 84
Person 76.6
Person 76.2
Person 75.2
Stallion 74.6
Person 73.4
Person 67.1
Person 47.6
Person 43.6

Imagga
created on 2022-01-22

horse 86.3
animal 48.6
horses 37
farm 35.7
vaulting horse 29.3
stallion 28.4
equine 27.9
field 25.9
grass 25.3
ranch 24
brown 22.8
mane 22.5
mammal 22.4
pasture 22
leading rein 21.5
equestrian 19.6
rural 19.4
mare 18.6
animals 18.5
meadow 17.9
gymnastic apparatus 17.6
rein 17.5
outdoors 17.2
bridle 16.3
saddle 15.7
livestock 15.2
strap 13.2
sport 13.2
chestnut 12.8
tail 12.5
wild 12.2
bull 12
countryside 11.9
sports equipment 11.9
country 11.4
cow 11.2
pet 11
domestic 10.8
stable 10.8
pony 10.8
grazing 10.8
mammals 10.7
trees 10.7
breed 10.6
standing 10.4
ride 10
cowboy 9.8
thoroughbred 9.8
running 9.6
cattle 9.2
pen 9.1
foal 8.9
leather strip 8.9
jockey 8.9
riding 8.8
friend 8.6
speed 8.2
sunset 8.1
herd 7.8
forest 7.8
black 7.8
run 7.7
seat 7.7
enclosure 7.6
sky 7.6
eating 7.6
park 7.4

Google
created on 2022-01-22

Horse 97.7
Vertebrate 92
Working animal 88.5
Mammal 85.6
Horse tack 85.2
Horse supplies 85
Style 83.9
Bridle 83.3
Black-and-white 82
Mane 79.2
Rein 77.8
Pack animal 77
Livestock 75.1
Recreation 75.1
Monochrome photography 73
Landscape 72.9
Monochrome 72.7
Sky 70.8
Event 70.8
Mare 70.4

Microsoft
created on 2022-01-22

animal 89.7
standing 83.3
equestrian 72.1
mammal 67.1
text 61.7
equine 60.4
horse 21

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 90.1%
Calm 94.8%
Confused 1.2%
Surprised 0.9%
Fear 0.8%
Sad 0.7%
Happy 0.6%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Female, 58.4%
Calm 100%
Happy 0%
Sad 0%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Happy 54.7%
Calm 36.3%
Sad 6.2%
Surprised 0.8%
Disgusted 0.7%
Angry 0.6%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Female, 100%
Disgusted 50.9%
Angry 28.1%
Sad 8.2%
Calm 3.4%
Fear 3.1%
Happy 2.5%
Confused 2%
Surprised 1.8%

AWS Rekognition

Age 18-24
Gender Female, 98.4%
Calm 50.6%
Confused 12.4%
Happy 9%
Fear 7.9%
Sad 7.7%
Disgusted 6.3%
Angry 3.3%
Surprised 2.8%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Disgusted 97.7%
Calm 1.9%
Angry 0.2%
Happy 0.1%
Sad 0.1%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 94.2%
Calm 96.3%
Surprised 1.4%
Confused 0.8%
Angry 0.5%
Fear 0.4%
Disgusted 0.2%
Happy 0.1%
Sad 0.1%

AWS Rekognition

Age 26-36
Gender Male, 60.8%
Calm 63.3%
Fear 24.1%
Disgusted 4.6%
Sad 2.4%
Angry 1.9%
Happy 1.9%
Confused 1.2%
Surprised 0.7%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Disgusted 50%
Calm 33.1%
Angry 10.9%
Sad 2.1%
Surprised 1.2%
Confused 1.2%
Happy 0.9%
Fear 0.7%

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Happy 57%
Calm 18.2%
Disgusted 6.6%
Sad 5.2%
Surprised 4.2%
Angry 4%
Fear 2.5%
Confused 2.4%

AWS Rekognition

Age 9-17
Gender Male, 88.5%
Calm 59.9%
Surprised 17.5%
Confused 6.4%
Angry 4%
Happy 3.6%
Sad 3.5%
Disgusted 2.9%
Fear 2.1%

AWS Rekognition

Age 35-43
Gender Male, 97%
Calm 59.9%
Surprised 11.2%
Sad 9.8%
Fear 8%
Happy 3.9%
Disgusted 3.4%
Angry 2.1%
Confused 1.7%

AWS Rekognition

Age 22-30
Gender Female, 99.4%
Calm 79.9%
Happy 3.8%
Fear 3.1%
Confused 3%
Sad 3%
Disgusted 2.6%
Angry 2.3%
Surprised 2.3%

AWS Rekognition

Age 24-34
Gender Female, 80.4%
Sad 68.2%
Confused 16.9%
Angry 5.6%
Disgusted 5.3%
Surprised 1.4%
Calm 1.2%
Fear 0.8%
Happy 0.6%

AWS Rekognition

Age 18-24
Gender Female, 50.5%
Sad 96.8%
Confused 2.5%
Disgusted 0.3%
Calm 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Calm 97.1%
Angry 1.8%
Confused 0.4%
Surprised 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 6-16
Gender Male, 88.8%
Calm 63.8%
Happy 12.4%
Surprised 7.3%
Sad 6.5%
Fear 3.3%
Confused 2.9%
Disgusted 2.2%
Angry 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Horse 99.8%
Person 99.7%

Captions

Microsoft

a group of people standing next to a horse 91.1%
a group of people standing on top of a horse 87.4%
a group of people standing around a horse 87.3%