Human Generated Data

Title

Untitled (father and son on horseback)

Date

1950s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.606

Human Generated Data

Title

Untitled (father and son on horseback)

People

Artist: Bachrach Studios, founded 1868

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Horse 99.6
Animal 99.6
Mammal 99.6
Human 99.5
Person 99.5
Horse 99.1
Equestrian 97.7
Person 91.4
Horse 85.9
Andalusian Horse 57.9

Imagga
created on 2022-01-23

horse 100
vaulting horse 67.2
animal 44.5
gymnastic apparatus 40.3
horses 34.1
riding 32.2
sports equipment 27.2
grass 26.9
farm 26.8
sport 26.4
outdoors 26.1
animals 25.9
stallion 25.5
field 25.1
saddle 24.7
horseback 23.7
equestrian 23.6
rural 22.9
cowboy 22.7
rider 22.6
equine 21.9
ranch 21.8
mare 21.6
ride 21.4
mammal 19.7
pasture 18.2
people 16.7
competition 16.5
country 15.8
brown 15.5
sky 15.3
plow 14.9
jockey 14.8
countryside 14.6
outdoor 14.5
fence 14.5
man 14.1
equipment 14.1
speed 13.7
male 13.7
livestock 13.1
action 13
mane 12.7
leisure 12.5
summer 12.2
outside 12
mammals 11.7
western 11.6
race 11.5
adult 11.1
tool 11
active 10.8
bridle 10.7
person 10.1
meadow 9.9
stable 9.9
black 9.6
pets 9.6
tail 9.6
lifestyle 9.4
mountain 8.9
trees 8.9
dressage 8.9
wild 8.7
adults 8.5
mountains 8.3
fun 8.2
freedom 8.2
one 8.2
domestic 8.1
rein 7.9
gallop 7.9
standing 7.8
show 7.6
hat 7.5
landscape 7.4
leading rein 7.4
training 7.4
pet 7.4
sunset 7.2
activity 7.2
sunlight 7.1
harness 7.1
happiness 7.1
autumn 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

outdoor 100
tree 99.9
grass 99.7
horse 91.4
animal 90.1
mammal 57.4
group 55.2
riding 14.1

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 94.3%
Calm 89.7%
Surprised 2.4%
Happy 1.9%
Sad 1.6%
Angry 1.6%
Confused 1.2%
Disgusted 1%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Calm 62.4%
Happy 31%
Angry 2.3%
Confused 1.2%
Surprised 1.1%
Fear 0.7%
Sad 0.7%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Horse 99.6%
Person 99.5%

Captions

Microsoft

a group of people sitting on a horse 90.9%
a group of people riding on the back of a horse 88.2%
a group of people standing in front of a horse 88.1%