Human Generated Data

Title

Untitled (boys with horse)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17637

Human Generated Data

Title

Untitled (boys with horse)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.9
Person 99.9
Mammal 99.8
Animal 99.8
Horse 99.8
Person 99.7
Apparel 94.5
Clothing 94.5
Andalusian Horse 93.9
Stallion 64.1
Photography 61.7
Face 61.7
Photo 61.7
Portrait 61.7
Female 60.8
Nature 60.3
Suit 60
Coat 60
Overcoat 60
Outdoors 59.7
Building 58.8
Steeple 58.8
Architecture 58.8
Spire 58.8
Tower 58.8
Hat 57.9
Colt Horse 57.3
Girl 55.3

Imagga
created on 2022-02-26

canvas tent 82
horse 40.7
barn 32.5
animal 30.9
farm 29.4
ranch 24
horses 23.4
field 21.7
pasture 21.1
equine 19.8
grass 19.8
animals 18.5
farm building 18.3
rural 17.6
mare 16.7
building 15.9
stallion 15.7
brown 15.5
mane 14.7
outdoor 14.5
structure 13.3
mammal 13.3
equestrian 12.8
riding 12.7
trees 12.5
summer 12.2
wild 12.2
livestock 11.9
outdoors 11.2
sky 10.8
sunset 10.8
sun 10.5
countryside 10.1
tree 10
meadow 9.9
grazing 9.8
scenic 9.7
silhouette 9.1
sunlight 8.9
stable 8.9
country 8.8
fence 8.7
person 8.6
sunny 8.6
outside 8.6
sunrise 8.4
portrait 8.4
bridle 8.3
cowboy 8.1
male 8
natural 8
forest 7.8
destruction 7.8
people 7.8
adult 7.8
color 7.8
tent 7.8
western 7.7
fog 7.7
hovel 7.6
dusk 7.6
two 7.6
eating 7.6
eat 7.5
smoke 7.4
negative 7.4
protection 7.3
danger 7.3
dirty 7.2
hay 7.1
travel 7
agriculture 7

Google
created on 2022-02-26

Horse 97.9
Working animal 87
Black-and-white 83.1
Horse supplies 80.7
Tints and shades 77.2
Pack animal 75.9
Art 74.5
Bridle 73.2
Monochrome photography 71.2
Monochrome 70.1
Landscape 69.5
Tree 69.5
Mare 68
Livestock 67.5
Visual arts 66.5
Mane 65.8
Stallion 65.6
Horse tack 65.5
Room 64.1
Stock photography 62.7

Microsoft
created on 2022-02-26

text 98.2
outdoor 97.9
animal 63.8
black and white 63.2
horse 18.2

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 93%
Calm 100%
Sad 0%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Female, 97.3%
Happy 90.2%
Calm 3.1%
Surprised 2.6%
Sad 1.7%
Fear 1.2%
Angry 0.5%
Confused 0.5%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Horse 99.8%

Captions

Microsoft

a person standing next to a horse 83.2%
a person riding on the back of a horse 61.8%
a person standing in front of a horse 61.7%