Human Generated Data

Title

Rehabilitation client, Boone County, Arkansas
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3060

Human Generated Data

Title

Rehabilitation client, Boone County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3060

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Cow 98.9
Cattle 98.9
Mammal 98.9
Animal 98.9
Donkey 93.8

Clarifai
created on 2023-10-15

people 99.6
vintage 98.9
cavalry 97.9
mammal 97.8
man 97.2
two 96.9
farm 95.4
portrait 95
retro 94.4
three 92.5
group 91.9
one 91.5
monochrome 91.2
cattle 90.5
old 90.5
barn 90.5
adult 89.7
animal 89.2
lid 88.1
shed 86.9

Imagga
created on 2021-12-15

horse 57.5
animal 49.2
farm 41.9
cowboy 35.7
mammal 34.4
horses 34.1
pasture 32.6
rural 30
grass 29.3
animals 28.7
ranch 27.3
field 25.1
brown 23.6
mare 22.6
equine 22.3
livestock 20.2
saddle 19.9
stock saddle 18.2
stallion 17.6
mane 17.6
countryside 17.4
pen 17.3
country 16.7
grazing 16.7
wild 16.6
meadow 15.2
outdoors 14.9
bull 14.8
outdoor 14.5
enclosure 13.9
fence 13.7
equestrian 13.7
bridle 13.7
wildlife 13.4
trees 13.3
stable 12.8
cattle 12.4
outside 12
seat 11.7
plow 11
head 10.9
male 10.5
laborer 10.4
sport 9.9
herd 9.8
landscape 9.7
summer 9.6
safari 9.6
dirt 9.5
support 9.2
black 9
sky 8.9
horn 8.9
graze 8.9
scenic 8.8
riding 8.8
mammals 8.8
forest 8.7
standing 8.7
tool 8.3
domestic 8.1
natural 8
cow 7.9
agriculture 7.9
ungulate 7.9
farmland 7.7
eating 7.6
sunset 7.2
feed 7.1
day 7.1
barn 7.1
autumn 7

Google
created on 2021-12-15

Working animal 89.1
Hat 87.8
Adaptation 79.2
Snout 74
Landscape 73.5
Pack animal 72.7
Monochrome photography 70
Monochrome 69.1
Livestock 68.5
Sun hat 68.4
Event 67
Terrestrial animal 66.9
Bovine 64.3
Bull 62
Ox 59.6
Vintage clothing 58
Horn 57.2
Cowboy hat 56
Ranch 52.1
Cow-goat family 50.8

Microsoft
created on 2021-12-15

grass 99.5
outdoor 99.5
text 93.6
standing 93.2
cow 92.9
cattle 89.9
animal 88.9
mammal 85.6
clothing 71.9
bull 71
person 69.7
man 60.1
working animal 51.7
donkey 22.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 98.6%
Calm 94.4%
Sad 4%
Angry 1.2%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Cow 98.9%

Captions

Microsoft
created on 2021-12-15

a man standing next to a cow 89.2%
a cow standing next to a fence 79%
a man standing in front of a cow 78.9%