Human Generated Data

Title

Rehabilitation client, Boone County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3060

Human Generated Data

Title

Rehabilitation client, Boone County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Cow 98.9
Cattle 98.9
Mammal 98.9
Animal 98.9
Donkey 93.8

Imagga
created on 2021-12-15

horse 57.5
animal 49.2
farm 41.9
cowboy 35.7
mammal 34.4
horses 34.1
pasture 32.6
rural 30
grass 29.3
animals 28.7
ranch 27.3
field 25.1
brown 23.6
mare 22.6
equine 22.3
livestock 20.2
saddle 19.9
stock saddle 18.2
stallion 17.6
mane 17.6
countryside 17.4
pen 17.3
country 16.7
grazing 16.7
wild 16.6
meadow 15.2
outdoors 14.9
bull 14.8
outdoor 14.5
enclosure 13.9
fence 13.7
equestrian 13.7
bridle 13.7
wildlife 13.4
trees 13.3
stable 12.8
cattle 12.4
outside 12
seat 11.7
plow 11
head 10.9
male 10.5
laborer 10.4
sport 9.9
herd 9.8
landscape 9.7
summer 9.6
safari 9.6
dirt 9.5
support 9.2
black 9
sky 8.9
horn 8.9
graze 8.9
scenic 8.8
riding 8.8
mammals 8.8
forest 8.7
standing 8.7
tool 8.3
domestic 8.1
natural 8
cow 7.9
agriculture 7.9
ungulate 7.9
farmland 7.7
eating 7.6
sunset 7.2
feed 7.1
day 7.1
barn 7.1
autumn 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

grass 99.5
outdoor 99.5
text 93.6
standing 93.2
cow 92.9
cattle 89.9
animal 88.9
mammal 85.6
clothing 71.9
bull 71
person 69.7
man 60.1
working animal 51.7
donkey 22.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 98.6%
Calm 94.4%
Sad 4%
Angry 1.2%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Cow 98.9%

Captions

Microsoft

a man standing next to a cow 89.2%
a cow standing next to a fence 79%
a man standing in front of a cow 78.9%