Human Generated Data

Title

Destitute tenant farmer's family, Ozark Mountains, Arkansas
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3068

Human Generated Data

Title

Destitute tenant farmer's family, Ozark Mountains, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 96.9
Human 96.9
Chair 94.9
Furniture 94.9
Sitting 82.9
Soil 77.6
Face 67
Clothing 61.3
Apparel 61.3
Photo 60.5
Photography 60.5
Portrait 58.8

Imagga
created on 2021-12-15

dutch oven 49.4
oven 39.6
kitchen appliance 30
scale 22.6
home appliance 20.1
measuring instrument 18.9
old 18.1
sitting 16.3
bench 16.1
outdoors 14.9
man 14.1
instrument 13.3
person 13.2
people 12.3
building 12
child 11.8
male 10.8
wall 10.3
architecture 10.2
appliance 10
seller 9.8
portrait 9.7
home 9.6
happy 9.4
lifestyle 9.4
outdoor 9.2
adult 9.1
cooking utensil 8.7
pan 8.7
smiling 8.7
antique 8.7
ancient 8.6
park 8.2
time 8.2
retro 8.2
rural 7.9
couple 7.8
smile 7.8
attractive 7.7
elderly 7.7
garden 7.5
house 7.5
wood 7.5
vintage 7.4
style 7.4
pot 7.3
chair 7.3
black 7.2
vessel 7.2
art 7.2
family 7.1
rustic 7.1
face 7.1
day 7.1
happiness 7

Google
created on 2021-12-15

Black 89.7
Adaptation 79.3
Tints and shades 76.5
Vintage clothing 71.5
Monochrome photography 71.3
Monochrome 69.6
Sitting 67.9
Room 66.5
Stock photography 65.1
Classic 60.4
Comfort 57.1
History 56.6
Chair 54.9
Visual arts 54.1
Portrait 51.9
Still life photography 50.6

Microsoft
created on 2021-12-15

text 98.3
person 97.9
clothing 94.1
white goods 78.3
furniture 73.8
smile 69.3
black and white 58.5
old 43

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 91.4%
Sad 52.3%
Calm 46.9%
Angry 0.3%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Chair 94.9%

Captions

Microsoft

a man sitting on top of a refrigerator 43.1%
a man sitting on a stove 43%
a man sitting in a kitchen 42.9%