Human Generated Data

Title

Destitute tenant farmer's family, Ozark Mountains, Arkansas
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3068

Human Generated Data

Title

Destitute tenant farmer's family, Ozark Mountains, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3068

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 96.9
Human 96.9
Chair 94.9
Furniture 94.9
Sitting 82.9
Soil 77.6
Face 67
Clothing 61.3
Apparel 61.3
Photography 60.5
Photo 60.5
Portrait 58.8

Clarifai
created on 2023-10-15

people 100
adult 99.4
two 99.1
child 98.6
three 97.6
woman 97.5
man 96.4
portrait 96.2
monochrome 95.6
group 93.9
furniture 93.4
group together 92.7
sit 92.2
four 92
wear 91.8
one 91.6
offspring 90.8
son 89.3
boy 87.9
room 87.5

Imagga
created on 2021-12-15

dutch oven 49.4
oven 39.6
kitchen appliance 30
scale 22.6
home appliance 20.1
measuring instrument 18.9
old 18.1
sitting 16.3
bench 16.1
outdoors 14.9
man 14.1
instrument 13.3
person 13.2
people 12.3
building 12
child 11.8
male 10.8
wall 10.3
architecture 10.2
appliance 10
seller 9.8
portrait 9.7
home 9.6
happy 9.4
lifestyle 9.4
outdoor 9.2
adult 9.1
cooking utensil 8.7
pan 8.7
smiling 8.7
antique 8.7
ancient 8.6
park 8.2
time 8.2
retro 8.2
rural 7.9
couple 7.8
smile 7.8
attractive 7.7
elderly 7.7
garden 7.5
house 7.5
wood 7.5
vintage 7.4
style 7.4
pot 7.3
chair 7.3
black 7.2
vessel 7.2
art 7.2
family 7.1
rustic 7.1
face 7.1
day 7.1
happiness 7

Google
created on 2021-12-15

Black 89.7
Adaptation 79.3
Tints and shades 76.5
Vintage clothing 71.5
Monochrome photography 71.3
Monochrome 69.6
Sitting 67.9
Room 66.5
Stock photography 65.1
Classic 60.4
Comfort 57.1
History 56.6
Chair 54.9
Visual arts 54.1
Portrait 51.9
Still life photography 50.6

Microsoft
created on 2021-12-15

text 98.3
person 97.9
clothing 94.1
white goods 78.3
furniture 73.8
smile 69.3
black and white 58.5
old 43

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 91.4%
Sad 52.3%
Calm 46.9%
Angry 0.3%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 96.9%
Chair 94.9%

Categories

Imagga

paintings art 76.8%
people portraits 15.7%
streetview architecture 2.9%
pets animals 2.7%

Captions

Microsoft
created on 2021-12-15

a man sitting on top of a refrigerator 43.1%
a man sitting on a stove 43%
a man sitting in a kitchen 42.9%