Human Generated Data

Title

Untitled (children of rehabilitation clients, Maria Plantation, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1976.121

Human Generated Data

Title

Untitled (children of rehabilitation clients, Maria Plantation, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1976.121

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Wood 100
Face 100
Head 100
Photography 100
Portrait 100
Body Part 99.7
Finger 99.7
Hand 99.7
Person 99.4
Boy 99.4
Child 99.4
Male 99.4
Hardwood 99.3
Person 99.2
Boy 99.2
Child 99.2
Male 99.2
Floor 99.1
Plywood 99
Flooring 98.1
Clothing 97.7
Hat 97.7
Sitting 91.6
Pants 84.6
Outdoors 60.4
Barefoot 57.7
Happy 56.9
Smile 56.9
Furniture 56
Dress 55.8
Architecture 55.6
Building 55.6
House 55.6
Housing 55.6
Porch 55.6
Dining Table 55
Table 55

Clarifai
created on 2018-05-10

people 100
child 100
two 99
portrait 97.8
group 97.7
sibling 97.6
offspring 97.5
three 97.4
son 97.4
sit 97.3
four 95.9
boy 95.6
facial expression 94.6
family 92.5
furniture 92
adult 91.6
baby 91.5
wear 91.3
actress 88.7
group together 85.9

Imagga
created on 2023-10-07

kin 77
child 39
parent 33.9
happy 32
mother 31.3
happiness 30.6
male 28.8
family 28.5
father 27.3
man 26.9
people 26.2
dad 25
sitting 24.9
love 24.5
couple 24.4
adult 23.9
portrait 23.3
lifestyle 23.1
casual 22
boy 19.1
bench 19.1
smiling 18.8
fun 18.7
cute 18.7
husband 18.1
attractive 16.8
outdoors 16.4
couch 16.4
together 15.8
home 15.2
smile 15
face 14.2
joy 14.2
kid 14.2
cheerful 13.8
two 13.6
daughter 13.3
leisure 13.3
wife 13.3
togetherness 13.2
park bench 13
sibling 12.9
childhood 12.5
married 12.5
little 12.4
person 12.3
dress 11.7
looking 11.2
hair 11.1
relaxation 10.9
baby 10.4
sit 10.4
relaxed 10.3
relationship 10.3
summer 10.3
day 10.2
seat 10.2
girls 10
outdoor 9.9
handsome 9.8
fashion 9.8
old 9.8
son 9.6
loving 9.5
outside 9.4
enjoy 9.4
youth 9.4
adorable 9.2
indoor 9.1
teenager 9.1
pretty 9.1
caring 8.8
women 8.7
jeans 8.6
enjoying 8.5
enjoyment 8.4
black 8.4
house 8.4
color 8.3
teen 8.3
park 8.2
one 8.2
playing 8.2
children 8.2
sensuality 8.2
lady 8.1
group 8.1
clothing 8.1
romance 8
romantic 8
boys 7.8
laughing 7.6
pair 7.6
kids 7.5
senior 7.5
room 7.4
relaxing 7.3
sexy 7.2
active 7.2

Google
created on 2018-05-10

photograph 96.3
sitting 93.4
black and white 93.2
person 92.5
monochrome photography 86.3
standing 85.7
human behavior 83.9
child 83.2
snapshot 81.8
photography 81.6
monochrome 73.3
vintage clothing 71
picture frame 68.4
human 68
girl 63.3
stock photography 61.6
portrait 52.5

Microsoft
created on 2018-05-10

sitting 98.6
outdoor 97.7
person 94.3
boy 76.6
ledge 51.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Male, 99.9%
Happy 54.5%
Calm 31.8%
Surprised 6.8%
Fear 6%
Sad 4.5%
Confused 3.3%
Angry 2.6%
Disgusted 0.9%

AWS Rekognition

Age 6-14
Gender Male, 99.5%
Sad 99.8%
Calm 27.5%
Surprised 6.4%
Fear 6.2%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Boy 99.4%
Child 99.4%
Male 99.4%

Categories

Imagga

people portraits 82.8%
paintings art 14.7%
pets animals 2%

Captions

Microsoft
created on 2018-05-10

a boy sitting on a bench 69.5%
a young boy sitting on a bench 60.4%
a little boy sitting on a bench 58.6%