Human Generated Data

Title

Untitled (children of rehabilitation clients, Maria Plantation, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3165
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (children of rehabilitation clients, Maria Plantation, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3165

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Barefoot 100
Body Part 99.9
Finger 99.9
Hand 99.9
Wood 99.9
Person 99.4
Boy 99.4
Child 99.4
Male 99.4
Person 98.8
Boy 98.8
Child 98.8
Male 98.8
Sitting 89.8
Clothing 57.8
Hat 57.8
Floor 56.4
Pants 56.2
Hardwood 55
Plywood 55

Clarifai
created on 2018-05-10

people 100
child 100
son 99.1
sit 98.4
two 98.4
group 97.2
boy 96.8
offspring 96.7
three 96.2
baby 96
portrait 96
sibling 94.8
four 94.4
family 93.2
adult 90.5
wear 88.4
facial expression 87.7
sitting 85.6
man 85.1
recreation 84.1

Imagga
created on 2023-10-05

child 46.9
kin 44
mother 30
parent 28
happy 25.7
family 24.9
people 24.5
portrait 23.9
happiness 22.7
male 21.7
sitting 20.6
kid 20.4
outdoors 20.2
cute 20.1
sibling 20
father 19.9
adult 19.4
fun 18.7
person 18.6
bench 18.4
man 17.5
lifestyle 17.3
daughter 16.8
smiling 16.6
smile 16.4
dad 16
little 15.9
love 15.8
face 15.6
childhood 15.2
casual 14.4
old 13.9
boy 13.9
couple 13.1
cheerful 13
outside 12.8
girls 12.8
joy 12.5
leisure 12.5
park 12.3
togetherness 12.3
summer 12.2
park bench 12.1
outdoor 11.5
husband 11.4
together 11.4
seat 11.1
day 11
children 10.9
baby 10.5
looking 10.4
autumn 9.7
home 9.6
laughing 9.4
youth 9.4
relationship 9.4
two 9.3
adorable 9.2
city 9.1
alone 9.1
black 9
religion 9
one 9
hair 8.7
son 8.6
statue 8.6
wall 8.6
wife 8.5
enjoying 8.5
pretty 8.4
fashion 8.3
handsome 8
women 7.9
eyes 7.7
lonely 7.7
culture 7.7
married 7.7
garden 7.5
relaxation 7.5
wood 7.5
senior 7.5
human 7.5
friendship 7.5
care 7.4
teen 7.3
world 7.3
playing 7.3
brother 7.2
dress 7.2

Google
created on 2018-05-10

photograph 96.2
black and white 94
sitting 94
person 93.9
child 88.9
monochrome photography 88.7
human behavior 84.5
photography 82.4
snapshot 81.8
standing 79.1
monochrome 72.6
vintage clothing 63.5
stock photography 61.4
girl 60.8

Microsoft
created on 2018-05-10

person 98.2
outdoor 97.7
boy 75.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Calm 40%
Sad 37.2%
Happy 21.3%
Confused 9.4%
Surprised 7%
Fear 6.1%
Angry 2.9%
Disgusted 1.2%

AWS Rekognition

Age 4-10
Gender Male, 99.4%
Calm 95.1%
Surprised 6.3%
Fear 5.9%
Sad 3.7%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Boy 99.4%
Child 99.4%
Male 99.4%

Categories

Imagga

paintings art 97.3%
people portraits 2.5%

Captions

Microsoft
created on 2018-05-10

a boy sitting on a bench 54.7%
a young boy sitting on a bench 44.9%
a little boy sitting on a bench 41.7%