Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3166
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3166

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
People 99
Person 98.5
Adult 98.5
Female 98.5
Woman 98.5
Person 97.7
Boy 97.7
Child 97.7
Male 97.7
Plant 95.4
Vegetation 95.4
Outdoors 88.1
Person 79.1
Nature 76.9
Backyard 72
Yard 72
Tree 57.4
Ball 57.2
Football 57.2
Soccer 57.2
Soccer Ball 57.2
Sport 57.2
Clothing 56.9
Dress 56.9
Flower 56.5
Happy 56.1
Smile 56.1
Architecture 56
Building 56
Shelter 56
Soil 55.7
Food 55.3
Fruit 55.3
Produce 55.3
Hippie 55.2
Tent 55.1

Clarifai
created on 2018-05-10

people 100
child 99.9
two 99.3
baby 98.9
adult 98.4
offspring 98.4
group 97.5
son 96.9
family 96.3
three 96
portrait 95.6
facial expression 95.5
wear 94.8
sit 94.1
sibling 93.9
war 91.9
canine 90.1
administration 87
one 86.2
four 82.9

Imagga
created on 2023-10-06

parent 55.7
mother 51.7
kin 48.1
child 42.3
family 41.8
outdoors 37.3
happy 36.4
park 36.3
senior 31.9
love 30.8
man 30.3
together 29.8
smiling 29.7
people 29
happiness 29
grandma 29
father 28.2
portrait 27.2
couple 27
grandfather 25.7
male 25.2
smile 22.8
adult 22.7
dad 22.5
lifestyle 21.7
fun 20.2
laughing 19.9
togetherness 18.9
childhood 18.8
mature 18.6
garden 18.5
joy 18.4
daughter 18.4
affection 18.4
leisure 18.3
grass 18.2
summer 18
kid 17.7
outdoor 17.6
retired 17.5
son 17
girls 16.4
outside 16.3
cheerful 16.3
day 15.7
retirement 15.4
husband 15.3
two 15.3
enjoying 15.2
women 15
relationship 15
boy 14.8
person 14.5
elderly 14.4
healthy 13.9
children 13.7
wife 13.3
old 13.2
autumn 13.2
countryside 11.9
face 11.4
kids 11.3
blond 11.3
casual 11
relaxing 10.9
cute 10.8
married 10.6
loving 10.5
females 10.4
camera 10.2
aged 10
meadow 9.9
romance 9.8
vacation 9.8
60s 9.8
embracing 9.8
affectionate 9.7
forest 9.6
walk 9.5
adults 9.5
sitting 9.5
friends 9.4
holding 9.1
fall 9.1
world 9
romantic 8.9
families 8.9
little 8.8
life 8.8
men 8.6
walking 8.5
clothing 8.5
friendship 8.4
attractive 8.4
relaxation 8.4
joyful 8.3
pensioner 8.2
playing 8.2
grandchild 7.9
granddaughter 7.9
grandparent 7.9
spring 7.9
50s 7.8
grandmother 7.8
sister 7.8
season 7.8
boys 7.8
hug 7.8
generation 7.7
sibling 7.6
brother 7.5
group 7.3
looking 7.2
active 7.2
hair 7.1
pretty 7

Google
created on 2018-05-10

people 97.5
photograph 96.2
black and white 93.4
person 92.4
monochrome photography 88.1
snapshot 81.8
child 81.4
standing 79.4
family 77.3
monochrome 71.1
interaction 69.5
human 68.7
tree 65.2
vintage clothing 63.7
stock photography 58.8
human behavior 58.3
smile 54.2

Microsoft
created on 2018-05-10

outdoor 100
person 99.5
tree 98.2
black 69.2
old 64.5
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Female, 100%
Sad 99.9%
Calm 19.2%
Surprised 6.3%
Fear 6.2%
Confused 5.1%
Disgusted 0.3%
Happy 0.3%
Angry 0.1%

AWS Rekognition

Age 1-7
Gender Male, 99.6%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 4%
Calm 2.4%
Confused 0.2%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Adult 98.5%
Female 98.5%
Woman 98.5%
Boy 97.7%
Child 97.7%
Male 97.7%

Categories

Imagga

people portraits 59.6%
pets animals 17.1%
paintings art 14.3%
nature landscape 8.8%