Human Generated Data

Title

Untitled (rehabilitation client, Maria Plantation, Ozarks, Arkansas)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3163
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (rehabilitation client, Maria Plantation, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3163

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Face 100
Head 100
Photography 100
Portrait 100
Accessories 100
Earring 100
Jewelry 100
Blouse 99.9
Clothing 99.9
Person 99.2
Baby 99.2
Person 98.9
Necklace 98.6
Happy 94.1
Body Part 91
Mouth 91
Teeth 91
Smile 86.1
Lady 83.5
Laughing 77.3
Glasses 56.1
Finger 55.8
Hand 55.8
Cross 55.7
Symbol 55.7
T-Shirt 55.5

Clarifai
created on 2018-05-10

people 99.9
two 99.4
adult 98.8
man 98.7
portrait 97.8
woman 95.1
monochrome 91.4
three 90.8
facial expression 90.2
affection 89.9
interaction 88.3
elderly 87.2
family 86.4
love 85.6
wear 84.9
group 84.6
one 83.2
actor 82.4
music 81.3
actress 78

Imagga
created on 2023-10-07

grandma 60.8
couple 50.6
mother 44.6
senior 44.1
male 41.1
man 41
love 38.7
parent 38.4
people 36.3
husband 35.5
happy 35.1
elderly 32.6
together 32.4
mature 31.6
wife 29.4
grandfather 28.2
portrait 27.2
happiness 25.9
old 25.8
adult 25.3
retired 24.3
lifestyle 23.9
person 23.2
family 23.1
smile 22.8
grandmother 22.5
two 22
married 21.1
smiling 21
retirement 20.2
hair 19.8
affection 19.3
home 18.4
romantic 16.9
gray 16.2
handsome 16.1
affectionate 15.5
lady 15.4
loving 15.3
romance 15.2
relationship 15
attractive 14.7
marriage 14.3
togetherness 14.2
daughter 13.9
father 13.7
kin 13
glasses 13
face 12.8
embracing 12.7
pretty 12.6
dad 12.3
cheerful 12.2
blond 11.7
hug 11.6
aging 11.5
park 10.7
older 10.7
child 10.6
indoors 10.5
fun 10.5
outdoors 10.5
looking 10.4
women 10.3
pensioner 10.2
joy 10
closeness 9.9
hugging 9.8
pair 9.5
health 9
healthy 8.8
embrace 8.8
eyes 8.6
sitting 8.6
age 8.6
close 8.6
females 8.5
casual 8.5
human 8.3
care 8.2
relaxing 8.2
aged 8.2
sexy 8
granddaughter 7.9
look 7.9
grandparent 7.9
60s 7.8
kiss 7.8
model 7.8
lovers 7.7
men 7.7
laugh 7.7
relax 7.6
laughing 7.6
friendship 7.5
girls 7.3
day 7.1

Google
created on 2018-05-10

photograph 96.1
person 93.8
human behavior 83.1
vintage clothing 82
snapshot 81.8
standing 80.6
portrait 77.5
human 71.9
black and white 64.3
girl 63.1
smile 59.9
child 58.4
grandparent 57.4
retro style 56.8
senior citizen 55.4
visual arts 50

Microsoft
created on 2018-05-10

person 99.8
old 40.2
older 22.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-53
Gender Female, 99.9%
Happy 95.8%
Surprised 6.5%
Fear 6.1%
Sad 2.6%
Disgusted 0.7%
Calm 0.5%
Confused 0.4%
Angry 0.2%

AWS Rekognition

Age 2-10
Gender Female, 84%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Angry 0%
Disgusted 0%
Calm 0%
Happy 0%

Microsoft Cognitive Services

Age 46
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Baby 99.2%

Categories

Imagga

people portraits 64.3%
events parties 18.5%
paintings art 14.3%
pets animals 1.2%

Captions

Microsoft
created on 2018-05-10

a person talking on a cell phone 41.5%
a person talking on a cell phone 41.4%