Human Generated Data

Title

Untitled (New Deal Inn, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3190

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New Deal Inn, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3190

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Clothing 99.9
Hat 99.9
People 99.9
Coat 99.5
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Person 99.2
Cap 87.3
Jacket 75.4
Person 66.3
Male 66.3
Boy 66.3
Child 66.3
Bonnet 61.6
Dress 57.5
Baby 56.7
Newborn 56.7
Lady 56.3
Formal Wear 56.1
Suit 56.1
Baseball Cap 56
Body Part 55.4
Finger 55.4
Hand 55.4

Clarifai
created on 2018-05-10

people 100
child 99.7
offspring 99.4
group 99.4
two 99.3
adult 98.9
facial expression 98.8
son 98.1
wear 98.1
portrait 97.6
baby 97.2
three 96.6
actress 95.7
administration 95.3
sibling 95.2
family 94.9
woman 93.6
man 92.3
leader 91.9
actor 90.3

Imagga
created on 2023-10-06

kin 75.4
mother 42.3
couple 33.1
happy 32.6
parent 32.2
portrait 29.8
people 29
happiness 29
love 28.4
man 28.2
family 26.7
male 26.5
dress 26.2
smiling 23.9
adult 23.3
groom 22.6
child 20.8
smile 20.7
father 20.4
bride 20.1
sibling 19.9
wedding 18.4
person 18
together 17.5
attractive 17.5
married 17.3
daughter 16.2
home 16
husband 14.7
cheerful 14.6
women 14.2
men 13.7
fashion 13.6
two 13.6
lifestyle 13
looking 12.8
celebration 12.8
old 12.5
marriage 12.3
wife 12.3
relationship 12.2
face 12.1
sitting 12
dad 12
hair 11.9
casual 11.9
brother 11.9
cute 11.5
senior 11.2
elegance 10.9
joy 10.9
romantic 10.7
lady 10.6
human 10.5
pretty 10.5
boy 10.4
expression 10.2
handsome 9.8
indoors 9.7
sexy 9.6
togetherness 9.4
bouquet 9.4
culture 9.4
suit 9.2
traditional 9.2
son 9.1
children 9.1
veil 8.8
brunette 8.7
enjoying 8.5
fun 8.2
outdoors 8.2
girls 8.2
gorgeous 8.2
clothing 8.2
romance 8
kid 8
decoration 8
look 7.9
standing 7.8
black 7.8
gown 7.8
modern 7.7
youth 7.7
elderly 7.7
holding 7.4
joyful 7.4
20s 7.3
color 7.2
posing 7.1
interior 7.1
model 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.7
military uniform 83.2
old 68.9
posing 46
older 22.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Female, 99.4%
Sad 80.3%
Calm 51.2%
Surprised 8%
Fear 6.5%
Confused 3%
Disgusted 2.1%
Angry 1.5%
Happy 1.2%

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Male, 99.6%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Adult 99.4%
Male 99.4%
Man 99.4%
Boy 66.3%
Child 66.3%

Categories

Imagga

paintings art 63.3%
people portraits 36.5%

Text analysis

Amazon

P