Human Generated Data

Title

Scene in Smithland, Kentucky, man, woman and child
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3076

Human Generated Data

Title

Scene in Smithland, Kentucky, man, woman and child

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3076

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Hat 99.6
Person 99.6
Face 88.7
Person 71.7
People 68.3
Cap 67.6
Sun Hat 59.8
Finger 59.5
Portrait 58.5
Photography 58.5
Photo 58.5

Clarifai
created on 2023-10-15

people 99.8
portrait 99.6
lid 99.6
monochrome 99.1
adult 97.6
veil 97.5
three 97.1
man 97
two 96
group 95
woman 94.9
group together 92.9
child 91.9
four 91.1
street 90.8
facial expression 90.7
wear 89.3
nostalgia 88.4
son 88.1
offspring 87

Imagga
created on 2021-12-15

nurse 37.8
man 34.3
adult 33
hat 30.8
people 30.7
person 29.5
attractive 27.3
male 27
happy 26.3
portrait 25.9
couple 25.3
clothing 23.5
smiling 22.4
smile 22.1
face 21.3
love 21.3
looking 18.4
pretty 17.5
brunette 17.4
happiness 17.2
one 16.4
hand 15.2
women 15
cowboy hat 14.7
black 14.5
casual 14.4
lifestyle 13.7
cute 13.6
headdress 12.9
bow tie 12.9
men 12.9
hair 12.7
professional 11.9
family 11.6
business 11.5
together 11.4
necktie 11.3
fashion 11.3
standing 11.3
worker 11.3
sexy 11.2
relationship 11.2
child 10.9
holding 10.7
single 10.7
cheerful 10.6
covering 10.4
20s 10.1
dress 9.9
attendant 9.9
romance 9.8
handsome 9.8
indoors 9.7
boy 9.6
loving 9.5
garment 9.5
expression 9.4
youth 9.4
camera 9.2
suit 9.2
costume 9.1
close 9.1
human 9
fun 9
color 8.9
success 8.8
working 8.8
home 8.8
lab coat 8.7
husband 8.7
work 8.6
formal 8.6
waiter 8.6
coat 8.5
marriage 8.5
two 8.5
sibling 8.3
emotion 8.3
friendly 8.2
confident 8.2
businesswoman 8.2
lady 8.1
team 8.1
mask 7.9
day 7.8
model 7.8
boyfriend 7.7
girlfriend 7.7
diversity 7.7
employee 7.7
bride 7.7
wife 7.6
females 7.6
togetherness 7.5
joy 7.5
shirt 7.5
glasses 7.4
joyful 7.3
consumer goods 7.3
alone 7.3
teenager 7.3
office 7.2
kid 7.1
look 7

Google
created on 2021-12-15

Outerwear 95.4
Photograph 94.2
White 92.2
Black 89.7
Hat 88.9
Cap 85.8
Style 83.9
Black-and-white 83.7
Headgear 82.6
Sun hat 78.4
Snapshot 74.3
Monochrome photography 73.5
Monochrome 73.2
Fedora 72.6
Vintage clothing 71.2
Stock photography 63
Art 60.9
Room 60.8
Window 59.1
Street fashion 57.3

Microsoft
created on 2021-12-15

hat 99.9
fashion accessory 99.9
human face 97.7
fedora 97.5
clothing 97.2
person 96.9
sun hat 95.2
cowboy hat 94
window 93.3
text 93.2
posing 77.4
white 74.3
man 67.8
headgear 62.7
smile 61.3
people 57
old 42.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Male, 98.2%
Calm 85%
Angry 9.1%
Confused 4.1%
Sad 1.3%
Surprised 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 20-32
Gender Female, 58%
Angry 90%
Calm 8.7%
Sad 0.5%
Confused 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 99.6%

Categories

Imagga

people portraits 96.8%
paintings art 3.1%

Text analysis

Amazon

SODA
A
GEM
its

Google

SUDA GEM
SUDA
GEM