Human Generated Data

Title

Coal miner's child, Omar, West Virginia

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3084

Human Generated Data

Title

Coal miner's child, Omar, West Virginia

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.7
Person 99.7
Clothing 97.5
Apparel 97.5
Face 95.1
Sleeve 93.7
Man 92.2
Home Decor 89.2
Linen 73.5
Photo 67.3
Portrait 67.3
Photography 67.3
Long Sleeve 61.3
Boy 56
Skin 55.1

Imagga
created on 2021-12-15

person 46
portrait 36.3
people 31.8
child 31
man 30.9
male 30.4
adolescent 29.2
adult 29.1
juvenile 28.6
smile 27.8
happy 27.6
face 22
one 20.9
world 19.6
smiling 19.5
happiness 18.8
lifestyle 18.1
handsome 17.8
looking 17.6
outdoors 16.4
boy 16.4
businessman 15.9
outdoor 15.3
suit 15.2
guy 15.1
clothing 15
model 14.8
business 14.6
human 14.3
attractive 14
standing 13.9
bow tie 13.8
kid 13.3
emotion 12.9
youth 12.8
casual 12.7
day 12.6
tie 12.4
cheerful 12.2
necktie 12.1
men 12
outside 12
expression 11.9
pretty 11.9
hair 11.9
children 11.8
park 11.5
sky 10.9
confident 10.9
cute 10.8
lady 10.6
corporate 10.3
alone 10.1
joy 10
black 10
fashion 9.8
office 9.6
brunette 9.6
women 9.5
friendly 9.1
leisure 9.1
girls 9.1
modern 9.1
look 8.8
love 8.7
thinking 8.5
garment 8.5
shirt 8.5
professional 8.4
summer 8.4
executive 8.3
student 8.2
active 8.1
life 8.1
success 8.1
family 8
grass 7.9
fresh 7.8
forest 7.8
elegant 7.7
confidence 7.7
health 7.6
serious 7.6
hand 7.6
head 7.6
kids 7.5
fun 7.5
building 7.1
autumn 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.7
human face 99.2
person 96.7
outdoor 96.6
portrait 95.9
clothing 94.3
man 90.6
standing 85.5
posing 74.5
boy 73.5
old 64.5
white 62.9
photograph 61.8
shirt 50
male 15.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-26
Gender Male, 87.9%
Calm 90%
Surprised 5.8%
Angry 1.6%
Sad 1.3%
Confused 0.5%
Fear 0.5%
Disgusted 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 11
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man posing for a photo 94.4%
a person posing for the camera 94.3%
a person standing posing for the camera 94%