Human Generated Data

Title

Untitled (children of miners working in Sunbeam Mines, Scotts Run, West Virginia)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3354
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (children of miners working in Sunbeam Mines, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3354

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Shorts 100
Person 99.5
Boy 99.5
Child 99.5
Male 99.5
Pants 99.4
Person 99.4
Boy 99.4
Child 99.4
Male 99.4
Grass 87.5
Plant 87.5
Backyard 87.3
Nature 87.3
Outdoors 87.3
Yard 87.3
Vest 74.5
Body Part 62
Hand 62
Coat 61.2
Jacket 57.9
Wood 57.9
Finger 57.4
Knitwear 56.3
Sweater 56.3
Garden 56
Furniture 55.8
Happy 55.2
Smile 55.2

Clarifai
created on 2018-05-10

people 100
child 99.9
boy 98.9
group 98
son 97.5
sibling 97.4
offspring 97.2
war 96.5
two 95.7
portrait 95.6
family 95.4
wear 95.3
group together 94.7
adult 94.2
facial expression 94.1
man 92.5
military 90.9
outfit 90.1
administration 90
three 88.6

Imagga
created on 2023-10-05

child 44.5
kin 43.5
outdoors 33.6
people 31.8
family 29.4
happiness 27.4
male 26
parent 25.7
mother 24.6
man 23.5
adult 22.6
person 22
love 21.3
kid 20.4
portrait 20.1
park 19.8
happy 19.4
boy 19.1
together 18.4
outdoor 18.3
sibling 18.3
walking 18
autumn 17.6
lifestyle 17.3
children 17.3
outside 17.1
world 17.1
smiling 16.6
couple 16.6
day 16.5
girls 16.4
fun 15.7
daughter 15.5
summer 15.4
two 14.4
son 14.3
human 14.2
life 13.6
grass 13.4
childhood 13.4
joy 13.4
walk 13.3
togetherness 13.2
father 13.1
women 12.7
leisure 12.5
cheerful 12.2
men 12
dad 11.8
beach 11.8
vacation 11.5
smile 11.4
relationship 11.2
holding 10.7
full length 10.7
active 9.9
sunset 9.9
clothing 9.7
hair 9.5
enjoying 9.5
kids 9.4
cute 9.3
casual 9.3
offspring 9.2
countryside 9.1
fall 9
recreation 9
sky 8.9
healthy 8.8
face 8.5
youth 8.5
females 8.5
senior 8.4
field 8.4
exercise 8.2
forest 7.8
season 7.8
affectionate 7.7
attractive 7.7
running 7.7
toddler 7.6
husband 7.6
tool 7.6
relaxation 7.5
rest 7.4
sport 7.4
juvenile 7.4
sun 7.2
romantic 7.1
grandfather 7.1
little 7.1

Google
created on 2018-05-10

people 96.4
photograph 96.3
black and white 93.4
person 93.3
standing 91.7
monochrome photography 88.3
sitting 86.5
child 83.4
photography 82.8
snapshot 81.8
male 80.6
family 76
vintage clothing 73
monochrome 71.9
human behavior 66.5
smile 53.6
stock photography 52.2
winter 50.6
tree 50.2

Microsoft
created on 2018-05-10

person 98.7
grass 98.4
outdoor 96
standing 95.9
posing 82
white 74.4
black 71.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 92%
Calm 83.6%
Happy 7.5%
Surprised 6.6%
Fear 6.2%
Sad 2.9%
Angry 2.7%
Confused 1.4%
Disgusted 1.2%

AWS Rekognition

Age 16-22
Gender Female, 99.9%
Sad 93.6%
Happy 36.5%
Fear 8.5%
Surprised 6.6%
Calm 4.3%
Angry 2.7%
Confused 2.3%
Disgusted 2.1%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Boy 99.5%
Child 99.5%
Male 99.5%
Coat 61.2%

Categories

Imagga

streetview architecture 84.9%
paintings art 10.6%
nature landscape 2.3%