Human Generated Data

Title

Untitled (family on relief, near Urbana, Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.62
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (family on relief, near Urbana, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.62

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Adult 99.8
Female 99.8
Person 99.8
Woman 99.8
Person 99.3
Boy 99.3
Male 99.3
Teen 99.3
Face 94.8
Head 94.8
Clothing 87.3
Hat 87.3
Door 77.3
Outdoors 71.6
Electronics 69.1
Phone 69.1
Accessories 60.2
Jewelry 60.2
Necklace 60.2
Blouse 57.8
Lady 57.6
Architecture 57.4
Building 57.4
Shelter 57.4
Photography 57.2
Portrait 57.2
Body Part 56.9
Finger 56.9
Hand 56.9
Mobile Phone 56.4
Reading 55.9
Smoke 55.7
Countryside 55.5
Nature 55.5

Clarifai
created on 2018-05-11

people 100
adult 98.6
child 97.5
two 97.5
wear 96.6
one 95.2
group 95.2
woman 94.4
three 90.3
furniture 88.4
doorway 87.8
home 87.7
four 86.6
administration 86.6
portrait 86.3
war 84
man 83.2
offspring 82.3
group together 81.3
music 81.1

Imagga
created on 2023-10-05

door 27
old 25.8
wall 25
device 24.7
call 23
guillotine 22.8
house 21.7
building 20.9
window 19.1
instrument of execution 19
architecture 18.7
cell 16.7
instrument 15.7
ancient 15.6
stone 14.3
window screen 14.1
vintage 14.1
home 13.6
person 13.5
history 13.4
entrance 12.6
wood 12.5
pretty 11.9
antique 11.2
historic 11
aged 10.9
doorway 10.8
screen 10.7
texture 10.4
portrait 10.4
adult 10.3
construction 10.3
cute 10
people 10
brick 9.7
wooden 9.7
black 9.6
brown 9.6
happy 9.4
telephone 9.3
smile 9.3
attractive 9.1
protective covering 8.9
lady 8.9
detail 8.8
pay-phone 8.8
structure 8.3
emotion 8.3
exterior 8.3
fashion 8.3
structural member 8.2
hair 7.9
jamb 7.6
elegance 7.6
child 7.5
city 7.5
retro 7.4
street 7.4
alone 7.3
face 7.1
interior 7.1

Google
created on 2018-05-11

photograph 95.7
black 95.1
black and white 87.5
standing 82.6
snapshot 81.8
monochrome photography 74.5
child 74.1
girl 69.8
monochrome 60.9
vintage clothing 57.3
human behavior 55

Microsoft
created on 2018-05-11

person 99.6
standing 76.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Female, 99.6%
Angry 90.4%
Surprised 6.4%
Fear 6.3%
Calm 4.3%
Sad 3.2%
Happy 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Male, 88.5%
Sad 98.2%
Calm 21.9%
Confused 11.1%
Fear 7.4%
Surprised 6.8%
Disgusted 3.9%
Angry 3%
Happy 0.8%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.8%
Female 99.8%
Person 99.8%
Woman 99.8%
Boy 99.3%
Male 99.3%
Teen 99.3%