Human Generated Data

Title

Two children in a window, Pittsburgh, Pennsylvania
Date

1907-1908, printed later?
People

Artist: Lewis Wickes Hine, American 1874 - 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosemblum, P1979.70

Human Generated Data

Title

Two children in a window, Pittsburgh, Pennsylvania

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1907-1908, printed later?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.1
Person 99.1
Person 98.4
Baby 90.1
Face 87.9
Window 83.7
Brick 71.4
Apparel 69.6
Clothing 69.6
Plant 66.4
People 64.5
Kid 58.9
Child 58.9
Door 57
Porch 55.7

Imagga
created on 2021-12-14

old 28.6
building 24.8
parent 24
sill 21.7
wall 21.6
mother 21.6
architecture 21.1
kin 21
ancient 19.9
door 19.3
child 17.4
brick 16.6
structural member 16.3
dad 14.5
stone 14.3
house 14.2
city 14.1
history 12.5
window 12.1
father 11.6
tourism 11.5
support 11.5
antique 11.3
culture 11.1
statue 10.9
vintage 10.8
portrait 10.4
grunge 10.2
historic 10.1
man 10.1
people 10
person 9.7
adult 9.7
entrance 9.7
device 9.7
groom 9.4
monument 9.3
travel 9.2
structure 9.1
landmark 9
religion 9
outdoors 9
windows 8.6
sculpture 8.6
construction 8.6
male 8.5
famous 8.4
exterior 8.3
aged 8.1
face 7.8
palace 7.7
outside 7.7
attractive 7.7
historical 7.5
traditional 7.5
classic 7.4
style 7.4
tradition 7.4
retro 7.4
street 7.4
world 7.3
dirty 7.2
black 7.2
happiness 7.1

Google
created on 2021-12-14

Black 89.7
Window 86.7
Rectangle 85.9
Black-and-white 85.4
Wood 84.4
Style 84
Line 81.6
Wall 81.5
Toddler 80.6
Monochrome 78.3
Monochrome photography 78.1
Baby 78
Tints and shades 76.8
Beauty 75.1
Art 69.9
Sitting 67.7
Room 66.6
Vintage clothing 64.9
Stock photography 63.7
Child 63.6

Microsoft
created on 2021-12-14

building 99.7
window 98.9
human face 98.1
outdoor 98
person 96.9
toddler 95.9
baby 94.7
clothing 88
black and white 87.9
child 87.8
boy 86.4
black 77
white 64
smile 59.9
old 52.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 91.7%
Happy 99.9%
Calm 0.1%
Confused 0%
Surprised 0%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Male, 95.8%
Happy 73.6%
Calm 24.1%
Confused 0.9%
Surprised 0.4%
Angry 0.4%
Sad 0.3%
Disgusted 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a man sitting in front of a window 91.5%
a man standing in front of a window 91.4%
a man sitting in front of a window posing for the camera 87.3%