Human Generated Data

Title

Dock Workers Enjoying Siesta, New York City
Date

c. 1922, printed later?
People

Artist: Lewis Wickes Hine, American 1874 - 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosemblum, P1979.73

Human Generated Data

Title

Dock Workers Enjoying Siesta, New York City

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

c. 1922, printed later?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Furniture 93.5
Person 91.9
Human 91.9
Clothing 71.9
Apparel 71.9
Couch 69.4
Officer 59.8
Military Uniform 59.8
Military 59.8
Bed 59.6
Soldier 56.6
Person 51.1
Person 50.1

Imagga
created on 2021-12-14

studio couch 64.4
sofa 52.7
convertible 51.4
cadaver 30.4
seat 29.2
furniture 27.4
home 26.3
bed 21.8
lying 21.6
litter 19.8
pillow 19.7
room 19.7
adult 19.4
bedroom 19.3
couch 19.3
person 18.8
people 17.3
attractive 16.8
interior 15.9
lifestyle 15.9
fashion 15.8
television 15.3
house 15
rest 14.4
relaxation 14.2
conveyance 14.2
blanket 13.6
portrait 13.6
male 13.5
man 13.4
comfortable 13.4
indoors 13.2
happy 13.2
body 12.8
sleep 12.6
relax 12.6
love 12.6
quilt 12.2
face 12.1
covered couch 12
pretty 11.9
stretcher 11.5
one 11.2
model 10.9
blond 10.8
cute 10.8
smile 10.7
child 10.5
modern 10.5
resting 10.5
couple 10.4
pillows 9.8
bedclothes 9.7
sexy 9.6
looking 9.6
apartment 9.6
smiling 9.4
floor 9.3
sleeping bag 9.1
bedding 8.9
hotel 8.6
design 8.5
relaxed 8.4
alone 8.2
style 8.2
decor 8
happiness 7.8
sleeping 7.8
comfort 7.7
casual 7.6
telecommunication system 7.6
joy 7.5
indoor 7.3
cloth covering 7.3
lady 7.3
decoration 7.3
relaxing 7.3
black 7.2
hair 7.1
women 7.1
family 7.1
kid 7.1
covering 7
architecture 7
together 7

Google
created on 2021-12-14

Black 89.5
Comfort 86
Motor vehicle 80.3
Art 74.7
Monochrome photography 67.7
Room 66.9
Vintage clothing 66.7
Sitting 63.8
Still life photography 63.7
Stock photography 63.2
Monochrome 60.5
Rectangle 59.5
History 57.9
Photographic paper 56
Advertising 54
Classic 52.3
Visual arts 51.8

Microsoft
created on 2021-12-14

arthropod 99.1
invertebrate 95.6
animal 94.5
person 90.6
text 90
clothing 75.1
crab 72.5
man 62.8
black and white 59.1
footwear 58.9

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Female, 53.5%
Calm 59.5%
Happy 22.8%
Sad 13.1%
Angry 2.5%
Fear 1.4%
Surprised 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 22-34
Gender Male, 93.5%
Sad 81.8%
Calm 15.9%
Confused 1.3%
Fear 0.3%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 36-52
Gender Male, 98.1%
Calm 92.3%
Happy 6%
Sad 0.9%
Surprised 0.2%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 23-37
Gender Male, 99.1%
Calm 67.3%
Angry 8.9%
Fear 7.7%
Disgusted 7%
Happy 5.4%
Sad 2.5%
Surprised 0.7%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.9%

Captions

Microsoft

a group of people sleeping on the floor 27.3%
a group of people sleeping on the ground 25.8%