Human Generated Data

Title

Housing, Conditions: United States. Pennsylvania. Pittsburgh. Pittsburgh Survey: Braddock: Willow Alley Rubbish.
Date

1907-1908
People

Artist: Lewis Wickes Hine, American 1874 - 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.6

Human Generated Data

Title

Housing, Conditions: United States. Pennsylvania. Pittsburgh. Pittsburgh Survey: Braddock: Willow Alley Rubbish.

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1907-1908

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.6

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Soil 100
People 100
Person 98.7
Boy 98.7
Child 98.7
Male 98.7
Person 98.4
Male 98.4
Adult 98.4
Man 98.4
Person 98.4
Person 98.3
Boy 98.3
Child 98.3
Male 98.3
Person 97.7
Person 97.3
Person 96.4
Boy 96.4
Child 96.4
Male 96.4
Person 96.1
Person 96
Child 96
Female 96
Girl 96
Person 93.8
Outdoors 93.3
Nature 93.2
Person 93.2
Clothing 92.7
Glove 92.7
Person 92.3
Person 92.1
Face 87.9
Head 87.9
Person 84.5
Footwear 72.8
Shoe 72.8
Hat 65.8
Shoe 63
Yard 61.2
Coat 57.5
Architecture 57.1
Building 57.1
Shelter 57.1
Brick 56.6
Photography 56.5
Portrait 56.5
Road 56.5
City 56.3
Gravel 56.3
Backyard 56.1
Shoe 55.6
Rubble 55.6

Clarifai
created on 2023-10-18

people 100
group 99.2
child 98.4
group together 97.3
street 95.5
adult 95.1
boy 95
many 94.8
administration 92.7
war 92.5
canine 91.3
man 90.2
monochrome 87.7
woman 84.8
dog 80
son 74.4
cavalry 74.3
wear 74.2
family 73.1
school 70.9

Imagga
created on 2018-12-28

beach 27
man 26.2
kin 24.7
child 21.8
people 21.7
male 21.4
summer 19.9
sea 17.2
person 17
sand 16.9
outdoor 16.8
sport 16.6
outdoors 16.4
adult 16.2
walking 16.1
sky 15.9
couple 15.7
water 15.3
sunset 15.3
together 14.9
vacation 14.7
active 14.5
lifestyle 14.4
walk 14.3
brass 13.9
boy 13.9
leisure 13.3
ocean 13.3
world 13
sun 12.1
love 11.8
horse 11.8
wind instrument 11.6
coast 10.8
silhouette 10.8
sunlight 10.7
happy 10.6
run 10.6
trombone 10.6
running 10.5
fun 10.5
animal 10.4
portrait 10.4
stretcher 10.3
outside 10.3
athlete 9.8
musical instrument 9.6
men 9.4
happiness 9.4
two 9.3
shore 9.3
field 9.2
competition 9.2
countryside 9.1
holding 9.1
clothing 8.8
relax 8.4
old 8.4
action 8.3
litter 8.3
park 8.2
protection 8.2
recreation 8.1
romance 8
family 8
life 7.8
hands 7.8
father 7.8
uniform 7.7
rifle 7.6
parent 7.6
dark 7.5
back 7.3
speed 7.3
girls 7.3
playing 7.3
danger 7.3
dad 7.2
grass 7.1
women 7.1
kid 7.1
day 7.1
sibling 7

Google
created on 2018-12-28

photograph 95.4
black and white 86.8
snapshot 81.8
standing 75.8
vintage clothing 75
monochrome photography 69.6
history 68.5
monochrome 68.3
tree 63.3
house 51.7
stock photography 51.4

Microsoft
created on 2018-12-28

building 99
outdoor 97.7
old 94.1
group 82.4
black 73.3
posing 54.5
mammal 54
farm building 38.2
horse 15.4
person 15.4
child 8.5
family 7
people 2.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Male, 77.7%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 44.3%
Angry 44%
Sad 8.4%
Surprised 6.4%
Fear 6%
Confused 0.5%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Male, 99.3%
Calm 93.4%
Surprised 6.5%
Fear 6%
Angry 3%
Sad 2.4%
Happy 1.3%
Confused 0.6%
Disgusted 0.3%

AWS Rekognition

Age 7-17
Gender Male, 88.7%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 0-4
Gender Male, 99.3%
Sad 100%
Calm 16.3%
Surprised 6.4%
Fear 6.1%
Angry 1%
Confused 0.6%
Disgusted 0.6%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 99.4%
Happy 91.6%
Calm 7.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 54%
Calm 60.7%
Confused 21.8%
Sad 8.3%
Surprised 6.8%
Fear 6.4%
Disgusted 2.1%
Angry 1.9%
Happy 1.2%

AWS Rekognition

Age 6-12
Gender Female, 99.4%
Angry 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Calm 0.4%
Disgusted 0.1%
Happy 0%
Confused 0%

AWS Rekognition

Age 24-34
Gender Male, 59.9%
Calm 82.3%
Surprised 8.4%
Fear 6.8%
Sad 3.2%
Happy 3%
Disgusted 2.9%
Angry 1.8%
Confused 1.3%

AWS Rekognition

Age 0-4
Gender Male, 99.1%
Calm 95.8%
Surprised 6.3%
Fear 5.9%
Sad 3.2%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 95.1%
Sad 100%
Calm 7.4%
Surprised 6.3%
Fear 5.9%
Confused 0.5%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 16-24
Gender Male, 88.3%
Calm 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.8%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 87.7%
Happy 67.7%
Calm 10.7%
Surprised 8.1%
Sad 6.6%
Angry 6.4%
Fear 6.2%
Confused 2.2%
Disgusted 0.7%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Boy 98.7%
Child 98.7%
Male 98.7%
Adult 98.4%
Man 98.4%
Female 96%
Girl 96%
Glove 92.7%
Shoe 72.8%
Hat 65.8%