Human Generated Data

Title

Social Settlements: United States. Louisiana. New Orleans. Kingsley House: The Kingsley House, New Orleans, La.: The Side Yard.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.270.2

Human Generated Data

Title

Social Settlements: United States. Louisiana. New Orleans. Kingsley House: The Kingsley House, New Orleans, La.: The Side Yard.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.270.2

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.5
Human 99.5
Person 99.5
Person 99.2
Person 99.2
Person 98.2
Person 98.1
Person 98
Person 97.9
Person 97.4
Person 95.3
Person 94.4
Person 93.9
Person 93.6
Person 89.5
Person 84.2
Person 83.5
People 80.3
Kindergarten 77.7
Person 75.1
Room 73
Indoors 73
Person 68.6
Person 67.4
Crowd 64.2
Building 63
Person 59.1
Audience 57.5
Clothing 57.4
Apparel 57.4
Person 56.2
Outdoors 56
Person 55.3
Urban 55.1
Person 50.9

Imagga
created on 2022-06-25

cemetery 35.6
banjo 27.7
stringed instrument 22.6
musical instrument 22.5
groom 16.9
man 16.1
stone 15.1
old 14.6
outdoors 13.4
garden 13.4
people 13.4
person 12.3
love 11
history 10.7
male 10.7
kin 10.6
bride 10.5
child 10.3
portrait 10.3
building 10.3
grass 10.3
holiday 10
girls 10
family 9.8
couple 9.6
architecture 9.4
tree 9.2
wedding 9.2
traditional 9.1
tourism 9.1
religion 9
happy 8.8
married 8.6
men 8.6
outside 8.5
culture 8.5
marriage 8.5
world 8.5
house 8.4
dark 8.3
city 8.3
sky 8.3
park 8.2
day 7.8
happiness 7.8
antique 7.8
ancient 7.8
travel 7.7
ball 7.7
two 7.6
pumpkin 7.5
dress 7.2
smile 7.1
face 7.1

Google
created on 2022-06-25

Building 74.7
Monochrome 73.6
Event 73.4
Monochrome photography 72.2
Hat 69
Crowd 66.2
History 66.1
Room 64.9
Vintage clothing 62.7
Child 59.9
Class 58.4
House 56.6
Toddler 56.3

Microsoft
created on 2022-06-25

person 98.4
clothing 95.8
indoor 87.8
old 85
house 78.8
black 72.1
group 71.9
man 64.4
people 60.3
woman 56.4
posing 47.5
vintage 32.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Male, 58.4%
Surprised 95.1%
Angry 9.9%
Sad 7.8%
Fear 7.4%
Confused 6.8%
Calm 2.7%
Disgusted 1%
Happy 0.7%

AWS Rekognition

Age 1-7
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 0.5%
Calm 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 2-10
Gender Male, 97.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Calm 0.2%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 74.6%
Sad 100%
Fear 7.7%
Surprised 6.7%
Disgusted 5.5%
Confused 2.8%
Calm 0.8%
Angry 0.5%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Female, 54.6%
Sad 68.9%
Calm 50.2%
Angry 10.4%
Fear 7.9%
Surprised 6.4%
Disgusted 1.3%
Happy 0.5%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Sad 87.4%
Calm 34.1%
Fear 9.9%
Surprised 6.8%
Angry 6.3%
Happy 5.1%
Disgusted 3%
Confused 1.8%

AWS Rekognition

Age 19-27
Gender Female, 100%
Surprised 59.1%
Confused 30.3%
Calm 13.6%
Fear 10.8%
Sad 5.7%
Disgusted 1.4%
Angry 1.1%
Happy 0.9%

AWS Rekognition

Age 2-8
Gender Female, 89%
Sad 91.6%
Angry 45.5%
Confused 8%
Surprised 6.4%
Fear 6.4%
Calm 0.9%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Sad 87%
Angry 38.4%
Calm 14.5%
Surprised 6.5%
Fear 6.3%
Disgusted 2.4%
Confused 2%
Happy 1.1%

AWS Rekognition

Age 6-12
Gender Female, 84.5%
Sad 100%
Fear 7.9%
Surprised 6.6%
Angry 4.3%
Calm 2.9%
Confused 2.5%
Disgusted 1.5%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Female, 59.1%
Calm 54%
Fear 14.3%
Surprised 10.8%
Angry 8.1%
Happy 7.4%
Sad 4.1%
Confused 2.3%
Disgusted 1.9%

AWS Rekognition

Age 2-10
Gender Female, 99.3%
Sad 99.9%
Calm 11%
Fear 6.5%
Surprised 6.5%
Confused 3.4%
Angry 2.4%
Disgusted 1.5%
Happy 1.4%

AWS Rekognition

Age 6-14
Gender Female, 50.4%
Happy 68.2%
Calm 25.7%
Surprised 6.4%
Fear 6.2%
Sad 3.3%
Angry 1.2%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 4-12
Gender Male, 95.6%
Fear 46.7%
Calm 31.3%
Surprised 29.8%
Sad 2.8%
Happy 2%
Disgusted 1.5%
Confused 1.4%
Angry 0.9%

AWS Rekognition

Age 6-12
Gender Female, 94%
Calm 84.1%
Fear 10.9%
Surprised 6.7%
Sad 2.5%
Confused 1.8%
Angry 1.7%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 50.9%
Sad 99.7%
Calm 14.8%
Surprised 7.8%
Fear 7.7%
Disgusted 6.2%
Happy 2.1%
Angry 1.8%
Confused 1.5%

AWS Rekognition

Age 18-26
Gender Male, 68.2%
Sad 37.4%
Calm 27.6%
Surprised 20.8%
Fear 14.8%
Angry 6.4%
Happy 5.7%
Confused 3.1%
Disgusted 2.8%

AWS Rekognition

Age 23-33
Gender Male, 87.3%
Calm 50.1%
Happy 44.1%
Surprised 6.6%
Fear 6.1%
Sad 2.8%
Disgusted 1.1%
Angry 1.1%
Confused 0.4%

AWS Rekognition

Age 18-26
Gender Female, 56.9%
Fear 73.6%
Calm 34.6%
Surprised 6.8%
Sad 4%
Disgusted 1.2%
Confused 1.1%
Angry 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.5%

Text analysis

Amazon

S

Google

Meat