Human Generated Data

Title

Social Settlements: United States. District of Columbia. Washington. Noel House: Noel House, Washington, D.C.: Evening in the Gymnasium.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.226.1

Human Generated Data

Title

Social Settlements: United States. District of Columbia. Washington. Noel House: Noel House, Washington, D.C.: Evening in the Gymnasium.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.8
Human 99.8
Person 99.7
Person 99.4
Person 99
Person 98.9
Person 98.6
Person 98.2
Person 98.2
Person 97.5
Person 94.3
Crowd 92.8
Audience 92.8
People 89.8
Person 88.5
Person 84.8
Person 84.2
Person 83
Person 70.8
Face 67.2
Person 66.5
Person 65.9
Clothing 63.2
Apparel 63.2
Person 61.1
Performer 57.5
Workshop 55.8
Person 41.6

Imagga
created on 2022-06-25

man 25.5
people 24.5
musical instrument 22.1
person 21.8
male 21.2
music 20.1
kin 19.6
musician 19.4
adult 18.3
wind instrument 18.1
play 18.1
brass 17.8
guitar 17
happy 15.6
group 15.3
bass 14.9
instrument 14.3
performer 14.3
style 14.1
attractive 14
outfit 13.1
rock 13
fun 12.7
singer 12.7
portrait 12.3
lifestyle 12.3
together 12.2
fashion 12
studio 11.4
couple 11.3
sexy 11.2
stringed instrument 11.2
women 11.1
handsome 10.7
musical 10.5
professional 10.5
black 10.4
men 10.3
device 10.3
dress 9.9
concert 9.7
color 9.4
wall 9.4
happiness 9.4
youth 9.4
smile 9.3
room 9.2
child 9.2
entertainment 9.2
leisure 9.1
playing 9.1
guitarist 8.8
clothing 8.8
urban 8.7
boy 8.7
smiling 8.7
party 8.6
cornet 8.5
player 8.5
teacher 8.5
pretty 8.4
street 8.3
holding 8.2
trombone 8.2
girls 8.2
lady 8.1
family 8
businessman 7.9
art 7.9
business 7.9
washboard 7.8
model 7.8
performance 7.6
active 7.5
banjo 7.5
city 7.5
cheerful 7.3
painting 7.2
violin 7.2
colorful 7.2
love 7.1
world 7
indoors 7

Google
created on 2022-06-25

Coat 88.7
Suit 85.2
Crew 78.6
Family reunion 75.8
Vintage clothing 74.7
Team 73.5
Event 72.8
History 67.1
Monochrome 65
Stock photography 64.3
Crowd 60.5
Fun 59
Font 55.2
Formal wear 54.3
Family 53.2
Room 52.3

Microsoft
created on 2022-06-25

person 99.7
clothing 99
posing 97.4
man 95.3
group 94.9
old 90.6
text 85.8
standing 82.6
smile 75
black 66.7
suit 59.3
people 56
team 32.5
dressed 25
clothes 16

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 100%
Sad 71.2%
Calm 48.3%
Confused 7.6%
Surprised 7.2%
Fear 7%
Disgusted 3.9%
Angry 1.7%
Happy 0.8%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 93.5%
Surprised 7.8%
Fear 6.7%
Sad 2.3%
Confused 0.7%
Disgusted 0.3%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 75.6%
Calm 75.4%
Angry 14.9%
Surprised 7%
Fear 6.1%
Disgusted 3.2%
Sad 2.8%
Confused 1.9%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Female, 96.3%
Calm 41.1%
Happy 21.1%
Angry 19.3%
Confused 8%
Fear 8%
Surprised 7.6%
Sad 2.7%
Disgusted 1.5%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 97%
Surprised 6.5%
Fear 5.9%
Sad 2.6%
Calm 0.7%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 85.9%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 98.5%
Calm 84.2%
Surprised 9.7%
Fear 6.3%
Confused 3.2%
Sad 2.7%
Angry 1.9%
Disgusted 1.9%
Happy 0.5%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Calm 72%
Confused 13.6%
Surprised 8.9%
Fear 6.5%
Sad 3.7%
Angry 2.5%
Happy 1%
Disgusted 0.9%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 96.1%
Surprised 6.8%
Fear 5.9%
Sad 2.4%
Confused 0.7%
Angry 0.5%
Disgusted 0.4%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 97.5%
Calm 61%
Confused 10.6%
Angry 10.3%
Surprised 9.1%
Fear 6.8%
Disgusted 6.3%
Sad 3%
Happy 2.3%

AWS Rekognition

Age 21-29
Gender Female, 80%
Calm 60%
Sad 13.1%
Surprised 10.6%
Happy 9%
Fear 6.5%
Confused 4.3%
Angry 4.2%
Disgusted 0.6%

AWS Rekognition

Age 24-34
Gender Female, 51%
Calm 91.8%
Surprised 6.6%
Fear 6%
Disgusted 3.5%
Sad 2.3%
Angry 2.1%
Confused 0.8%
Happy 0.1%

AWS Rekognition

Age 4-12
Gender Female, 91.6%
Surprised 99.4%
Fear 5.9%
Calm 5.9%
Sad 2.2%
Confused 2%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Female, 58.6%
Calm 84.7%
Surprised 7.5%
Fear 6.1%
Confused 5.6%
Sad 2.7%
Happy 2.4%
Disgusted 1.6%
Angry 1.4%

AWS Rekognition

Age 23-33
Gender Female, 60.8%
Calm 89.1%
Surprised 6.7%
Fear 6.2%
Sad 3.2%
Disgusted 2.6%
Happy 1.3%
Confused 1.3%
Angry 1%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 93.4%
Surprised 6.7%
Fear 5.9%
Confused 4.3%
Sad 2.2%
Angry 0.7%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 4-10
Gender Female, 100%
Angry 31.1%
Sad 19.2%
Calm 16.1%
Surprised 12.2%
Fear 10.3%
Disgusted 9.9%
Confused 7.7%
Happy 1.2%

AWS Rekognition

Age 6-16
Gender Male, 52.2%
Sad 99.8%
Calm 22.2%
Surprised 6.4%
Fear 6.2%
Angry 3.2%
Disgusted 0.5%
Confused 0.5%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.2%
Calm 61%
Happy 14.8%
Surprised 9.2%
Sad 7.6%
Fear 6.4%
Angry 5.5%
Confused 1.8%
Disgusted 1.4%

AWS Rekognition

Age 22-30
Gender Female, 79.2%
Calm 62%
Sad 18.5%
Angry 10.3%
Surprised 8.5%
Fear 7.3%
Confused 2.1%
Disgusted 1.2%
Happy 0.7%

AWS Rekognition

Age 28-38
Gender Male, 76.1%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Angry 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 70.4%
Fear 12.9%
Surprised 8.3%
Confused 4%
Disgusted 4%
Sad 3%
Angry 1.8%
Happy 0.9%

AWS Rekognition

Age 21-29
Gender Male, 90.4%
Calm 97.8%
Surprised 6.4%
Fear 6.1%
Sad 2.5%
Angry 0.1%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 94.2%
Calm 99.5%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Happy 0%

AWS Rekognition

Age 4-12
Gender Male, 99.9%
Calm 27.4%
Happy 20.4%
Fear 18.2%
Disgusted 11.2%
Surprised 9.9%
Sad 9.2%
Angry 2.8%
Confused 2.7%

AWS Rekognition

Age 24-34
Gender Female, 56.9%
Sad 87.1%
Angry 15.6%
Surprised 11.7%
Fear 10%
Happy 7.1%
Disgusted 7%
Confused 6.9%
Calm 6.7%

AWS Rekognition

Age 25-35
Gender Male, 99%
Calm 43.2%
Confused 24.9%
Happy 9.4%
Surprised 8.4%
Fear 7.5%
Sad 5.8%
Disgusted 4%
Angry 3.7%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Calm 64.7%
Sad 13.3%
Surprised 8.2%
Angry 6.9%
Fear 6.9%
Disgusted 6.4%
Confused 1.7%
Happy 0.7%

AWS Rekognition

Age 48-54
Gender Male, 97.8%
Sad 99.8%
Calm 20.2%
Angry 9.1%
Surprised 6.3%
Fear 6%
Confused 0.9%
Disgusted 0.5%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 75.6%
Sad 100%
Calm 8.5%
Surprised 6.4%
Fear 6.2%
Disgusted 1.5%
Angry 0.8%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Male, 76.1%
Calm 82.4%
Sad 20%
Surprised 6.3%
Fear 5.9%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 11-19
Gender Female, 64.8%
Fear 88.4%
Surprised 11%
Angry 8.6%
Calm 5.9%
Sad 3.4%
Happy 1.5%
Disgusted 1.2%
Confused 0.9%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 98.2%
an old photo of a group of people posing for the camera 97.6%
an old photo of a group of people posing for a picture 97.5%

Text analysis

Amazon

5°,,

Google

S