Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Womens Club ready for a play.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2880.1

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Womens Club ready for a play.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2880.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

School 99.9
Indoors 99.8
Classroom 99.8
Room 99.8
Human 99.1
Person 99.1
Person 99.1
Person 98.5
Person 98.4
Person 98.3
Person 98
Person 98
Person 97.8
Person 97.8
Person 97.8
Person 97.1
Person 96.8
Person 96.4
Person 96.1
Person 93.5
Person 92.2
Painting 78.5
Art 78.5
People 75
Kindergarten 59
Person 57.1

Clarifai
created on 2019-06-05

people 100
group 99.9
child 99.6
many 99.1
group together 98.1
education 98
elementary school 97.9
school 97
woman 96.3
teacher 95.9
adult 95
boy 94.6
classroom 93.2
several 92.5
adolescent 90.7
administration 90.6
man 90.5
portrait 90.4
sit 89.3
war 88.1

Imagga
created on 2019-06-05

kin 56.1
nurse 52
people 25.1
man 24.8
person 22.7
couple 22.6
happy 19.4
dress 18.9
room 18.7
male 17
adult 16.9
portrait 16.8
bride 16.3
love 15
family 14.2
wedding 13.8
happiness 13.3
old 13.2
group 12.9
men 12.9
women 12.6
smiling 12.3
together 12.2
groom 12.2
fashion 12
home 12
grandfather 11.8
gown 11.7
smile 11.4
art 11.3
bridal 10.7
married 10.5
bouquet 10.4
senior 10.3
work 10.2
classroom 10.1
celebration 9.6
decoration 9.4
attractive 9.1
indoors 8.8
hospital 8.7
mother 8.7
professional 8.6
marriage 8.5
vintage 8.3
human 8.2
fun 8.2
retro 8.2
lady 8.1
child 8
businessman 7.9
sculpture 7.9
holiday 7.9
black 7.8
antique 7.8
ancient 7.8
life 7.7
sitting 7.7
culture 7.7
two 7.6
joy 7.5
traditional 7.5
style 7.4
design 7.3
new 7.3
business 7.3
color 7.2
lifestyle 7.2
religion 7.2
history 7.1
worker 7.1
romantic 7.1
interior 7.1
teacher 7

Google
created on 2019-06-05

Social group 96.6
Photograph 95.8
Snapshot 82.5
Class 81.8
Team 67.7
Crew 56.9
State school 53.8

Microsoft
created on 2019-06-05

posing 99.9
person 99.5
group 98.8
clothing 98
woman 90.9
smile 86
human face 85.2
girl 79.7
old 76
black 74
dress 65
school 62.8
team 60.5
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 52.3%
Disgusted 45.6%
Confused 45.2%
Surprised 45.4%
Calm 51.9%
Happy 45.5%
Angry 45.2%
Sad 46.1%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Surprised 45.2%
Happy 45.1%
Confused 45.3%
Sad 47.1%
Calm 51.9%
Disgusted 45.1%
Angry 45.2%

AWS Rekognition

Age 16-27
Gender Male, 50.4%
Calm 53.6%
Surprised 45.1%
Disgusted 45%
Confused 45%
Sad 45.8%
Happy 45.3%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Calm 48.8%
Angry 45.2%
Disgusted 45.5%
Sad 49.9%
Surprised 45.1%
Happy 45.3%
Confused 45.1%

AWS Rekognition

Age 30-47
Gender Female, 50.1%
Surprised 45.9%
Calm 47.3%
Happy 45.6%
Sad 48.2%
Angry 45.9%
Confused 45.7%
Disgusted 46.4%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Calm 54%
Confused 45.1%
Angry 45.3%
Surprised 45.1%
Disgusted 45.1%
Sad 45.1%
Happy 45.2%

AWS Rekognition

Age 45-63
Gender Female, 55%
Sad 54.8%
Angry 45%
Calm 45.1%
Confused 45%
Happy 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Happy 45.2%
Calm 45.8%
Sad 52.5%
Angry 46.1%
Confused 45.2%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 48-68
Gender Female, 50.3%
Disgusted 45.1%
Sad 50.7%
Surprised 45.2%
Calm 48%
Angry 45.5%
Happy 45.2%
Confused 45.3%

AWS Rekognition

Age 45-63
Gender Male, 54.3%
Confused 45.2%
Disgusted 45.6%
Happy 45.5%
Calm 49.4%
Surprised 45.1%
Sad 48.7%
Angry 45.5%

AWS Rekognition

Age 45-63
Gender Female, 54.5%
Happy 46.1%
Surprised 45.3%
Angry 45.4%
Sad 50.4%
Confused 45.4%
Disgusted 45.2%
Calm 47.3%

AWS Rekognition

Age 35-52
Gender Female, 53.9%
Angry 45.3%
Calm 45.8%
Sad 50.1%
Disgusted 45.3%
Happy 48%
Confused 45.3%
Surprised 45.2%

AWS Rekognition

Age 45-63
Gender Female, 55%
Sad 48.2%
Happy 46.8%
Disgusted 45.3%
Calm 46.2%
Angry 48.1%
Confused 45.2%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Confused 45.2%
Angry 45.2%
Happy 45.1%
Sad 51.8%
Disgusted 45.1%
Surprised 45.1%
Calm 47.4%

AWS Rekognition

Age 27-44
Gender Female, 52.1%
Disgusted 45.5%
Happy 45.2%
Surprised 45.3%
Angry 46.1%
Confused 45.1%
Calm 50.9%
Sad 47%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Calm 49.7%
Sad 45.4%
Disgusted 45.2%
Happy 49.2%
Surprised 45.1%
Angry 45.1%
Confused 45.1%

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 78.5%

Categories

Imagga

paintings art 83.1%
people portraits 14.3%