Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Little Womens Club. Picnic.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2881.2

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Little Womens Club. Picnic.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2881.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.5
Person 99.5
Person 98.9
Person 98.6
Person 98.5
Person 98.5
Person 97.8
Person 97.4
Person 97.3
Person 97.2
Person 96.6
Person 96.2
Person 95.9
Person 95.8
Person 93.3
Apparel 91.2
Clothing 91.2
People 90.2
Person 83.7
Person 82
Person 81
Person 80.9
Accessory 79.7
Accessories 79.7
Tie 79.7
Person 79.3
Military Uniform 78.8
Troop 78.8
Armored 78.8
Army 78.8
Military 78.8
Person 78.2
Person 74.6
Person 72.9
Person 69.9
Kindergarten 64.1
Person 61.3
Hat 59.2
Outdoors 57.9
Officer 57.8
Child 56.6
Kid 56.6
Person 47.1
Person 45.4

Clarifai
created on 2019-06-05

child 99.9
people 99.9
group 99.2
group together 98.8
many 98.1
son 97.8
portrait 97
boy 97
facial expression 94.6
offspring 92.8
adult 91.2
man 90.1
sibling 89.6
adolescent 89.1
woman 87
family 86.9
sit 86.6
wear 85.6
several 84.5
education 83.3

Imagga
created on 2019-06-05

kin 100
child 33.8
family 32
portrait 25.8
people 24.5
man 22.8
happy 22.5
mother 20.7
happiness 19.6
person 18.5
male 18.5
father 16.8
together 16.6
fun 15.7
smile 15.7
outdoors 15.7
adult 15.5
daughter 15.4
childhood 15.2
smiling 15.2
parent 15
love 15
park 14
kid 13.3
old 13.2
boy 13
face 12.8
girls 12.7
men 12
culture 11.9
son 11.7
joy 11.7
women 11.1
day 11
children 10.9
little 10.6
cheerful 10.6
group 10.5
couple 10.4
ancient 10.4
tradition 10.2
two 10.1
cute 10
dress 9.9
holding 9.9
togetherness 9.4
lifestyle 9.4
baby 9.4
innocent 9.2
traditional 9.1
religion 9
affectionate 8.7
decoration 8.7
holiday 8.6
outside 8.5
casual 8.5
head 8.4
history 8
autumn 7.9
room 7.8
sepia 7.8
loving 7.6
statue 7.6
senior 7.5
religious 7.5
vintage 7.4
life 7.4
new 7.3
nurse 7.3
blond 7.2
home 7.2
to 7.1
interior 7.1

Google
created on 2019-06-05

People 96.6
Social group 94.8
Family 66.5
Family reunion 60
Child 57.3
Vintage clothing 54.7

Microsoft
created on 2019-06-05

person 100
posing 99.9
tree 99.3
clothing 98.6
outdoor 97.1
smile 93.2
child 92.3
group 91.8
young 91.2
human face 91.2
boy 87.6
team 76.9
school 71.6
old 65.3
family 64.5
photograph 56.6
toddler 50.9
crowd 3.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 53.6%
Happy 53.7%
Surprised 45.2%
Angry 45.2%
Sad 45.3%
Confused 45.1%
Calm 45.3%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Surprised 45.1%
Sad 48.4%
Happy 45.1%
Disgusted 45.2%
Confused 45.5%
Calm 50.1%
Angry 45.6%

AWS Rekognition

Age 11-18
Gender Female, 54.5%
Sad 45.7%
Disgusted 45.1%
Surprised 45.2%
Happy 45.1%
Confused 45.5%
Angry 49.6%
Calm 48.9%

AWS Rekognition

Age 20-38
Gender Female, 52.6%
Sad 45.8%
Disgusted 45.7%
Surprised 45.3%
Angry 45.2%
Happy 51%
Calm 46.7%
Confused 45.2%

AWS Rekognition

Age 19-36
Gender Female, 53.9%
Disgusted 45.1%
Angry 45.4%
Sad 48.6%
Surprised 45.2%
Happy 45.6%
Calm 49.8%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Surprised 45.1%
Disgusted 45.1%
Confused 45%
Sad 45%
Calm 45.2%
Happy 54.5%
Angry 45.1%

AWS Rekognition

Age 10-15
Gender Female, 53.6%
Surprised 45.1%
Calm 54.7%
Happy 45.1%
Sad 45.1%
Confused 45%
Angry 45%
Disgusted 45%

AWS Rekognition

Age 10-15
Gender Female, 52%
Disgusted 45%
Happy 45%
Surprised 45%
Angry 45%
Confused 45%
Calm 54.9%
Sad 45%

AWS Rekognition

Age 9-14
Gender Female, 52.4%
Confused 45.1%
Disgusted 45.1%
Calm 51.9%
Angry 45.6%
Happy 45.2%
Surprised 45.1%
Sad 46.9%

AWS Rekognition

Age 17-27
Gender Female, 53.3%
Calm 50.4%
Sad 45.8%
Disgusted 45.3%
Happy 45.3%
Surprised 45.9%
Angry 46.5%
Confused 45.8%

AWS Rekognition

Age 20-38
Gender Female, 50.6%
Disgusted 45.5%
Confused 45.2%
Angry 45.4%
Calm 53.2%
Surprised 45.3%
Happy 45.2%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Disgusted 45.3%
Confused 45.3%
Happy 45.2%
Calm 48.4%
Surprised 45.5%
Sad 47.9%
Angry 47.4%

AWS Rekognition

Age 14-23
Gender Female, 52.2%
Surprised 45.1%
Happy 53.7%
Confused 45.1%
Sad 45.5%
Calm 45.4%
Disgusted 45.1%
Angry 45.1%

AWS Rekognition

Age 15-25
Gender Male, 52.6%
Calm 47%
Disgusted 45.1%
Confused 45.2%
Angry 45.8%
Happy 45.1%
Sad 51.8%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Happy 45.1%
Disgusted 45%
Sad 46%
Confused 45.1%
Angry 45.2%
Surprised 45.1%
Calm 53.5%

AWS Rekognition

Age 10-15
Gender Female, 53%
Disgusted 45.2%
Calm 48.9%
Surprised 45.2%
Sad 49.5%
Confused 45.3%
Angry 45.6%
Happy 45.3%

AWS Rekognition

Age 26-43
Gender Male, 55%
Happy 46.4%
Disgusted 45.5%
Confused 49.8%
Surprised 45.3%
Sad 45.6%
Angry 45.7%
Calm 46.7%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Disgusted 45.1%
Sad 45.5%
Surprised 45.4%
Calm 50.6%
Happy 47.5%
Confused 45.6%
Angry 45.3%

AWS Rekognition

Age 10-15
Gender Male, 54.2%
Sad 45.2%
Surprised 45%
Confused 45%
Disgusted 45%
Happy 45%
Calm 54.7%
Angry 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Sad 46%
Angry 45.6%
Calm 52.2%
Confused 45.5%
Happy 45.3%
Surprised 45.2%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 52%
Sad 45.1%
Angry 45.1%
Calm 45.9%
Happy 53.8%
Disgusted 45%
Confused 45.1%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 53.5%
Happy 48.3%
Disgusted 45.2%
Sad 45.2%
Confused 45.1%
Angry 45.2%
Surprised 45.3%
Calm 50.7%

AWS Rekognition

Age 10-15
Gender Female, 54.4%
Calm 45.2%
Angry 45.2%
Disgusted 45.2%
Sad 45.3%
Surprised 45.1%
Happy 53.9%
Confused 45.2%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Surprised 45.2%
Happy 45.1%
Confused 45.4%
Sad 46.8%
Calm 49.9%
Disgusted 45.2%
Angry 47.5%

AWS Rekognition

Age 10-15
Gender Male, 54.1%
Disgusted 45.2%
Confused 45.5%
Angry 46.9%
Happy 46.7%
Calm 47.2%
Surprised 45.2%
Sad 48.3%

AWS Rekognition

Age 26-43
Gender Male, 50.6%
Confused 45.1%
Disgusted 45.1%
Happy 49.9%
Calm 48.6%
Surprised 45.2%
Sad 45.9%
Angry 45.2%

AWS Rekognition

Age 27-44
Gender Female, 54.8%
Disgusted 45.4%
Sad 53.9%
Surprised 45.1%
Calm 45.1%
Angry 45.3%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54%
Angry 47.2%
Surprised 45.1%
Confused 45.7%
Sad 48.7%
Disgusted 45.2%
Happy 45.1%
Calm 47.9%

AWS Rekognition

Age 16-27
Gender Male, 51.4%
Happy 47.3%
Surprised 45.2%
Angry 45.2%
Sad 49.8%
Confused 45.1%
Disgusted 45.1%
Calm 47.3%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Disgusted 45.2%
Calm 46%
Confused 45.2%
Surprised 45.3%
Happy 45.4%
Angry 52.5%
Sad 45.4%

AWS Rekognition

Age 35-52
Gender Female, 52.1%
Angry 45.5%
Happy 45.6%
Disgusted 45.6%
Confused 45.3%
Surprised 45.3%
Sad 49.9%
Calm 47.8%

AWS Rekognition

Age 26-43
Gender Male, 55%
Surprised 45%
Confused 45.2%
Sad 48.3%
Calm 45.9%
Happy 45%
Disgusted 45%
Angry 50.5%

AWS Rekognition

Age 6-13
Gender Female, 54%
Calm 49.1%
Angry 46.1%
Confused 45.9%
Sad 46.8%
Happy 46.8%
Disgusted 45.2%
Surprised 45.2%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 13
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.5%
Person 98.9%
Person 98.6%
Person 98.5%
Person 98.5%
Person 97.8%
Person 97.4%
Person 97.3%
Person 97.2%
Person 96.6%
Person 96.2%
Person 95.9%
Person 95.8%
Person 93.3%
Person 83.7%
Person 82%
Person 81%
Person 80.9%
Person 79.3%
Person 78.2%
Person 74.6%
Person 72.9%
Person 69.9%
Person 61.3%
Person 47.1%
Person 45.4%
Tie 79.7%

Categories

Imagga

people portraits 99.9%