Human Generated Data

Title

Social Settlements: United States. Delaware. Wilmington. "Peoples Settlements": The Peoples Settlement, Wilmington, Del.: An Outing
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2795.3

Human Generated Data

Title

Social Settlements: United States. Delaware. Wilmington. "Peoples Settlements": The Peoples Settlement, Wilmington, Del.: An Outing

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2795.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Painting 99.3
Art 99.3
Person 98.7
Human 98.7
Person 97.5
People 96.7
Person 92.5
Person 88.9
Person 85.9
Person 80.2
Person 76.1
Person 75.4
Person 74.6
Person 74.6
Person 72
Meal 64.9
Leisure Activities 64.9
Vacation 64.9
Food 64.9
Picnic 64.9
Person 63
Plant 60.8
Tree 60.8
Crowd 60.6
Family 58.5

Clarifai
created on 2019-06-05

people 99.4
adult 98.3
art 97.7
group 97.5
many 96.2
wear 95.1
man 93.9
print 90.4
painting 89.8
military 89.7
woman 89.6
illustration 88.4
cavalry 88.3
soldier 85.1
no person 84.5
mammal 80.8
war 80.3
veil 79.1
home 75.6
sculpture 75.6

Imagga
created on 2019-06-05

cemetery 41.5
graffito 37.2
decoration 32.7
old 28.6
ancient 22.5
statue 22
antique 21.2
sculpture 19.7
art 19
stone 17.5
vintage 15.7
culture 15.4
travel 14.8
history 14.3
grunge 13.6
dirty 12.6
sepia 11.7
religion 11.6
people 11.2
texture 11.1
architecture 10.9
sand 10.8
man 10.8
desert 10.6
outdoors 10.4
wall 10.4
monument 10.3
historic 10.1
head 10.1
detail 9.7
rock 9.6
outdoor 9.2
park 9.1
aged 9
retro 9
animal 8.6
traditional 8.3
landscape 8.2
paper 7.8
color 7.8
empty 7.7
religious 7.5
rough 7.3

Google
created on 2019-06-05

People 95.9
Tree 68.7
Art 67.7
Adaptation 67
Vintage clothing 64
Family 59.2
Visual arts 55
Crowd 50.7

Microsoft
created on 2019-06-05

person 95.5
clothing 95
old 94.8
group 84
posing 56.5
man 51.4
fabric 26.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 53.7%
Confused 2%
Sad 7.9%
Angry 6.6%
Disgusted 6.5%
Calm 54.9%
Surprised 4.7%
Happy 17.4%

AWS Rekognition

Age 26-43
Gender Female, 61.2%
Calm 18.9%
Angry 5.2%
Confused 1.9%
Sad 63.6%
Happy 1.4%
Disgusted 7%
Surprised 1.9%

AWS Rekognition

Age 9-14
Gender Female, 53.7%
Disgusted 2.4%
Confused 6%
Angry 5.7%
Calm 4.9%
Surprised 5.3%
Happy 8.1%
Sad 67.6%

AWS Rekognition

Age 35-53
Gender Female, 50.4%
Sad 50%
Angry 48.6%
Happy 45.2%
Confused 45.2%
Surprised 45.1%
Disgusted 45.5%
Calm 45.4%

AWS Rekognition

Age 4-9
Gender Female, 53.8%
Angry 45.2%
Happy 45.6%
Surprised 45.2%
Calm 45.2%
Confused 45.1%
Sad 53.5%
Disgusted 45.2%

AWS Rekognition

Age 20-38
Gender Female, 52%
Sad 47.2%
Surprised 45.5%
Calm 47.7%
Happy 46.6%
Disgusted 45.7%
Confused 45.5%
Angry 46.8%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Disgusted 45.6%
Happy 51.1%
Confused 45.3%
Sad 45.8%
Angry 45.5%
Surprised 45.6%
Calm 46%

AWS Rekognition

Age 11-18
Gender Female, 54.1%
Calm 45%
Happy 46.2%
Angry 45.1%
Sad 53.4%
Surprised 45%
Confused 45.1%
Disgusted 45.2%

AWS Rekognition

Age 35-52
Gender Male, 51.2%
Disgusted 45%
Confused 45.1%
Happy 45%
Calm 45.1%
Surprised 45%
Sad 54.4%
Angry 45.3%

AWS Rekognition

Age 29-45
Gender Male, 51.5%
Happy 51.5%
Surprised 45.2%
Calm 45.6%
Confused 45.3%
Disgusted 45.8%
Angry 45.9%
Sad 45.7%

AWS Rekognition

Age 23-38
Gender Female, 50.8%
Sad 45.7%
Angry 45.6%
Calm 45.7%
Happy 51%
Disgusted 46%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 27-44
Gender Female, 50.6%
Angry 45.5%
Calm 45.5%
Sad 48.3%
Confused 45.3%
Disgusted 46.1%
Happy 49.2%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 52.8%
Sad 51.6%
Disgusted 45.1%
Surprised 45.2%
Happy 45.3%
Confused 45.5%
Angry 45.3%
Calm 46.9%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Calm 45.3%
Sad 46.3%
Happy 52.2%
Angry 45.3%
Disgusted 45.3%
Confused 45.3%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Disgusted 46.4%
Calm 46.8%
Angry 45.7%
Sad 49.6%
Happy 45.6%
Surprised 45.4%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Male, 51.1%
Disgusted 45.8%
Sad 49.8%
Calm 46.8%
Happy 45.2%
Confused 45.4%
Surprised 45.5%
Angry 46.3%

AWS Rekognition

Age 11-18
Gender Female, 52.4%
Calm 45.7%
Disgusted 45.4%
Confused 45.4%
Angry 45.8%
Happy 45.4%
Sad 51.8%
Surprised 45.4%

AWS Rekognition

Age 10-15
Gender Female, 54.7%
Disgusted 45.1%
Confused 45%
Surprised 45%
Calm 45%
Happy 45%
Angry 54.5%
Sad 45.3%

AWS Rekognition

Age 10-15
Gender Female, 54.3%
Sad 47.4%
Confused 45.5%
Angry 45.9%
Happy 48.7%
Calm 45.9%
Surprised 45.5%
Disgusted 46.1%

AWS Rekognition

Age 35-55
Gender Female, 50.9%
Disgusted 46.5%
Calm 47.9%
Surprised 45.7%
Sad 45.5%
Confused 45.4%
Angry 48.3%
Happy 45.7%

AWS Rekognition

Age 35-52
Gender Male, 50.8%
Happy 45.6%
Surprised 45.2%
Calm 46.3%
Angry 46.9%
Confused 45.8%
Sad 46.8%
Disgusted 48.3%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Surprised 45.9%
Confused 46.5%
Sad 46.8%
Disgusted 45.3%
Calm 49.2%
Angry 46.2%
Happy 45.1%

AWS Rekognition

Age 15-25
Gender Female, 51.7%
Confused 45.4%
Calm 46.8%
Angry 45.7%
Sad 49.2%
Happy 46.3%
Disgusted 46%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Disgusted 45.4%
Happy 45.6%
Confused 45.1%
Sad 53.1%
Angry 45.3%
Surprised 45.1%
Calm 45.3%

AWS Rekognition

Age 26-43
Gender Male, 52.8%
Happy 45.1%
Disgusted 45.1%
Sad 48.9%
Confused 45.5%
Angry 45.8%
Surprised 45.5%
Calm 49.1%

AWS Rekognition

Age 6-13
Gender Female, 54.4%
Angry 45.6%
Calm 45.7%
Sad 47.1%
Confused 45.8%
Disgusted 46.9%
Happy 48.4%
Surprised 45.5%

AWS Rekognition

Age 23-38
Gender Female, 54.5%
Angry 45.5%
Calm 47.1%
Sad 50.3%
Disgusted 45.1%
Happy 46.4%
Confused 45.5%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 51.6%
Calm 48.4%
Disgusted 45.6%
Surprised 46%
Sad 47.3%
Happy 46%
Angry 46%
Confused 45.7%

AWS Rekognition

Age 17-27
Gender Female, 54.9%
Calm 45.5%
Sad 45.3%
Happy 46.5%
Angry 50.8%
Disgusted 46%
Confused 45.2%
Surprised 45.8%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Painting 99.3%
Person 98.7%

Text analysis

Amazon

shs

Google

s
s