Human Generated Data

Title

Social Settlements: United States. Delaware. Wilmington. "Peoples Settlement": The Peoples Settlement, Wilmington, Del.: Children of the kindergarten.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2793.4

Human Generated Data

Title

Social Settlements: United States. Delaware. Wilmington. "Peoples Settlement": The Peoples Settlement, Wilmington, Del.: Children of the kindergarten.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.2
Person 99.2
Person 99.1
Person 98.9
Person 98.7
People 98
Person 96.6
Person 95.9
Person 85.3
Person 81.3
Family 79.9
Person 79
Person 76.9
Sailor Suit 76.4
Person 75.1
Person 74.2
Person 62.4
Kindergarten 56.7
School 56
Person 51

Clarifai
created on 2019-06-05

people 100
group 99.2
adult 97.7
many 97.6
child 94.9
man 94.6
group together 93.6
wear 92.6
woman 90.1
military 87.9
administration 86.5
soldier 85.3
war 85.1
several 84.9
home 80.6
vehicle 80.5
print 79.1
art 77
leader 75.3
boy 74.4

Imagga
created on 2019-06-05

old 23.7
man 16.1
vintage 15.7
ancient 15.5
history 14.3
building 14.3
statue 14.2
city 14.1
guillotine 13.4
architecture 13.3
people 12.8
travel 12.7
historic 11.9
art 11.9
sculpture 11.7
window 11.6
instrument of execution 11.3
historical 11.3
wall 11.1
device 10.5
instrument 10.3
stone 10.2
decoration 10.2
male 9.9
musical instrument 9.6
black 9.6
kin 9.6
culture 9.4
shop 9.3
holiday 9.3
brass 9.3
tourism 9.1
room 9
religion 9
person 8.9
antique 8.6
grunge 8.5
religious 8.4
traditional 8.3
retro 8.2
hat 8
family 8
portrait 7.8
men 7.7
war 7.7
street 7.4
aged 7.2
dirty 7.2
wind instrument 7.1

Google
created on 2019-06-05

People 97.4
Photograph 96.1
Snapshot 84.1
Vintage clothing 77.4
Child 76.5
Family 70.7
History 64.5
Classic 56.7

Microsoft
created on 2019-06-05

person 97.2
clothing 96.9
posing 89.8
old 87.7
human face 84.6
group 61

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Calm 45.2%
Surprised 45%
Disgusted 45%
Confused 45.1%
Sad 54.1%
Happy 45%
Angry 45.5%

AWS Rekognition

Age 9-14
Gender Female, 51.7%
Confused 45%
Sad 54.9%
Angry 45%
Disgusted 45%
Calm 45%
Surprised 45%
Happy 45%

AWS Rekognition

Age 9-14
Gender Female, 50%
Angry 49%
Happy 45.6%
Surprised 45.4%
Calm 47.8%
Confused 45.3%
Sad 46.5%
Disgusted 45.4%

AWS Rekognition

Age 23-38
Gender Female, 54.6%
Happy 46.1%
Calm 48.1%
Confused 45.3%
Disgusted 46.1%
Surprised 45.6%
Angry 47%
Sad 46.9%

AWS Rekognition

Age 6-13
Gender Male, 53.3%
Happy 45%
Surprised 45%
Calm 45.4%
Angry 45.1%
Confused 45%
Sad 54.4%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Disgusted 45.1%
Calm 53.6%
Angry 45.5%
Sad 45.6%
Happy 45.1%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 4-9
Gender Female, 54.9%
Confused 45.1%
Disgusted 45%
Sad 53.5%
Surprised 45%
Calm 45.2%
Happy 45.1%
Angry 46.1%

AWS Rekognition

Age 20-38
Gender Female, 51.3%
Calm 45.2%
Happy 45.3%
Angry 45.2%
Sad 53.8%
Surprised 45.1%
Confused 45.1%
Disgusted 45.4%

AWS Rekognition

Age 35-52
Gender Female, 54.5%
Angry 45.4%
Surprised 45.2%
Disgusted 45.4%
Happy 46.7%
Calm 45.3%
Sad 51.7%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Disgusted 45.2%
Sad 48.9%
Surprised 45.2%
Calm 49.3%
Angry 45.2%
Happy 46.1%
Confused 45.1%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Calm 45.4%
Angry 52.9%
Disgusted 45.2%
Sad 46.1%
Surprised 45.1%
Happy 45.2%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 52.7%
Sad 52.9%
Confused 45.2%
Calm 45.4%
Disgusted 45.4%
Happy 45.2%
Angry 45.7%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Confused 45.4%
Disgusted 46.1%
Happy 46.1%
Calm 46.5%
Surprised 45.2%
Sad 49.3%
Angry 46.2%

AWS Rekognition

Age 10-15
Gender Female, 54.1%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 45%
Happy 45%
Angry 45.1%
Sad 54.8%

AWS Rekognition

Age 9-14
Gender Female, 55%
Happy 49.3%
Angry 45.7%
Calm 45.2%
Disgusted 45.4%
Sad 48.3%
Confused 45.7%
Surprised 45.4%

AWS Rekognition

Age 6-13
Gender Female, 53.1%
Surprised 45.1%
Happy 45%
Confused 45.2%
Sad 53.4%
Calm 45.8%
Disgusted 45%
Angry 45.4%

AWS Rekognition

Age 20-38
Gender Female, 52.6%
Surprised 45.8%
Happy 48.1%
Sad 47.4%
Calm 45.6%
Confused 45.2%
Disgusted 45.6%
Angry 47.3%

AWS Rekognition

Age 57-77
Gender Female, 52.3%
Angry 49.9%
Disgusted 45.2%
Confused 45.1%
Calm 46.9%
Happy 46.4%
Surprised 45.2%
Sad 46.2%

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 95.9%
an old photo of a group of people posing for the camera 95.4%
an old photo of a group of people posing for a picture 95.3%

Text analysis

Amazon

2
3.