Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.5

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 98.4
Human 98.4
Person 96.5
Person 95.7
Person 91.5
Person 89.4
Person 86.6
People 85.1
Apparel 84
Clothing 84
Person 79.7
Painting 72.5
Art 72.5
Outdoors 64.6
Building 61.7
Wedding Gown 61.4
Fashion 61.4
Robe 61.4
Gown 61.4
Wedding 61.4
Face 59.4

Clarifai
created on 2019-06-05

people 100
adult 99
group 98.6
many 98.2
child 97.8
group together 97.4
wear 96.8
woman 96.4
several 93.7
man 91.8
veil 90
uniform 89.4
furniture 88.7
two 87.5
outfit 86.8
recreation 86
boy 85.4
sit 82.7
room 81.5
military 81.2

Imagga
created on 2019-06-05

old 20.2
bride 19.2
dress 19
wall 18.7
wedding 17.5
decoration 16.1
antique 15
texture 14.6
groom 13.4
vintage 13.2
people 12.8
love 12.6
art 12.3
grunge 11.9
flower 11.5
ancient 11.2
paper 11
structure 10.9
aged 10.9
clothing 10.8
adult 10.7
bouquet 10.7
interior 10.6
couple 10.5
celebration 10.4
design 10.1
toilet tissue 10
lace 9.9
retro 9.8
wed 9.8
romantic 9.8
portrait 9.7
man 9.5
decorative 9.2
material 8.9
person 8.9
married 8.6
marriage 8.5
grungy 8.5
two 8.5
traditional 8.3
room 8
tissue 8
flowers 7.8
travel 7.7
attractive 7.7
outdoor 7.6
building 7.6
fashion 7.5
human 7.5
style 7.4
detail 7.2
home 7.2
holiday 7.2
gown 7.1
empty 7.1
surface 7.1

Google
created on 2019-06-05

Photograph 97.2
People 93.7
Snapshot 88.6
Vintage clothing 68.9
Family 66.5
Room 65.7
Photography 62.4
History 54.1

Microsoft
created on 2019-06-05

clothing 98.3
person 97.4
old 91.4
woman 87.9
smile 85.4
human face 71
dress 62.7
posing 60.7
child 52.2
vintage 50.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Confused 45.2%
Angry 45.8%
Surprised 45.5%
Sad 45.9%
Disgusted 46.1%
Calm 51.3%
Happy 45.2%

AWS Rekognition

Age 30-47
Gender Female, 52.6%
Disgusted 46.2%
Sad 46.7%
Surprised 46.2%
Calm 48.2%
Angry 45.9%
Happy 46.4%
Confused 45.4%

AWS Rekognition

Age 45-66
Gender Female, 52.8%
Happy 54.6%
Calm 45.2%
Confused 45%
Disgusted 45%
Surprised 45%
Angry 45%
Sad 45.1%

AWS Rekognition

Age 1-5
Gender Female, 54.8%
Sad 53.8%
Confused 45.1%
Angry 45.2%
Happy 45.2%
Calm 45.5%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 10-15
Gender Female, 54.5%
Disgusted 45.3%
Confused 45.3%
Angry 45.2%
Sad 45.2%
Surprised 45.2%
Happy 47.5%
Calm 51.2%

AWS Rekognition

Age 15-25
Gender Female, 54.9%
Confused 46%
Disgusted 48.1%
Sad 46.4%
Surprised 45.5%
Calm 47.4%
Happy 45.8%
Angry 45.9%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Disgusted 45.4%
Surprised 46.8%
Confused 46.6%
Sad 45.7%
Angry 45.7%
Calm 49.4%
Happy 45.4%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98.4%
Painting 72.5%
Wedding Gown 61.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 91.5%
a vintage photo of a group of people posing for a picture 91.4%
a vintage photo of some people posing in front of a building 88.3%