Human Generated Data

Title

Social Settlements: United States. Delaware. Wilmington. "Peoples Settlements": The Peoples Settlement, Wilmington, Del.: Ready for the country
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2795.1

Human Generated Data

Title

Social Settlements: United States. Delaware. Wilmington. "Peoples Settlements": The Peoples Settlement, Wilmington, Del.: Ready for the country

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2795.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 98.6
Human 98.6
Person 98.5
Person 97.8
Person 97.5
Painting 97.3
Art 97.3
Person 96.7
Person 96.3
Person 96.3
Person 95.5
Person 90.2
Room 89.6
Indoors 89.6
Person 88.8
Kindergarten 88.4
Person 88.4
Person 83.9
People 76.7
School 74.9
Classroom 73.8
Person 68.6
Interior Design 67
Porch 56
Urban 55.3
Person 54.7

Clarifai
created on 2019-06-05

people 97.4
veil 93.6
art 92.4
desktop 92.1
adult 91.6
illustration 91.1
group 89.7
old 86.9
vintage 86.6
building 86.5
decoration 86.3
retro 86.3
man 85.8
wear 85.4
woman 83.2
architecture 81.8
antique 80.5
wedding 80.3
ceremony 79.9
texture 78.6

Imagga
created on 2019-06-05

tile 31.6
old 27.2
ancient 26.8
art 26.4
texture 22.2
grunge 22.1
antique 22
vintage 20.7
wall 20.4
panel 20.3
brown 19.9
paper 19.1
aged 18.1
sculpture 18
material 16.1
architecture 15.8
pattern 15
parchment 14.4
retro 13.9
marble 13.8
mosaic 13.7
room 13.3
decor 13.3
textured 13.1
stucco 12.6
blank 12
travel 12
rough 11.8
design 11.8
decoration 11.7
map 11.6
stained 11.5
interior 11.5
card 11.4
detail 11.3
creation 11.3
stone 11.1
dirty 10.8
history 10.7
carving 10.6
furniture 10.6
backgrounds 10.5
grungy 10.4
sheet 10.3
empty 10.3
page 10.2
house 10.2
color 10
building 10
yellow 9.9
burnt 9.7
surface 9.7
torn 9.7
geography 9.6
hotel 9.5
weathered 9.5
traditional 9.1
fabric 8.8
canvas 8.5
earth 8.5
frame 8.4
wallpaper 8.4
backdrop 8.2
plastic art 8
palace 7.9
temple 7.7
beige 7.7
culture 7.7
cloth 7.7
home 7.7
rusty 7.6
statue 7.6
wood 7.5
east 7.5
document 7.4
natural 7.4
book 7.3
parquet 7.2
world 7.1

Google
created on 2019-06-05

Photograph 96.8
People 93.7
Snapshot 86.8
Room 65.7
Photography 62.4
Family 60.7
Vintage clothing 57
Art 50.2

Microsoft
created on 2019-06-05

person 97.8
clothing 97.3
human face 94.9
child 94.7
smile 90.8
old 88.4
window 81.8
girl 79.5
white 65
woman 61.5
family 61.1
posing 58.1
vintage 25.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 53%
Calm 49.7%
Disgusted 45.2%
Angry 45.5%
Sad 48.5%
Happy 45.5%
Confused 45.3%
Surprised 45.3%

AWS Rekognition

Age 15-25
Gender Female, 54.8%
Angry 45.4%
Calm 46.7%
Disgusted 45.2%
Happy 50.6%
Surprised 45.6%
Sad 46.1%
Confused 45.4%

AWS Rekognition

Age 15-25
Gender Female, 54.2%
Happy 45.3%
Angry 45.3%
Calm 53.2%
Disgusted 45.2%
Sad 45.8%
Confused 45.1%
Surprised 45.2%

AWS Rekognition

Age 19-36
Gender Female, 51.4%
Sad 47.7%
Surprised 45.2%
Disgusted 45.4%
Calm 47.7%
Happy 45.2%
Confused 45.3%
Angry 48.7%

AWS Rekognition

Age 15-25
Gender Female, 54.6%
Happy 45.2%
Surprised 45.1%
Calm 45.4%
Confused 45.1%
Disgusted 45.2%
Angry 45.7%
Sad 53.4%

AWS Rekognition

Age 35-52
Gender Female, 53.7%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%
Happy 45.1%
Calm 45.7%
Sad 53.8%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Confused 45.7%
Disgusted 45.5%
Happy 45.9%
Calm 47.9%
Surprised 45.9%
Sad 48.1%
Angry 46%

AWS Rekognition

Age 6-13
Gender Female, 54.4%
Calm 45.3%
Disgusted 45.2%
Confused 45.3%
Happy 45.5%
Angry 45.7%
Surprised 45.2%
Sad 52.8%

AWS Rekognition

Age 15-25
Gender Female, 51.8%
Sad 46.7%
Disgusted 45.6%
Confused 45.2%
Angry 50.8%
Happy 45.5%
Surprised 45.3%
Calm 45.9%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Confused 46.1%
Calm 46.4%
Angry 45.5%
Sad 47.4%
Happy 48.7%
Disgusted 45.4%
Surprised 45.5%

AWS Rekognition

Age 11-18
Gender Female, 54.1%
Disgusted 45.3%
Confused 45.4%
Angry 46.1%
Calm 45.4%
Surprised 45.7%
Happy 51.5%
Sad 45.6%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Angry 45.4%
Disgusted 45.1%
Confused 45.1%
Calm 45.7%
Happy 47.1%
Surprised 45.1%
Sad 51.5%

AWS Rekognition

Age 26-43
Gender Male, 51.1%
Happy 45.6%
Disgusted 46.1%
Sad 48.9%
Confused 45.6%
Angry 45.9%
Surprised 45.4%
Calm 47.5%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Surprised 45.6%
Calm 46.4%
Happy 47.6%
Sad 48.1%
Angry 45.5%
Confused 45.4%
Disgusted 46.3%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Sad 46.9%
Confused 45%
Angry 45.1%
Happy 52.8%
Calm 45.1%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 20-38
Gender Female, 53.6%
Happy 45.1%
Disgusted 45.1%
Confused 45.1%
Angry 45.4%
Surprised 45.1%
Sad 54.1%
Calm 45.2%

AWS Rekognition

Age 4-9
Gender Female, 53.1%
Confused 45.4%
Angry 47.5%
Disgusted 45.2%
Surprised 45.2%
Sad 50.8%
Happy 45.2%
Calm 45.7%

AWS Rekognition

Age 11-18
Gender Female, 54.8%
Angry 45.1%
Calm 45.1%
Sad 47.8%
Disgusted 45.1%
Happy 51.8%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 4-7
Gender Female, 55%
Angry 45.2%
Disgusted 45.3%
Sad 48.7%
Confused 45.3%
Happy 49.9%
Surprised 45.2%
Calm 45.3%

AWS Rekognition

Age 20-38
Gender Female, 53.3%
Sad 48.3%
Disgusted 46.2%
Angry 45.6%
Surprised 45.5%
Calm 46.9%
Confused 45.7%
Happy 46.8%

AWS Rekognition

Age 27-44
Gender Female, 50.7%
Confused 45.2%
Calm 45.8%
Happy 45.3%
Surprised 45.2%
Sad 52.2%
Angry 46%
Disgusted 45.2%

AWS Rekognition

Age 35-52
Gender Female, 54%
Surprised 46.2%
Sad 47.2%
Happy 46.7%
Disgusted 46.3%
Confused 46.8%
Calm 46.2%
Angry 45.6%

AWS Rekognition

Age 12-22
Gender Female, 54.3%
Surprised 45.5%
Happy 46.4%
Sad 46.4%
Calm 50.1%
Confused 45.5%
Disgusted 45.7%
Angry 45.4%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Surprised 45.3%
Happy 50.3%
Sad 47.3%
Calm 45.6%
Confused 45.4%
Disgusted 45.7%
Angry 45.4%

AWS Rekognition

Age 11-18
Gender Female, 53.3%
Disgusted 46.2%
Happy 47.1%
Sad 45.9%
Angry 46.1%
Calm 48.2%
Confused 45.7%
Surprised 45.7%

AWS Rekognition

Age 35-52
Gender Female, 53.9%
Surprised 45.7%
Calm 48.9%
Happy 46%
Sad 46.8%
Angry 46.1%
Confused 45.4%
Disgusted 46%

AWS Rekognition

Age 15-25
Gender Female, 53.6%
Calm 45.7%
Disgusted 45.4%
Confused 45.3%
Happy 45.2%
Angry 45.4%
Surprised 45.2%
Sad 52.8%

AWS Rekognition

Age 14-25
Gender Female, 53.3%
Happy 46.3%
Surprised 45.5%
Calm 45.5%
Angry 46.6%
Confused 45.3%
Sad 49.2%
Disgusted 46.5%

AWS Rekognition

Age 15-25
Gender Female, 52.9%
Sad 52.5%
Confused 45.2%
Angry 45.4%
Surprised 45.3%
Happy 45.4%
Calm 46%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Sad 47%
Confused 45.2%
Calm 45.4%
Disgusted 45.1%
Happy 51.9%
Angry 45.2%
Surprised 45.2%

AWS Rekognition

Age 4-9
Gender Female, 54.3%
Angry 46.2%
Happy 45.7%
Disgusted 45.2%
Surprised 45.3%
Calm 45.8%
Confused 45.4%
Sad 51.4%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 21
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98.6%
Painting 97.3%

Categories

Imagga

interior objects 56.4%
paintings art 42.4%
food drinks 1%

Text analysis

Amazon

S'
)2

Google

2
2