Human Generated Data

Title

Social Settlements: United States. New York. New York City. University Settlement: University Settlement, New York City: Young Women's Gymnasium Class.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.182.2

Human Generated Data

Title

Social Settlements: United States. New York. New York City. University Settlement: University Settlement, New York City: Young Women's Gymnasium Class.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.182.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 95.9
Person 95.9
Person 95.5
Person 95.2
Person 94.4
Person 92.6
Person 90.3
Person 82.4
Crowd 74.9
Person 72.1
People 69.8
Room 65.1
Indoors 65.1
Person 63.7
Floor 57.6

Clarifai
created on 2019-06-05

people 99.8
adult 98.5
child 97.5
woman 96.7
group 95.2
wear 95
indoors 94.7
man 94.3
many 88.3
education 87.5
family 86.1
illustration 85
room 84
sit 80.2
veil 79.2
portrait 76.9
school 76.4
music 76.1
ceremony 75.7
furniture 75.6

Imagga
created on 2019-06-05

carton 69
container 61.7
box 51.9
old 37.6
grunge 37.5
vintage 35.7
paper 33.4
texture 32
envelope 31.1
map 29.9
antique 24.6
aged 24.4
wallpaper 21.4
retro 21.3
dirty 20.8
empty 18
blank 18
design 16.9
frame 16.1
ancient 14.7
wall 14.7
pattern 14.4
textured 14
representation 13.5
art 13.2
border 12.7
decay 12.5
damaged 12.4
board 12.4
grungy 12.3
sheet 12.2
page 12.1
document 12.1
note 11.9
letter 11.9
material 11.6
geography 11.5
business 11.5
structure 11.5
rusty 11.4
canvas 11.4
rough 10.9
space 10.9
classroom 10.6
world 10.6
card 10.6
parchment 10.6
aging 10.5
artistic 10.4
tile 9.9
faded 9.7
stain 9.6
brown 9.6
graphic 9.5
floral 9.4
leaf 9.3
panel 9.2
horizontal 9.2
backdrop 9.1
atlas 9
blackboard 9
backgrounds 8.9
new 8.9
surface 8.8
grime 8.8
ragged 8.8
crumpled 8.7
cardboard 8.6
worn 8.6
weathered 8.5
flower 8.5
decorative 8.4
color 8.3
school 8.2
happy 8.1
home 8
country 7.9
text 7.9
people 7.8
mottled 7.8
education 7.8
fracture 7.8
rust 7.7
house 7.5
study 7.5
style 7.4
student 7.4
grain 7.4
template 7.3
artwork 7.3
message 7.3
room 7.3
paint 7.2
interior 7.1

Google
created on 2019-06-05

Photograph 96.2
Snapshot 86.7
Text 85.2
Room 71.4
Photography 62.4
Family 54.8

Microsoft
created on 2019-06-05

person 97.5
clothing 96.7
furniture 72
picture frame 6.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 53.5%
Happy 45.1%
Sad 45.6%
Disgusted 45.1%
Angry 45.2%
Surprised 45.1%
Calm 53.9%
Confused 45.1%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Disgusted 45.6%
Sad 47.1%
Calm 50.5%
Surprised 45.6%
Angry 45.4%
Happy 45.4%
Confused 45.5%

AWS Rekognition

Age 11-18
Gender Female, 52.3%
Angry 45.4%
Calm 52.7%
Disgusted 45.2%
Surprised 45.7%
Sad 45.3%
Happy 45.1%
Confused 45.6%

AWS Rekognition

Age 27-44
Gender Male, 52.4%
Calm 45%
Surprised 45%
Confused 45%
Sad 45%
Angry 45%
Disgusted 45%
Happy 54.9%

AWS Rekognition

Age 15-25
Gender Male, 51.6%
Sad 45.3%
Angry 45.2%
Confused 45.1%
Happy 45.1%
Disgusted 45.1%
Surprised 45.3%
Calm 53.9%

AWS Rekognition

Age 20-38
Gender Male, 51.1%
Sad 48%
Surprised 45.1%
Confused 45.3%
Angry 45.7%
Happy 45.1%
Calm 50.7%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Angry 45.9%
Disgusted 45.8%
Sad 45.8%
Surprised 46%
Happy 45.6%
Calm 50.2%
Confused 45.7%

AWS Rekognition

Age 12-22
Gender Female, 51%
Sad 45.7%
Disgusted 45.3%
Angry 45.3%
Surprised 45.3%
Calm 52.7%
Confused 45.4%
Happy 45.3%

AWS Rekognition

Age 12-22
Gender Female, 51.3%
Calm 50.4%
Surprised 45.5%
Happy 45.7%
Disgusted 45.7%
Angry 45.9%
Sad 46.3%
Confused 45.5%

AWS Rekognition

Age 23-38
Gender Female, 53.5%
Disgusted 45.5%
Confused 45.6%
Calm 48.4%
Surprised 46.1%
Happy 48.6%
Sad 45.5%
Angry 45.4%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Sad 46.8%
Angry 45.3%
Happy 48.8%
Surprised 45.7%
Confused 45.5%
Calm 47.4%
Disgusted 45.5%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.9%

Categories

Imagga

paintings art 97.9%
interior objects 1.9%

Captions

Microsoft
created on 2019-06-05

an old photo of a person 44.7%
old photo of a person 38.7%
an old photo of a person 38.1%

Text analysis

Amazon

UNIVERSITY
Young
Women's
Young Women's yrnnasium C1055.
yrnnasium
C1055.
iS

Google

UNIVERSITY Young Women's Gymnasiam Class.
UNIVERSITY
Young
Women's
Gymnasiam
Class.