Human Generated Data

Title

Social Settlements: United States. New York. New York City. "University Settlement": University Settlement, New York City.: Basket Ball and Base Ball Teams at Recreation Center. Public School No. 20 Near Settlement.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3203.2

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "University Settlement": University Settlement, New York City.: Basket Ball and Base Ball Teams at Recreation Center. Public School No. 20 Near Settlement.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3203.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.7
Person 99.7
Person 99
Person 98.9
Person 98.3
Person 98.1
Person 98
Person 97.9
Person 96.7
Person 94.3
Person 94.1
Person 94
Person 94
Person 93.5
People 92.8
Person 91.6
Person 85.7
Person 85.2
Person 83.5
Person 71
Transportation 64.8
Armored 59.7
Military Uniform 59.7
Army 59.7
Military 59.7
Troop 59.7
Vehicle 58.3
Kindergarten 56.3
Kid 56.2
Child 56.2

Clarifai
created on 2019-06-06

people 100
group 98.7
child 98.4
adult 97.6
group together 97.6
many 95.8
man 94.8
wear 93.3
woman 89.5
son 89.2
several 86.7
portrait 86.2
retro 86.1
war 85.3
five 83.9
three 83.6
boy 83.6
four 83.4
military 82.7
sepia 82.3

Imagga
created on 2019-06-06

sketch 56.1
drawing 51.5
grunge 47.7
vintage 42.2
old 41.8
aged 38.9
texture 36.8
representation 34.4
antique 31.4
retro 26.2
decoration 24.6
art 24.4
wallpaper 23.7
grungy 23.7
graffito 23.5
dirty 21.7
pattern 19.8
stain 19.2
ancient 19
graphic 19
paper 18.8
material 18.8
design 18.6
paint 18.1
canvas 18
flower 16.9
rough 16.4
decorative 15.9
wall 15.9
textured 15.8
grain 15.7
artistic 15.6
aging 15.3
floral 15.3
frame 15.2
structure 14.8
decay 14.5
edge 14.4
obsolete 14.4
style 14.1
border 13.6
color 13.4
brown 13.2
space 13.2
text 13.1
backgrounds 13
grime 12.7
crack 12.6
detailed 12.5
silhouette 12.4
worn 12.4
map 12.4
mottled 11.7
fracture 11.7
rust 11.6
surface 11.5
stencil 11.4
page 11.1
painterly 10.9
smudged 10.8
dirt 10.5
damaged 10.5
rusty 10.5
textures 10.4
artwork 10.1
effect 10
distressed 9.8
messy 9.7
detail 9.7
geography 9.6
leaf 9.3
plants 9.3
backdrop 9.1
black 9
world 9
stained 8.7
architecture 8.6
blank 8.6
creative 7.9
atlas 7.9
scratch 7.8
burnt 7.8
states 7.7
empty 7.7
card 7.7
painting 7.5
element 7.4
close 7.4
letter 7.3
earth 7.3
negative 7.2

Google
created on 2019-06-06

Photograph 96.4
People 93.1
Team 90.3
Snapshot 82
Photography 62.4
Family 54.3
History 54.1
Team sport 50.7

Microsoft
created on 2019-06-06

person 98.1
clothing 97.6
smile 90.6
old 89.9
human face 81.3
child 66.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 51.2%
Angry 45.8%
Surprised 45.5%
Sad 45.6%
Confused 45.8%
Calm 52.1%
Disgusted 45.2%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Sad 54.2%
Calm 45.3%
Surprised 45%
Confused 45.2%
Disgusted 45.1%
Happy 45.1%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Calm 46.8%
Sad 52.3%
Happy 45%
Confused 45.5%
Angry 45.3%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Confused 45%
Surprised 45.1%
Angry 45.1%
Happy 45%
Sad 45.1%
Calm 54.6%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Male, 51.7%
Surprised 45%
Disgusted 45%
Angry 54.5%
Sad 45.4%
Happy 45%
Confused 45%
Calm 45%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Calm 50.5%
Confused 45.2%
Happy 45.1%
Disgusted 45%
Angry 45.3%
Surprised 45.1%
Sad 48.8%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Angry 47.6%
Calm 49.4%
Surprised 45.1%
Sad 47.4%
Disgusted 45.1%
Happy 45.1%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Male, 53.8%
Disgusted 45%
Happy 45%
Angry 45.5%
Surprised 45.1%
Sad 46.4%
Confused 45.2%
Calm 52.8%

AWS Rekognition

Age 23-38
Gender Male, 54.2%
Disgusted 45.1%
Confused 45.4%
Surprised 45.1%
Calm 45.8%
Happy 45.1%
Angry 50.5%
Sad 48.1%

AWS Rekognition

Age 26-43
Gender Male, 53%
Calm 47.5%
Sad 49.1%
Surprised 45.2%
Angry 47.6%
Happy 45.1%
Confused 45.5%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Confused 45.2%
Disgusted 45.4%
Sad 48.5%
Angry 45.5%
Surprised 45.3%
Happy 46.8%
Calm 48.4%

AWS Rekognition

Age 20-38
Gender Male, 53.7%
Calm 45.1%
Confused 45%
Happy 45%
Disgusted 45%
Angry 45.1%
Surprised 45%
Sad 54.7%

AWS Rekognition

Age 48-68
Gender Male, 51.9%
Angry 52.2%
Calm 45.5%
Disgusted 45.2%
Surprised 45.1%
Sad 46.7%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 51%
Calm 45.3%
Surprised 45.4%
Happy 45.2%
Disgusted 45.3%
Angry 47.4%
Sad 50.7%
Confused 45.6%

AWS Rekognition

Age 20-38
Gender Male, 52.7%
Happy 45%
Sad 45%
Confused 45%
Calm 55%
Angry 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Confused 45.1%
Happy 54.6%
Sad 45.1%
Disgusted 45.1%
Angry 45.1%
Calm 45.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 54.2%
Happy 45.1%
Disgusted 45.2%
Surprised 45.1%
Sad 46.6%
Confused 45.4%
Angry 45.2%
Calm 52.4%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 93.8%
people portraits 5%

Captions

Microsoft
created on 2019-06-06

a vintage photo of a person 78.1%
a vintage photo of a girl 64.9%
an old photo of a person 64.8%

Text analysis

Google

WNEE AC RD 20 WNEEA.C
WNEE
AC
RD
20
WNEEA.C