Human Generated Data

Title

Social Settlements: United States. New York. New York City. "University Settlement": University Settlement, New York City.: Basket Ball and Base Ball Teams at Recreation Center. Public School No. 20 Near Settlement.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3203.1

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "University Settlement": University Settlement, New York City.: Basket Ball and Base Ball Teams at Recreation Center. Public School No. 20 Near Settlement.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.7
Person 99.7
Person 99.5
Person 99.4
Person 99.2
Person 99.1
Person 98.9
Person 98.8
Person 98.6
People 91.3
Shorts 86.1
Apparel 86.1
Clothing 86.1
Transportation 73
Vehicle 71.6
Oars 67.6
Field 60.3
Vessel 60.1
Watercraft 60.1
Person 59.6
Team 58
Sports 58
Team Sport 58
Sport 58
Brick 56.6

Clarifai
created on 2019-06-06

people 99.8
group together 99.4
child 97.9
wear 96.8
group 96.2
adult 95.5
man 93.7
two 92
many 91.9
recreation 91.4
several 90.2
four 90.1
boy 89.8
three 89.1
woman 88.7
fun 84.5
athlete 83.5
five 83.2
competition 82.7
sibling 82.5

Imagga
created on 2019-06-06

fountain 100
structure 100
grunge 42.6
texture 38.2
old 29.3
antique 27.7
aged 27.1
vintage 26.5
pattern 24.6
dirty 24.4
grungy 23.7
wallpaper 23
frame 22.5
wall 21.4
border 20.8
art 19.5
design 19.1
surface 18.5
paint 18.1
retro 18
textured 17.5
rough 17.3
damaged 17.2
decoration 16.8
paper 15.7
canvas 15.2
color 15
space 14.7
water 14.7
graphic 14.6
negative 13.8
edge 13.5
aging 13.4
cool 13.3
weathered 13.3
brown 13.2
backdrop 13.2
ancient 13
stain 12.5
text 12.2
material 11.6
messy 11.6
decay 11.6
stained 11.5
natural 10.7
parchment 10.6
backgrounds 10.5
dirt 10.5
rusty 10.5
artistic 10.4
cold 10.3
empty 10.3
blank 10.3
light 10
decorative 10
film 9.7
worn 9.5
ice 9.5
stone 9.4
artwork 9.2
close 9.1
black 9
graffito 9
burnt 8.7
crack 8.7
rust 8.7
detailed 8.7
obsolete 8.6
card 8.5
travel 8.4
blackboard 8.4
dark 8.3
silhouette 8.3
effect 8.2
digital 8.1
detail 8
ocean 7.9
splash 7.9
scratches 7.9
forest 7.8
noise 7.8
grime 7.8
stains 7.8
snow 7.7
textures 7.6
sheet 7.5
grain 7.4
drop 7.3
drawing 7.1

Google
created on 2019-06-06

Photograph 96.9
Snapshot 85.5
Family 64
Photography 62.4
Stock photography 59.4
Team 59.4
Picture frame 56.7

Microsoft
created on 2019-06-06

outdoor 97.3
clothing 96.9
person 96.5
old 95
smile 91.8
woman 78.1
man 73.5
human face 71
posing 47.7
vintage 29.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Female, 50.8%
Confused 45.1%
Disgusted 45%
Sad 46.4%
Angry 45.1%
Surprised 45.1%
Happy 45.1%
Calm 53.2%

AWS Rekognition

Age 15-25
Gender Male, 53.1%
Confused 45.2%
Disgusted 45.1%
Calm 50.3%
Sad 48.2%
Angry 45.9%
Happy 45.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.1%
Angry 45.3%
Happy 46.8%
Confused 45.1%
Surprised 45.2%
Sad 46.7%
Disgusted 45.2%
Calm 50.6%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Calm 45.5%
Happy 54%
Sad 45.2%
Angry 45.1%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 16-27
Gender Female, 51.6%
Confused 45.3%
Calm 51.6%
Disgusted 45.2%
Sad 47%
Happy 45.2%
Angry 45.5%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Sad 46%
Calm 53.7%
Happy 45.1%
Surprised 45%
Angry 45.1%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 19-36
Gender Male, 54.3%
Calm 51.2%
Confused 45.3%
Happy 45.4%
Surprised 45.2%
Angry 45.2%
Disgusted 45.1%
Sad 47.4%

AWS Rekognition

Age 19-36
Gender Female, 50%
Disgusted 45%
Happy 46.1%
Angry 45.3%
Surprised 45%
Sad 53.3%
Confused 45.1%
Calm 45.2%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 85.9%
a vintage photo of a group of people posing for a picture 85.8%
an old photo of a group of people posing for the camera 85.7%

Text analysis

Amazon

190

Google

190
190