Human Generated Data

Title

Social Settlements: United States. New York. Buffalo. "Welcome Hall": Welcome Hall, Buffalo, N.Y.: The Playground and Scenes in the Vicinity.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3136.8

Human Generated Data

Title

Social Settlements: United States. New York. Buffalo. "Welcome Hall": Welcome Hall, Buffalo, N.Y.: The Playground and Scenes in the Vicinity.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3136.8

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 97.7
Person 97.7
Play 93.7
Playground 89.8
Play Area 89.8
Face 82.5
Clothing 82.2
Apparel 82.2
Cutlery 80.5
Spoon 75.4
Bird 68.7
Animal 68.7
Photography 67.1
Portrait 67.1
Photo 67.1
Child 66.3
Kid 66.3
Bird 65.7
Outdoors 59.8
Boy 57.7

Clarifai
created on 2019-06-05

people 99.8
child 99.6
one 99
wear 98.2
adult 95.4
boy 94.5
two 94.1
man 91.3
portrait 91
recreation 87.9
street 86.5
retro 81.7
fun 80.4
three 79.3
group 78.6
lid 78.1
woman 77.2
competition 77.1
group together 74.7
music 74.4

Imagga
created on 2019-06-05

swing 52
child 43.4
plaything 41.6
mechanical device 41.1
mechanism 30.6
people 22.3
fun 19.5
kid 17.7
little 17.7
person 17.5
portrait 17.5
summer 16.7
boy 16.5
happy 16.3
youth 15.3
outdoor 15.3
childhood 15.2
cute 15.1
outdoors 14.9
happiness 14.9
beach 14.3
adult 14.2
face 14.2
joy 14.2
sand 13.8
women 13.4
family 13.3
leash 13.3
lifestyle 13
hair 12.7
vacation 12.3
smile 12.1
sitting 12
playing 11.9
sibling 11.7
smiling 11.6
park 11.5
man 11.4
hand 11.4
play 11.2
pretty 11.2
long 11
active 10.8
restraint 10.6
look 10.5
attractive 10.5
snow 10.1
children 10
leisure 10
together 9.6
toddler 9.6
mother 9.5
male 9.5
love 9.5
outside 9.4
sea 9.4
casual 9.3
stone 9.3
blond 9.1
black 9
cheerful 8.9
brother 8.7
sad 8.7
wall 8.6
device 8.5
sit 8.5
head 8.4
one 8.2
activity 8.1
wheeled vehicle 8
parent 8
skateboard 8
sadness 7.8
eyes 7.7
juvenile 7.5
resort area 7.5
baby 7.5
adorable 7.4
girls 7.3
looking 7.2
autumn 7

Google
created on 2019-06-05

Photograph 96.5
Child 90.1
Snapshot 86
Standing 79.6
Fun 70.4
Adaptation 67
Photography 62.4
Play 57.3
Black-and-white 56.4
Monochrome 54.4
Smile 54

Microsoft
created on 2019-06-05

ground 99.9
outdoor 98.6
human face 93.4
clothing 93.2
toddler 91.9
person 90.4
little 90.2
child 88.8
smile 88
baby 83.3
young 80.2
boy 73.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 78.8%
Calm 2.9%
Confused 3.4%
Sad 8%
Surprised 1.6%
Happy 80.1%
Disgusted 2.1%
Angry 1.9%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Bird 68.7%

Categories

Imagga

beaches seaside 93%
paintings art 3%
nature landscape 2.3%
pets animals 1.2%

Captions

Text analysis

Amazon

sn
sn ns
ns

Google

5
5