Human Generated Data

Title

Social Settlements: United States. Alabama. Calhoun. "Calhoun Colored School": Calhoun Colored School, Calhoun, Ala.: "Raw Material."

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.241.2

Human Generated Data

Title

Social Settlements: United States. Alabama. Calhoun. "Calhoun Colored School": Calhoun Colored School, Calhoun, Ala.: "Raw Material."

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.1
Human 99.1
Clothing 82.1
Apparel 82.1
Ground 79.9
Female 71.5
Face 67.1
Photography 66.5
Photo 66.5
Portrait 65.6
Grass 62.8
Plant 62.8
People 61.5

Imagga
created on 2022-06-25

child 34
person 28.1
outdoors 27.9
pedestrian 25
people 22.9
adult 22
beach 19.6
man 19.5
male 19.3
summer 18.7
lifestyle 18.1
leisure 17.4
active 17.1
outdoor 16.8
happiness 16.5
walking 16.1
outside 15.4
juvenile 14.7
sky 14.7
sand 14.3
fun 14.2
women 13.4
day 13.3
healthy 13.2
happy 13.2
sport 13.1
grass 12.7
love 12.6
hiking 12.5
park 12.4
autumn 12.3
play 12.1
sexy 12.1
travel 12
hair 11.9
family 11.6
fashion 11.3
blond 11.3
field 10.9
smiling 10.9
dress 10.8
recreation 10.8
clothing 10.7
forest 10.4
two 10.2
sea 10.2
model 10.1
countryside 10.1
relaxation 10.1
playing 10
girls 10
exercise 10
vacation 9.8
attractive 9.8
tree 9.8
human 9.8
portrait 9.7
run 9.7
couple 9.6
boy 9.6
walk 9.5
men 9.5
smile 9.3
fit 9.2
hand 9.1
children 9.1
activity 9
life 8.9
color 8.9
mountain 8.9
kid 8.9
water 8.7
holiday 8.6
joy 8.4
health 8.3
holding 8.3
fitness 8.1
cheerful 8.1
sunset 8.1
sun 8.1
together 7.9
face 7.8
black 7.3
looking 7.2
body 7.2
world 7.1
country 7
season 7

Google
created on 2022-06-25

Plant 91.9
People in nature 84.2
Sleeve 83.9
Sky 77.9
Tints and shades 77.3
Tree 77.3
Grass 76.7
Landscape 76.3
Vintage clothing 75
Monochrome photography 71.6
Monochrome 70.3
Waist 69.4
Human leg 65.6
Fashion design 63.4
Smile 61.8
Knee 61.6
Wood 61.3
Soil 60.9
Day dress 59.8
History 54.9

Microsoft
created on 2022-06-25

outdoor 100
tree 99.9
clothing 95.4
person 93.9
text 58.4
dirt 22.9

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 96.6%
Sad 96.5%
Calm 45.8%
Surprised 6.5%
Fear 6%
Angry 1.1%
Confused 0.8%
Disgusted 0.8%
Happy 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a person walking down a dirt road 93.7%
a person standing in a field 93.3%
a person standing in a dirt field 93.2%

Text analysis

Amazon

14
3
S
n 3
n

Google

Sz