Human Generated Data

Title

Races, Indians: United States. Virginia. Hampton. Hampton Normal and Industrial School: Before Entering School, Sioux: "Seven little Indians in four different stages of civilization"
Date

1899-1900
People

Artist: Frances Benjamin Johnston, American 1864 - 1952
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.5

Human Generated Data

Title

Races, Indians: United States. Virginia. Hampton. Hampton Normal and Industrial School: Before Entering School, Sioux: "Seven little Indians in four different stages of civilization"

People

Artist: Frances Benjamin Johnston, American 1864 - 1952

Date

1899-1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.5

Machine Generated Data

Tags

Amazon
created on 2022-05-27

Person 99.4
Human 99.4
Person 99.4
Person 98.8
Person 98.2
Clothing 97.7
Apparel 97.7
Person 97.4
Person 97.4
Nature 96.5
Person 96.2
Fog 85.5
Painting 82.3
Art 82.3
Smoke 81.7
People 81.6
Standing 79.2
Outdoors 77.3
Face 69.2
Person 67.2
Pollution 63.6
Smog 62.6
Weather 59.2
Overcoat 58.7
Coat 51.4

Clarifai
created on 2023-10-30

people 100
child 99.9
group 99.7
group together 98.7
portrait 98.6
son 98.2
wear 98.1
family 97.9
sibling 96.8
three 96
five 95.1
four 95
war 92.5
offspring 92.4
boy 91.1
several 89.8
adult 88.4
woman 87.6
man 86.5
sepia 86.5

Imagga
created on 2022-05-27

kin 76
man 29.6
uniform 26.2
male 24.8
people 24.5
person 22.6
military uniform 21.7
outdoors 20.1
clothing 19.9
soldier 19.5
military 18.3
adult 17
outdoor 15.3
sport 14.7
sky 14
army 13.6
danger 13.6
rifle 12.9
world 12.8
family 12.4
gun 12.4
weapon 12.3
travel 12
protection 11.8
happiness 11.7
war 11.6
group 11.3
men 11.2
outside 11.1
love 11
field 10.9
camouflage 10.8
silhouette 10.8
park 10.7
child 10.6
autumn 10.5
walking 10.4
summer 10.3
holding 9.9
portrait 9.7
couple 9.6
grass 9.5
happy 9.4
two 9.3
sunset 9
recreation 9
activity 9
mask 8.8
toxic 8.8
life 8.7
statue 8.7
nuclear 8.7
forest 8.7
boy 8.7
consumer goods 8.7
lifestyle 8.7
covering 8.7
sculpture 8.6
adventure 8.5
beach 8.4
old 8.4
action 8.3
leisure 8.3
fun 8.2
environment 8.2
fall 8.1
active 8.1
to 8
combat 7.9
radioactive 7.8
day 7.8
radiation 7.8
battle 7.8
destruction 7.8
warrior 7.8
protective 7.8
play 7.8
death 7.7
chemical 7.7
gas 7.7
hiking 7.7
landscape 7.4
symbol 7.4
mother 7.3
peace 7.3
girls 7.3
industrial 7.3
dirty 7.2
black 7.2
history 7.2
mountain 7.1
together 7

Google
created on 2022-05-27

People in nature 73.9
Vintage clothing 71
Art 70.9
Uniform 67.9
Grass 65.6
Event 63.9
Visual arts 63.6
History 60.3
Crew 55.8
Team 55.2
Toddler 52.7
Child 52.3
Military organization 51.6

Microsoft
created on 2022-05-27

grass 99.7
person 99
clothing 98.5
outdoor 96
posing 95.2
standing 94.3
old 84.8
woman 81.3
group 79.3
man 73.9
text 66.8
smile 58.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-10
Gender Female, 99.9%
Sad 99.9%
Calm 14.7%
Surprised 6.7%
Fear 6.5%
Angry 2%
Disgusted 1.2%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 4-10
Gender Female, 100%
Sad 100%
Fear 8.2%
Calm 8%
Surprised 6.5%
Angry 0.6%
Disgusted 0.6%
Confused 0.6%
Happy 0.4%

AWS Rekognition

Age 2-8
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 0.6%
Angry 0%
Disgusted 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Male, 58.3%
Sad 99.5%
Calm 33.2%
Fear 6.4%
Surprised 6.4%
Angry 0.5%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Male, 91%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 0.9%
Angry 0.2%
Disgusted 0.1%
Confused 0%
Happy 0%

AWS Rekognition

Age 4-12
Gender Female, 100%
Sad 100%
Calm 14.7%
Surprised 6.4%
Fear 6%
Angry 1%
Confused 0.5%
Disgusted 0.5%
Happy 0.1%

AWS Rekognition

Age 2-10
Gender Male, 95.1%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.9%
Angry 0.1%
Disgusted 0%
Confused 0%
Happy 0%

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 82.3%
Coat 51.4%

Categories

Imagga

people portraits 47.2%
streetview architecture 35.6%
paintings art 10.8%
events parties 5%

Text analysis

Amazon

Before
Entering
Before Entering School
School
Sioux,"97.

Google

1000 Before Entering School Sou 07:
Before
Entering
School
Sou
07
:
1000