Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Some of the Boys
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2380.2

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Some of the Boys

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2380.2

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Person 99.2
Person 99.1
Person 98.9
Furniture 98.7
Bicycle 89.8
Bike 89.8
Transportation 89.8
Vehicle 89.8
People 83.6
Bench 81.9
Nature 68.8
Outdoors 68.6
Ground 63.7
Grass 63.4
Plant 63.4
Military 60.9
Military Uniform 60.9
Yard 58
Army 58
Armored 58
Barefoot 57.7
Park Bench 56.2

Clarifai
created on 2019-06-04

people 99.7
group 98.4
group together 98.4
child 98
adult 94.5
many 92.5
portrait 91.3
wear 90.6
boy 88.9
man 87.2
several 84.8
sibling 82.3
offspring 82.3
four 81.3
war 81.3
family 79.9
five 77.5
administration 77.1
military 76.9
woman 76.2

Imagga
created on 2019-06-04

helmet 100
football helmet 100
headdress 80.5
clothing 53.6
people 27.3
consumer goods 27.3
covering 27
man 26.9
athlete 25.3
outdoors 24.6
player 22.2
ballplayer 21.6
male 19.9
grass 19
person 18.9
summer 17.4
happiness 17.2
sunset 17.1
outdoor 16.8
love 16.6
child 15.1
joy 15
adult 14.9
couple 14.8
sky 14.7
lifestyle 14.4
fun 14.2
contestant 14.2
park 14
boy 13.9
portrait 13.6
leisure 13.3
sport 12.8
beach 12.6
field 12.5
family 12.4
happy 11.9
together 11.4
play 11.2
men 11.2
outside 11.1
active 10.8
silhouette 10.8
black 10.2
smiling 10.1
autumn 9.7
day 9.4
youth 9.4
relationship 9.4
freedom 9.1
meadow 9
activity 9
women 8.7
run 8.7
walking 8.5
old 8.4
holding 8.2
competition 8.2
teenager 8.2
girls 8.2
bench 8.1
childhood 8.1
sun 8
romance 8
kid 8
casual 7.6
two 7.6
clouds 7.6
relax 7.6
free 7.5
human 7.5
playing 7.3
color 7.2

Google
created on 2019-06-04

Photograph 96.3
People 95.6
Snapshot 83.3
Tree 68.7
Photography 67.8
Adaptation 67
Vintage clothing 66.6
Family 64.8
Child 64.5
Black-and-white 56.4
Team 52.3

Microsoft
created on 2019-06-04

grass 100
outdoor 99.9
tree 99.8
person 97.9
clothing 95
posing 94.8
child 94.7
boy 91.4
field 84.1
standing 79.9
group 76.4
smile 72
team 66.2
toddler 62
people 60

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-13
Gender Female, 50.1%
Calm 45.4%
Happy 45.1%
Surprised 45.1%
Sad 53.8%
Angry 45.5%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.3%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Sad 54.4%
Surprised 45%
Happy 45%
Calm 45.1%

AWS Rekognition

Age 15-25
Gender Male, 53.6%
Confused 45.4%
Surprised 45.2%
Calm 46.5%
Angry 47%
Disgusted 45.1%
Happy 45.1%
Sad 50.7%

AWS Rekognition

Age 19-36
Gender Male, 53.5%
Calm 47.1%
Sad 50.5%
Angry 45.2%
Disgusted 45.1%
Confused 45.4%
Happy 46.4%
Surprised 45.3%

AWS Rekognition

Age 16-27
Gender Female, 54.4%
Calm 46.9%
Confused 45.1%
Happy 45.1%
Sad 52.5%
Surprised 45.1%
Disgusted 45.1%
Angry 45.2%

AWS Rekognition

Age 4-7
Gender Female, 54.6%
Angry 45.4%
Calm 45.1%
Confused 45.1%
Disgusted 45%
Happy 45.1%
Sad 54.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Bicycle
Person 99.7%
Person 99.6%
Person 99.5%
Person 99.2%
Person 99.1%
Person 98.9%
Bicycle 89.8%

Text analysis

Amazon

897
3ki
Vyw/

Google

&97
&97