Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Some of the Boys

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Some of the Boys

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon

Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.2
Person 99.1
Person 98.9
Furniture 98.7
Bicycle 89.8
Vehicle 89.8
Bike 89.8
Transportation 89.8
People 83.6
Bench 81.9
Nature 68.8
Outdoors 68.6
Ground 63.7
Plant 63.4
Grass 63.4
Military 60.9
Military Uniform 60.9
Yard 58
Army 58
Armored 58
Barefoot 57.7
Park Bench 56.2

Clarifai

people 99.7
group 98.4
group together 98.4
child 98
adult 94.5
many 92.5
portrait 91.3
wear 90.6
boy 88.9
man 87.2
several 84.8
sibling 82.3
offspring 82.3
four 81.3
war 81.3
family 79.9
five 77.5
administration 77.1
military 76.9
woman 76.2

Imagga

football helmet 100
helmet 100
headdress 80.5
clothing 53.6
people 27.3
consumer goods 27.3
covering 27
man 26.9
athlete 25.3
outdoors 24.6
player 22.2
ballplayer 21.6
male 19.9
grass 19
person 18.9
summer 17.4
happiness 17.2
sunset 17.1
outdoor 16.8
love 16.6
child 15.1
joy 15
adult 14.9
couple 14.8
sky 14.7
lifestyle 14.4
fun 14.2
contestant 14.2
park 14
boy 13.9
portrait 13.6
leisure 13.3
sport 12.8
beach 12.6
field 12.5
family 12.4
happy 11.9
together 11.4
play 11.2
men 11.2
outside 11.1
active 10.8
silhouette 10.8
black 10.2
smiling 10.1
autumn 9.7
day 9.4
youth 9.4
relationship 9.4
freedom 9.1
meadow 9
activity 9
women 8.7
run 8.7
walking 8.5
old 8.4
holding 8.2
competition 8.2
teenager 8.2
girls 8.2
bench 8.1
childhood 8.1
sun 8
romance 8
kid 8
casual 7.6
two 7.6
clouds 7.6
relax 7.6
free 7.5
human 7.5
playing 7.3
color 7.2

Google

Photograph 96.3
People 95.6
Snapshot 83.3
Tree 68.7
Photography 67.8
Adaptation 67
Vintage clothing 66.6
Family 64.8
Child 64.5
Black-and-white 56.4
Team 52.3

Microsoft

grass 100
outdoor 99.9
tree 99.8
person 97.9
clothing 95
posing 94.8
child 94.7
boy 91.4
field 84.1
standing 79.9
group 76.4
smile 72
team 66.2
toddler 62
people 60

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-13
Gender Female, 50.1%
Calm 45.4%
Happy 45.1%
Surprised 45.1%
Sad 53.8%
Angry 45.5%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.3%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Sad 54.4%
Surprised 45%
Happy 45%
Calm 45.1%

AWS Rekognition

Age 15-25
Gender Male, 53.6%
Confused 45.4%
Surprised 45.2%
Calm 46.5%
Angry 47%
Disgusted 45.1%
Happy 45.1%
Sad 50.7%

AWS Rekognition

Age 19-36
Gender Male, 53.5%
Calm 47.1%
Sad 50.5%
Angry 45.2%
Disgusted 45.1%
Confused 45.4%
Happy 46.4%
Surprised 45.3%

AWS Rekognition

Age 16-27
Gender Female, 54.4%
Calm 46.9%
Confused 45.1%
Happy 45.1%
Sad 52.5%
Surprised 45.1%
Disgusted 45.1%
Angry 45.2%

AWS Rekognition

Age 4-7
Gender Female, 54.6%
Angry 45.4%
Calm 45.1%
Confused 45.1%
Disgusted 45%
Happy 45.1%
Sad 54.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Bicycle 89.8%

Captions

Microsoft

Caleb Cheeshahteaumuck et al. posing for a photo 98.9%
Caleb Cheeshahteaumuck et al. posing for a picture 98.8%
Caleb Cheeshahteaumuck et al. standing in a field posing for the camera 98.5%

Text analysis

Amazon

897
3ki
Vyw/

Google

&97
&97