Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: A School-Room.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.460.2

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: A School-Room.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.460.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

School 99.2
Classroom 99.1
Room 99.1
Indoors 99.1
Human 99
Person 99
Person 98.9
Person 97.7
Person 97.6
Person 97.2
Person 95.9
Person 86.1
Building 83.6
Factory 79.9
Person 76
Person 65.4
Person 64.8
Mammal 64
Canine 64
Dog 64
Pet 64
Animal 64
Person 63.9
Crowd 55.7
Person 48.2

Clarifai
created on 2019-06-05

people 99.9
many 99.6
group 98.8
adult 98.4
administration 97.1
man 96.6
woman 96.5
group together 93.6
war 91.4
education 89.8
leader 88.1
room 87.3
crowd 86.4
school 86.4
furniture 86.1
military 86.1
home 84.5
chair 83.4
vehicle 82.2
teacher 81

Imagga
created on 2019-06-05

classroom 61.2
room 58.7
chair 24.1
table 22.5
building 20.8
architecture 18.1
interior 17.7
restaurant 17.6
city 16.6
people 15.6
teacher 14.1
men 13.7
travel 13.4
house 13.4
day 13.3
outdoor 13
hall 12.9
center 12.8
work 12.5
wood 12.5
person 12.4
business 12.1
male 12
empty 12
structure 11.9
tourism 11.5
urban 11.4
snow 11.3
scene 11.2
furniture 10.9
man 10.7
indoors 10.5
modern 10.5
seat 10.5
outdoors 10.4
women 10.3
street 10.1
transportation 9.9
chairs 9.8
group 9.7
landscape 9.7
cafeteria 9.5
university 9.5
cold 9.5
glass 9.3
window 9.2
school 8.9
tables 8.9
light 8.7
adult 8.6
meeting 8.5
educator 8.4
inside 8.3
tourist 8.2
park 8.2
new 8.1
home 8
professional 7.9
library 7.9
season 7.8
sitting 7.7
wall 7.7
tree 7.7
old 7.7
winter 7.7
sky 7.6
dinner 7.6
office 7.5
bench 7.4
floor 7.4
black 7.2
team 7.2

Google
created on 2019-06-05

Photograph 95.3
Room 83.5
Snapshot 83.3
History 72.6
Class 71
Classroom 68.6
Event 67
Adaptation 67
Stock photography 64
State school 55
Building 53.4
Illustration 50.4

Microsoft
created on 2019-06-05

person 94.8
indoor 88.3
library 84.2
clothing 77.5
school 65.1
group 62.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Female, 50.4%
Happy 45%
Disgusted 45.1%
Sad 53.2%
Surprised 45.1%
Confused 45.2%
Calm 45.6%
Angry 45.8%

AWS Rekognition

Age 20-38
Gender Female, 51.3%
Angry 45.4%
Calm 46.1%
Disgusted 45.6%
Surprised 45.1%
Sad 51.9%
Happy 45.6%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Confused 45.1%
Angry 52.5%
Disgusted 45%
Calm 45.1%
Happy 45%
Surprised 45%
Sad 47.2%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Angry 45.3%
Happy 45.4%
Calm 45.8%
Confused 45.7%
Sad 52.2%
Disgusted 45.2%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Female, 51.2%
Angry 45.3%
Sad 52.5%
Disgusted 45.2%
Calm 45.2%
Surprised 45.1%
Confused 45.1%
Happy 46.7%

AWS Rekognition

Age 10-15
Gender Female, 52.5%
Angry 46.9%
Disgusted 45.3%
Confused 45.5%
Calm 47.7%
Happy 45.7%
Surprised 45.8%
Sad 48%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Calm 49.8%
Angry 49.6%
Happy 49.6%
Sad 49.9%
Surprised 49.6%
Confused 49.6%
Disgusted 49.5%

AWS Rekognition

Age 9-14
Gender Female, 50.3%
Calm 49.7%
Sad 50.1%
Angry 49.6%
Surprised 49.5%
Disgusted 49.6%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.5%
Disgusted 49.5%
Calm 50.3%
Surprised 49.5%
Happy 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.6%
Happy 49.6%
Confused 49.5%
Calm 49.6%
Disgusted 49.6%
Angry 49.7%
Sad 49.9%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Sad 51.2%
Angry 46.1%
Disgusted 45.4%
Surprised 45.5%
Happy 45.8%
Calm 45.8%
Confused 45.3%

AWS Rekognition

Age 15-25
Gender Female, 53.7%
Disgusted 45.6%
Surprised 45.8%
Sad 48.2%
Angry 47.8%
Happy 45.5%
Confused 45.4%
Calm 46.6%

AWS Rekognition

Age 11-18
Gender Female, 50.2%
Calm 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.3%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Surprised 49.5%
Happy 49.6%
Calm 50.1%
Disgusted 49.6%
Confused 49.5%
Sad 49.6%
Angry 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.2%
Calm 49.6%
Happy 49.6%
Sad 49.9%
Angry 49.7%
Confused 49.5%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 45-63
Gender Female, 50.2%
Angry 49.6%
Disgusted 49.6%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Sad 50.2%
Confused 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Calm 49.9%
Disgusted 49.5%
Surprised 49.6%
Confused 49.6%
Angry 49.6%
Sad 49.8%
Happy 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50%
Sad 50.1%
Angry 49.6%
Happy 49.6%
Disgusted 49.5%
Calm 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Happy 49.5%
Sad 50.4%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Disgusted 49.8%
Surprised 49.6%
Sad 49.8%
Angry 49.6%
Happy 49.5%
Confused 49.6%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Angry 46%
Surprised 45.7%
Disgusted 46.7%
Sad 45.5%
Happy 45.7%
Confused 45.2%
Calm 50.2%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Angry 49.7%
Surprised 49.6%
Sad 49.6%
Confused 49.6%
Calm 49.7%
Disgusted 49.6%
Happy 49.8%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Calm 49.6%
Sad 50.1%
Surprised 49.5%
Angry 49.6%
Happy 49.6%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Happy 49.5%
Sad 50.4%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 49.6%
Calm 49.5%
Disgusted 49.6%
Surprised 49.5%
Sad 50.1%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 38-57
Gender Female, 50.1%
Sad 49.6%
Angry 49.6%
Confused 49.6%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 50.2%

AWS Rekognition

Age 14-25
Gender Male, 50.5%
Happy 49.5%
Sad 50.3%
Disgusted 49.6%
Calm 49.5%
Surprised 49.5%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 35-55
Gender Female, 50.5%
Sad 49.8%
Calm 49.8%
Happy 49.5%
Surprised 49.6%
Angry 49.6%
Disgusted 49.6%
Confused 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Calm 49.7%
Sad 49.9%
Angry 49.6%
Surprised 49.6%
Disgusted 49.5%
Confused 49.6%
Happy 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50%
Confused 49.6%
Disgusted 49.5%
Calm 49.7%
Sad 50%
Angry 49.7%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 2-5
Gender Female, 50.2%
Happy 49.6%
Sad 49.9%
Disgusted 49.7%
Calm 49.7%
Surprised 49.5%
Confused 49.6%
Angry 49.6%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Dog 64%

Text analysis

Amazon

A
A SCHOOL-ROOM
SCHOOL-ROOM
875-

Google

87 5 an A SCHOOL-ROOM
87
5
an
SCHOOL-ROOM
A