Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.22

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.22

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Human 97.9
Person 97.9
Chair 97
Furniture 97
Indoors 93.7
Room 93.7
Person 91.8
Chair 86.2
Chair 86.2
Chair 84.8
Advertisement 83.9
Person 82.9
Poster 81.7
Classroom 81.1
School 81.1
Person 81
Person 77.8
Person 77.7
Person 74.3
Flyer 74
Brochure 74
Paper 74
Person 66.9
Cafeteria 64.1
Restaurant 64.1
Court 63.4
Person 62.5
Person 60.9
Text 59.8
Lab 57.8
Clinic 57
Jury 55.6

Clarifai
created on 2023-10-29

furniture 99.3
no person 98.5
room 97.8
architecture 97.5
people 97.2
chair 97
seat 96.2
house 96.1
print 94
home 93.5
man 93.4
family 92.4
indoors 92.2
group 92
building 91.2
vintage 91
monochrome 89.3
table 89.1
window 89.1
adult 88.9

Imagga
created on 2022-06-03

sketch 82.1
drawing 64.8
representation 45.4
building 38.7
architecture 38.6
house 33.4
construction 23.1
structure 21.8
city 20
window 18.7
home 18.3
snow 17.1
roof 16.2
facility 15.9
old 15.3
winter 15.3
sky 15.3
gymnasium 14.5
travel 14.1
modern 14
urban 14
office 13.3
exterior 12.9
design 12.4
plan 12.3
architect 11.6
project 11.5
wall 11.3
floor 11.2
athletic facility 10.8
history 10.7
tourism 10.7
facade 10.4
reflection 10.2
interior 9.7
business 9.7
development 9.5
cold 9.5
black 9
blueprint 8.8
paper 8.6
residential 8.6
station 8.6
bridge 8.5
wood 8.3
vintage 8.3
door 8.2
new 8.1
antique 8.1
tower 8.1
water 8
scene 7.8
glass 7.8
empty 7.7
industry 7.7
garage 7.7
grunge 7.7
engineering 7.6
estate 7.6
frame 7.6
landscape 7.4
town 7.4
housing 7.4
street 7.4

Google
created on 2022-06-03

Furniture 92.9
Chair 86.6
Interior design 85.2
Table 82.6
Art 80.8
Font 80.6
Adaptation 79.2
Painting 70.9
Event 67.9
Room 66.8
History 66.6
Monochrome 65
Illustration 64.6
Monochrome photography 62.7
Hall 62.5
Stock photography 61.7
Paper product 59.6
Visual arts 58.6
Collection 58
Classic 57.1

Microsoft
created on 2022-06-03

text 99.9
indoor 93.6
furniture 84.3
table 78.3
different 39.9
several 13.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 7-17
Gender Female, 96.4%
Calm 32.2%
Happy 23%
Sad 13.5%
Disgusted 12.2%
Surprised 9.4%
Fear 8.2%
Angry 5%
Confused 3.4%

AWS Rekognition

Age 20-28
Gender Female, 61.1%
Sad 99.8%
Calm 16.2%
Surprised 7.6%
Fear 6.3%
Angry 3.3%
Happy 3.3%
Confused 2.8%
Disgusted 1.3%

AWS Rekognition

Age 18-24
Gender Female, 95.2%
Calm 97.4%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Disgusted 0.6%
Angry 0.6%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 7-17
Gender Female, 56.6%
Calm 76.3%
Sad 22.4%
Surprised 6.4%
Fear 6.2%
Disgusted 2.8%
Angry 0.9%
Happy 0.4%
Confused 0.4%

AWS Rekognition

Age 10-18
Gender Female, 76.6%
Sad 87%
Confused 42%
Fear 7.5%
Calm 7.3%
Surprised 7.2%
Disgusted 2.3%
Angry 1.7%
Happy 1.1%

AWS Rekognition

Age 16-22
Gender Male, 87.1%
Sad 61.2%
Calm 49.5%
Angry 11.1%
Fear 7.3%
Surprised 6.6%
Disgusted 3.9%
Happy 0.9%
Confused 0.5%

AWS Rekognition

Age 24-34
Gender Female, 52.4%
Calm 86.2%
Surprised 6.4%
Confused 6.3%
Fear 5.9%
Sad 4.6%
Angry 0.5%
Happy 0.5%
Disgusted 0.5%

AWS Rekognition

Age 14-22
Gender Male, 87.5%
Sad 99.9%
Calm 11%
Surprised 7.4%
Fear 6.4%
Disgusted 2.3%
Angry 2%
Confused 1.8%
Happy 1.6%

AWS Rekognition

Age 27-37
Gender Female, 54.1%
Calm 87.4%
Surprised 6.5%
Fear 6.3%
Sad 5.4%
Confused 2%
Angry 1.2%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Calm 81.1%
Sad 15.5%
Surprised 6.3%
Fear 6%
Angry 2.1%
Confused 0.8%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 18-26
Gender Female, 59.3%
Sad 94.5%
Calm 26.7%
Disgusted 7.9%
Surprised 7.2%
Fear 6.9%
Angry 6.3%
Happy 4.1%
Confused 4%

AWS Rekognition

Age 21-29
Gender Male, 78.4%
Calm 64.6%
Happy 12.2%
Surprised 11.5%
Fear 6.4%
Disgusted 4.7%
Sad 4.5%
Angry 2.5%
Confused 1.4%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.4%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 18-24
Gender Female, 97.8%
Sad 83.3%
Calm 30.1%
Fear 13.1%
Surprised 8.4%
Angry 7.7%
Confused 3.1%
Disgusted 2.9%
Happy 1.4%

AWS Rekognition

Age 7-17
Gender Female, 99.5%
Calm 58.1%
Sad 18%
Angry 11.2%
Confused 8.3%
Surprised 7%
Fear 6.7%
Happy 1.7%
Disgusted 1.2%

AWS Rekognition

Age 18-24
Gender Female, 99.7%
Calm 56.5%
Fear 10.2%
Disgusted 9.5%
Sad 8.1%
Surprised 7.8%
Confused 5.9%
Happy 4.4%
Angry 2.5%

AWS Rekognition

Age 11-19
Gender Male, 73.9%
Calm 32.8%
Angry 27.8%
Disgusted 19.7%
Fear 7.8%
Surprised 7.3%
Sad 7.2%
Happy 2.5%
Confused 1.9%

AWS Rekognition

Age 10-18
Gender Male, 97.3%
Calm 74.2%
Sad 40.5%
Surprised 6.4%
Fear 6%
Angry 0.5%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Calm 55.6%
Sad 46%
Surprised 6.9%
Confused 6.7%
Fear 6.4%
Angry 4.3%
Disgusted 4%
Happy 1.2%

AWS Rekognition

Age 19-27
Gender Male, 89.7%
Calm 45.1%
Angry 14.7%
Surprised 12.1%
Sad 10.2%
Fear 8.5%
Disgusted 8.5%
Confused 2.9%
Happy 2.8%

AWS Rekognition

Age 23-31
Gender Female, 74.1%
Calm 72.9%
Sad 27%
Surprised 6.6%
Fear 6.1%
Happy 3%
Confused 1.2%
Disgusted 1.2%
Angry 0.7%

AWS Rekognition

Age 11-19
Gender Male, 87.9%
Calm 83.6%
Surprised 6.6%
Fear 6.2%
Sad 6.1%
Angry 3.5%
Disgusted 1.5%
Confused 1.3%
Happy 1%

AWS Rekognition

Age 11-19
Gender Male, 62.4%
Calm 66.8%
Sad 34.3%
Angry 8.5%
Surprised 6.4%
Fear 6%
Disgusted 0.9%
Happy 0.6%
Confused 0.4%

AWS Rekognition

Age 19-27
Gender Female, 67.4%
Calm 56%
Happy 25.1%
Surprised 8%
Fear 7.2%
Sad 5%
Disgusted 2.9%
Angry 2.7%
Confused 0.8%

AWS Rekognition

Age 6-14
Gender Male, 86.6%
Calm 95.9%
Surprised 6.3%
Fear 6%
Sad 2.3%
Angry 1.9%
Happy 0.9%
Disgusted 0.5%
Confused 0.1%

AWS Rekognition

Age 7-17
Gender Male, 81.4%
Calm 83.5%
Surprised 7.2%
Fear 6.2%
Angry 6.2%
Disgusted 3.8%
Sad 2.7%
Happy 1.8%
Confused 0.7%

AWS Rekognition

Age 11-19
Gender Female, 97.8%
Calm 53.9%
Sad 21.5%
Angry 17.6%
Fear 6.8%
Surprised 6.7%
Happy 4.9%
Confused 1.4%
Disgusted 1.4%

Feature analysis

Amazon

Person 97.9%
Chair 97%

Captions

Microsoft
created on 2022-06-03

a portrait of a store 55.8%
a close up of a store 52.7%
a group of people in a room 42.7%

Text analysis

Amazon

Indian
Asylum
and
for
Thomas
State Thomas Asylum for Orphan and Destitute Indian Children,
Orphan
State
Children,
Iroquois,
Destitute
Iroquois, N.Y.
KINDERGARTEN
N.Y.
CHILDRENS
DOPUMITORY
NURSERY CHILDRENS DOPUMITORY
NURSERY
2
2 47-71-2715
47-71-2715

Google

State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N. Y. 27-67-78-27 15 Boce gro-al KINDERGARTEN NURSERY CHILDRENS DORMITORY
State
Thomas
Asylum
for
Orphan
and
Destitute
Indian
Children
,
Iroquois
N.
Y.
27-67-78-27
15
Boce
gro
-
al
KINDERGARTEN
NURSERY
CHILDRENS
DORMITORY