Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.460

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 97.5
Person 97.5
Person 96.8
Person 96
Person 93.7
Person 88.8
Vehicle 83.9
Boat 83.9
Transportation 83.9
Text 83.8
Crowd 81.8
Person 68.1
Advertisement 67.2
School 65.3
Paper 62.5
Person 61.6
Classroom 57.4
Indoors 57.4
Room 57.4
Audience 55.2
Poster 53.3

Clarifai
created on 2019-06-05

people 99
adult 95.6
group 94.9
man 93.3
room 91.9
many 91.3
house 91.3
architecture 89.1
landscape 87.9
building 86.8
home 86.4
art 86
furniture 85.7
museum 85.7
family 85.3
street 85.2
city 85.1
woman 83.8
wear 82.1
print 80.8

Imagga
created on 2019-06-05

web site 98.3
billboard 65.3
signboard 52.1
structure 41.8
landscape 22.3
old 20.2
grunge 19.6
vintage 18.2
sky 17.2
architecture 15.6
city 15
history 13.4
travel 13.4
antique 13
building 12.8
dirty 12.7
trees 12.5
retro 12.3
black 11.4
paper 11
rough 10.9
frame 10.8
scenery 10.8
grungy 10.4
texture 10.4
ancient 10.4
paint 10
landmark 9.9
rural 9.7
scenic 9.7
field 9.2
art 9.1
outdoors 9
urban 8.7
grass 8.7
snow 8.7
old fashioned 8.6
historical 8.5
tree 8.5
mountains 8.3
grain 8.3
transport 8.2
pattern 8.2
aged 8.1
border 8.1
space 7.8
culture 7.7
winter 7.7
light 7.4
design 7.3
countryside 7.3
transportation 7.2
river 7.1
summer 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

gallery 79.8
room 76.2
scene 71.1
house 52.2
picture frame 6.1

Face analysis

Amazon

AWS Rekognition

Age 16-27
Gender Male, 50.3%
Disgusted 49.5%
Confused 49.5%
Surprised 49.6%
Calm 49.7%
Happy 49.6%
Angry 49.6%
Sad 50.1%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Calm 49.5%
Sad 50%
Angry 49.9%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.5%
Sad 49.7%
Calm 49.6%
Happy 50.1%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 49.5%
Angry 49.6%
Calm 49.8%
Sad 49.7%
Surprised 49.5%
Confused 49.7%
Disgusted 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.6%
Happy 49.6%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.2%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Sad 49.8%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.6%
Calm 49.5%
Disgusted 50%

AWS Rekognition

Age 38-59
Gender Female, 50.1%
Calm 49.8%
Sad 49.8%
Angry 49.7%
Surprised 49.5%
Disgusted 49.6%
Confused 49.6%
Happy 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Angry 49.6%
Calm 49.6%
Disgusted 49.5%
Happy 49.7%
Surprised 49.6%
Sad 50%
Confused 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Calm 49.6%
Surprised 49.6%
Happy 49.8%
Disgusted 49.7%
Angry 49.7%
Sad 49.6%
Confused 49.5%

Feature analysis

Amazon

Person 97.5%
Boat 83.9%
Poster 53.3%

Captions

Microsoft

a screen shot of a person 57.1%
a screen shot of a social media photo of a person 48.8%
an old photo of a person 46%

Text analysis

Amazon

Indian
Thomas
Orphan
Destitute
State
and
State Thomas Asylum for Orphan and Destitute Indian Children,
Asylum
N.Y.
for
Children,
Iroquois,
877
Iroquois, N.Y. Y.
DOPMITOMY
BOYS DOPMITOMY
BOYS
Y.

Google

State Thomas Asylum for Orphan and Destitute Indian Children, Res Iroquois, N. Y. B0YS DOPMITONY A SCrOOL-ROOM
Thomas
B0YS
Orphan
Res
for
Children,
Iroquois,
Asylum
Indian
DOPMITONY
State
and
Destitute
N.
Y.
A
SCrOOL-ROOM