Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Dining-Room
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2381.1

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Dining-Room

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2381.1

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Restaurant 99.8
Human 97.6
Person 97.6
Person 96.6
Person 95
Person 94.7
Cafeteria 94.5
Person 92.7
Food Court 84.1
Food 84.1
Person 79.6
Furniture 77.8
Chair 77.8
Building 77.6
Indoors 68.9
Person 66.7
Room 66
Person 63
Person 61.3
Cafe 57.3
Person 57.3
Person 46.2

Clarifai
created on 2019-06-04

people 100
many 99.9
group together 99.8
group 99.6
adult 97.8
furniture 96.2
administration 95.8
man 94.8
woman 93.2
several 93.2
crowd 93
room 89.5
chair 89.5
vehicle 89.4
leader 89.1
education 87.3
military 84.2
war 83.8
watercraft 81.3
sit 80.9

Imagga
created on 2019-06-04

room 47.1
restaurant 46.8
chair 41.5
table 35.5
interior 33.6
building 32.9
classroom 32.9
cafeteria 30.5
furniture 28.6
hall 27.6
structure 25.2
seat 24.4
architecture 22
empty 18.9
chairs 18.6
floor 18.6
tables 16.7
modern 16.1
house 15.9
dinner 15.2
dining 14.3
wood 14.2
decor 14.1
city 14.1
design 14.1
indoors 14.1
light 14
patio 14
lunch 13.7
glass 13.2
barroom 13.1
hotel 12.4
window 12
university 12
travel 12
home 12
inside 12
eat 11.7
decoration 11.6
night 11.5
center 11.4
urban 11.4
life 11.1
bar 11.1
outdoor 10.7
lamp 10.5
scene 10.4
wall 10.4
party 10.3
food 10.3
culture 10.3
place 10.2
street 10.1
style 9.6
comfortable 9.6
luxury 9.4
nobody 9.3
relax 9.3
drink 9.2
business 9.1
vacation 9
reflection 8.9
area 8.9
residential 8.6
space 8.5
elegance 8.4
relaxation 8.4
people 8.4
summer 8.4
old 8.4
indoor 8.2
shop 8
stool 7.9
work 7.9
barbershop 7.7
traditional 7.5
outdoors 7.5

Google
created on 2019-06-04

Room 82.6
Restaurant 72.7
Building 69.6
Table 67.2
Cafeteria 62.4

Microsoft
created on 2019-06-04

table 98.7
furniture 98.4
chair 97.9
indoor 94.1
person 87.1
clothing 79.1
building 77.4
old 73.1
library 69.2
restaurant 28.9
dining room 20.1
several 11.6
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 17-27
Gender Female, 50.8%
Disgusted 45.2%
Angry 45.4%
Sad 52.4%
Surprised 45.2%
Happy 45.2%
Calm 46.6%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Male, 52.6%
Disgusted 45.6%
Confused 45.1%
Angry 45.2%
Calm 51.4%
Surprised 45.1%
Happy 45.2%
Sad 47.3%

AWS Rekognition

Age 16-27
Gender Female, 52.2%
Calm 45.4%
Disgusted 45.1%
Angry 45.2%
Sad 54.2%
Happy 45%
Confused 45.1%
Surprised 45%

AWS Rekognition

Age 48-68
Gender Female, 52.1%
Sad 54.9%
Confused 45%
Calm 45%
Disgusted 45%
Happy 45%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 45.1%
Happy 45.2%
Sad 50.5%
Angry 45.4%
Calm 48.3%
Confused 45.1%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51.1%
Disgusted 46.1%
Calm 45.7%
Surprised 45.5%
Angry 47.8%
Sad 48.9%
Confused 45.2%
Happy 45.8%

AWS Rekognition

Age 4-9
Gender Female, 54%
Surprised 45.5%
Confused 45.3%
Sad 48.1%
Disgusted 45.7%
Calm 49.5%
Angry 45.6%
Happy 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Disgusted 49%
Surprised 45.3%
Angry 49.6%
Happy 45.2%
Calm 45.5%
Sad 45.2%
Confused 45.1%

AWS Rekognition

Age 45-63
Gender Female, 53%
Calm 45.7%
Sad 51%
Happy 46.6%
Angry 45.4%
Disgusted 45.6%
Confused 45.4%
Surprised 45.4%

AWS Rekognition

Age 14-23
Gender Female, 50.2%
Calm 49.8%
Happy 49.8%
Surprised 49.5%
Sad 49.7%
Angry 49.6%
Disgusted 49.6%
Confused 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Calm 49.6%
Disgusted 49.5%
Surprised 49.5%
Sad 50.2%
Happy 49.5%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Happy 49.7%
Disgusted 49.7%
Sad 49.8%
Confused 49.5%
Angry 49.6%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 48-68
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.6%
Surprised 49.6%
Sad 49.7%
Confused 49.6%
Angry 49.6%
Happy 50%

AWS Rekognition

Age 10-15
Gender Female, 50.3%
Confused 49.6%
Calm 49.8%
Angry 49.5%
Sad 50%
Happy 49.5%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Calm 49.6%
Surprised 49.5%
Happy 50.1%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Angry 49.5%
Calm 50%
Sad 49.8%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Sad 50.4%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.6%
Angry 50.3%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Surprised 49.6%
Happy 49.8%
Confused 49.5%
Sad 49.7%
Calm 49.7%
Disgusted 49.7%
Angry 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Surprised 49.6%
Happy 49.6%
Confused 49.5%
Sad 50.1%
Calm 49.6%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 30-47
Gender Male, 50.1%
Confused 49.5%
Happy 49.5%
Angry 49.6%
Sad 50.3%
Calm 49.5%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Confused 49.5%
Sad 49.6%
Angry 49.6%
Disgusted 49.9%
Calm 49.7%
Surprised 49.6%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.8%
Surprised 49.6%
Calm 49.9%
Happy 49.6%
Disgusted 49.5%
Confused 49.6%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Angry 49.6%
Surprised 49.5%
Disgusted 49.8%
Happy 49.6%
Calm 49.8%
Sad 49.7%
Confused 49.5%

Microsoft Cognitive Services

Age 10
Gender Male

Feature analysis

Amazon

Person 97.6%
Chair 77.8%

Categories

Imagga

interior objects 99.9%

Text analysis

Amazon

873

Google

873
873