Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Kindergarten
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.22.1

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Kindergarten

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.22.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Room 99.8
Indoors 99.8
School 99.8
Classroom 99.8
Furniture 99.5
Chair 99.5
Chair 99.5
Human 99.3
Person 99.3
Person 98.7
Chair 98.2
Chair 97.1
Person 94
Person 90.9
Person 90.8
Person 86.6
Chair 86.6
Person 86.1
Person 85.3
Person 83.9
Person 80.6
Person 78.6
Person 78
Person 77
Person 75.7
Person 75.5
Person 72.3
Person 70.7
Person 69.5
Person 65
Person 60.2
Person 56.6
Person 53.8
Person 44.6
Person 41.7

Clarifai
created on 2019-06-05

people 100
many 99.9
group 99.7
group together 99.4
furniture 98.6
administration 98.4
adult 97.4
leader 96.2
education 95.4
several 95.1
war 94.7
military 94.3
room 94.1
chair 92.1
child 92
man 90.3
woman 87.8
seat 87.7
vehicle 81.2
elementary school 80.1

Imagga
created on 2019-06-05

room 97.5
cafeteria 93.5
restaurant 87
chair 69.7
interior 65.5
classroom 63.7
table 56.8
furniture 54.5
building 50.6
structure 46.2
house 40.2
floor 34.5
seat 34.4
home 33.5
modern 33
wood 30.9
chairs 30.4
design 29.3
decor 29.2
dining 28.6
inside 24
window 23.8
indoor 23.8
architecture 21.9
empty 21.5
patio 21
contemporary 20.7
indoors 20.2
tables 19.7
luxury 18.9
folding chair 18.6
residential 18.2
decoration 18.1
light 18.1
living 18
glass 17.9
style 17.8
dinner 17.7
area 17.5
kitchen 17.4
comfortable 16.3
lamp 16.2
apartment 15.3
sofa 15.3
hotel 15.3
food 15.1
hall 14.9
wall 14.6
decorate 14.3
plant 14.2
stool 13.9
eat 13.4
lunch 12.9
drink 12.6
coffee 12.1
bar 12
stove 11.8
elegance 11.8
urban 11.4
relax 11
nobody 10.9
space 10.9
upscale 10.9
stylish 10.9
hardwood 10.8
lighting 10.6
couch 10.6
office 10.5
cook 10.1
relaxation 10.1
cabinets 9.9
drawer 9.9
counter 9.8
residence 9.7
carpet 9.7
wooden 9.7
estate 9.5
desk 9.5
place 9.3
3d 9.3
domestic 9.1
meal 8.9
scene 8.7
day 8.6
tile 8.6
business 8.5
refrigerator 7.9
rug 7.9
cabinet 7.9
oven 7.9
diner 7.8
render 7.8
elegant 7.7
leather 7.6
real 7.6
work 7.1
life 7

Google
created on 2019-06-05

Classroom 93.1
Room 93.1
Class 84.3
Building 67
State school 66.1
Cafeteria 65.5
Table 63.8
Restaurant 61.8
Furniture 56.7

Microsoft
created on 2019-06-05

floor 99.5
table 98.7
indoor 97.8
chair 97.1
classroom 91.8
library 88.8
school 81.4
scene 72.9
person 71.6
clothing 70.8
room 65.8
building 59.2
kitchen & dining room table 55.1
restaurant 22.2
furniture 19.1
several 15.9
dining room 11.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Calm 45.6%
Surprised 45.6%
Disgusted 51%
Angry 45.9%
Happy 45.9%
Sad 45.6%
Confused 45.4%

AWS Rekognition

Age 10-15
Gender Female, 50.1%
Sad 46.6%
Disgusted 45.5%
Happy 49.4%
Surprised 45.7%
Angry 46.1%
Calm 46.2%
Confused 45.5%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Surprised 45.2%
Sad 51.8%
Happy 45.2%
Confused 45.1%
Calm 46%
Angry 45.6%
Disgusted 46.1%

AWS Rekognition

Age 11-18
Gender Female, 54%
Calm 47.5%
Surprised 46%
Confused 45.4%
Sad 46.9%
Angry 47.4%
Disgusted 46.5%
Happy 45.4%

AWS Rekognition

Age 10-15
Gender Female, 52.6%
Sad 52.2%
Disgusted 45.3%
Angry 45.3%
Surprised 45.2%
Calm 46.7%
Confused 45.2%
Happy 45.2%

AWS Rekognition

Age 14-25
Gender Female, 53.6%
Confused 45.2%
Sad 47.8%
Angry 45.3%
Calm 50.6%
Happy 45.2%
Disgusted 45.6%
Surprised 45.2%

AWS Rekognition

Age 4-9
Gender Female, 52.2%
Angry 45.5%
Calm 45.3%
Surprised 45.1%
Disgusted 45.1%
Happy 45.1%
Sad 53.5%
Confused 45.4%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Surprised 45.4%
Happy 45.7%
Confused 45.3%
Calm 51.2%
Disgusted 45.1%
Sad 46.8%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Calm 49.7%
Disgusted 45.9%
Sad 46%
Angry 46.3%
Happy 45.7%
Confused 45.5%
Surprised 45.9%

AWS Rekognition

Age 23-38
Gender Female, 54.2%
Sad 52.6%
Confused 45.1%
Angry 45.3%
Calm 46.5%
Surprised 45.1%
Happy 45.2%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Angry 49.6%
Sad 49.9%
Calm 49.7%
Surprised 49.6%
Confused 49.5%
Disgusted 49.5%
Happy 49.6%

AWS Rekognition

Age 11-18
Gender Female, 50.4%
Surprised 49.5%
Confused 49.5%
Angry 49.6%
Happy 49.6%
Disgusted 49.7%
Sad 50.1%
Calm 49.5%

AWS Rekognition

Age 14-23
Gender Female, 50.5%
Angry 49.6%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Sad 50.2%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54%
Angry 45.1%
Sad 49.9%
Disgusted 45.1%
Calm 49.6%
Surprised 45.1%
Confused 45.1%
Happy 45.2%

AWS Rekognition

Age 10-15
Gender Female, 50.5%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Sad 50.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Confused 49.5%
Disgusted 49.6%
Surprised 49.6%
Sad 49.7%
Angry 49.6%
Happy 49.7%
Calm 49.8%

AWS Rekognition

Age 35-52
Gender Female, 54.9%
Disgusted 45.5%
Confused 45.9%
Calm 50.7%
Angry 45.4%
Happy 45.6%
Sad 46.1%
Surprised 45.9%

AWS Rekognition

Age 16-27
Gender Male, 51.6%
Calm 51.1%
Disgusted 45.2%
Confused 45.8%
Happy 45.4%
Angry 45.7%
Sad 46%
Surprised 45.8%

AWS Rekognition

Age 11-18
Gender Male, 54.2%
Calm 52.2%
Disgusted 45.4%
Surprised 45.3%
Confused 45.2%
Angry 45.3%
Sad 46.1%
Happy 45.4%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.5%
Sad 50.4%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Sad 49.6%
Surprised 49.6%
Confused 49.6%
Angry 49.6%
Happy 49.5%
Calm 50.2%
Disgusted 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Happy 49.5%
Surprised 49.5%
Angry 49.7%
Calm 49.5%
Sad 50.2%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Surprised 49.6%
Confused 49.5%
Sad 49.7%
Disgusted 49.6%
Happy 49.9%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 14-25
Gender Female, 50.3%
Confused 49.5%
Disgusted 49.5%
Sad 49.7%
Surprised 49.5%
Calm 50.1%
Angry 49.5%
Happy 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Happy 49.5%
Sad 50.3%
Surprised 49.5%
Angry 49.6%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Happy 45.2%
Angry 47.9%
Calm 46.3%
Sad 49.6%
Surprised 45.2%
Confused 45.2%
Disgusted 45.6%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Sad 50.4%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50.2%
Surprised 49.5%
Happy 50%
Sad 49.7%
Angry 49.5%
Disgusted 49.5%
Calm 49.7%
Confused 49.5%

AWS Rekognition

Age 11-18
Gender Male, 50.4%
Angry 49.5%
Sad 49.8%
Calm 50%
Surprised 49.5%
Confused 49.6%
Disgusted 49.5%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Angry 49.6%
Disgusted 49.7%
Surprised 49.6%
Happy 49.5%
Calm 49.6%
Sad 49.9%
Confused 49.6%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.5%
Person 99.3%

Categories

Imagga

interior objects 100%

Text analysis

Amazon

83

Google

883
883