Human Generated Data

Title

Charity, Children: United States. New York. Oswego. Orphan Asylum: Orphan Asylum, Oswego, N.Y.: School-Room
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.659.1

Human Generated Data

Title

Charity, Children: United States. New York. Oswego. Orphan Asylum: Orphan Asylum, Oswego, N.Y.: School-Room

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.659.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Room 99.5
Indoors 99.5
Classroom 99.5
School 99.5
Human 96.3
Person 96.3
Person 94
Clock Tower 93.5
Tower 93.5
Architecture 93.5
Building 93.5
Person 91.9
Person 91.7
Person 91.5
Chair 89.7
Furniture 89.7
Person 88.3
Person 86
Person 85.5
Person 79.4
Person 73.9
Person 65
Court 60.7
Person 51.4
Person 46.9
Person 43.1

Clarifai
created on 2019-06-07

people 99.9
many 99.6
room 99.4
furniture 99.3
group 99
chair 98.5
leader 98.4
administration 98.4
adult 98.1
group together 98
education 96.3
home 95.7
indoors 95.6
seat 95.4
several 94.5
war 92.8
desk 91.9
man 91.2
woman 91
military 90.8

Imagga
created on 2019-06-07

room 98.7
classroom 71
interior 62.8
table 51.7
chair 50.3
furniture 46.7
restaurant 37.1
modern 32.9
house 32.6
hall 30.3
decor 30.1
floor 29.7
home 27.9
design 27.6
indoors 23.7
building 23.1
architecture 22.6
luxury 22.3
wood 21.7
chairs 21.5
window 21.4
lamp 21
empty 20.6
indoor 19.2
inside 18.4
residential 18.2
sofa 18.2
dining 18.1
style 17.8
light 17.4
glass 16.3
office 16.3
living 16.1
lighting 15.5
decoration 15.2
dinner 15.2
tables 14.8
couch 14.5
seat 14.4
structure 14.3
comfortable 14.3
contemporary 14.1
carpet 13.6
hotel 13.4
relax 12.6
work 12.6
cafeteria 12.5
desk 12.4
decorate 12.4
wall 12
furnishings 11.8
kitchen 11.8
elegance 11.8
business 11.5
apartment 11.5
elegant 11.1
upscale 10.9
residence 10.7
rug 9.9
food 9.7
wooden 9.7
estate 9.5
leather 9.5
meeting 9.4
bar 9.2
shop 9
people 8.9
stool 8.9
hardwood 8.8
dwelling 8.8
living room 8.8
conference 8.8
education 8.7
nobody 8.6
bed 8.5
real 8.5
space 8.5
3d 8.5
eat 8.4
warm 8.3
center 8.2
lunch 8.1
man 8.1
fireplace 8
suburbs 7.9
suburban 7.9
counter 7.8
render 7.8
barbershop 7.8
party 7.7
relaxation 7.5
barroom 7.5
place 7.4
domestic 7.2
lifestyle 7.2
family 7.1
teacher 7

Google
created on 2019-06-07

Room 81.5
Building 68.9
Table 58.6
Black-and-white 56.4

Microsoft
created on 2019-06-07

indoor 99.5
furniture 95.7
table 89.9
ceiling 83.9
room 79.8
group 70.7
people 69.9
desk 68.2
clock 65.1
building 59.1
chair 58.9
person 53.2
several 12.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 50.1%
Calm 45.4%
Disgusted 45.2%
Sad 45.4%
Happy 45.1%
Surprised 45.1%
Angry 53.6%
Confused 45.2%

AWS Rekognition

Age 4-9
Gender Female, 51.7%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 46.9%
Happy 45%
Angry 45.1%
Sad 52.9%

AWS Rekognition

Age 10-15
Gender Female, 50.7%
Angry 45.3%
Sad 53.8%
Happy 45.1%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%
Calm 45.5%

AWS Rekognition

Age 6-13
Gender Male, 50.8%
Sad 49.6%
Calm 47.2%
Angry 45.7%
Happy 45.4%
Disgusted 46.1%
Confused 45.4%
Surprised 45.4%

AWS Rekognition

Age 6-13
Gender Female, 54.8%
Sad 52%
Happy 45.2%
Angry 47.3%
Surprised 45.1%
Disgusted 45.2%
Confused 45.1%
Calm 45.2%

AWS Rekognition

Age 2-5
Gender Female, 50.1%
Happy 49.6%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Disgusted 49.6%
Confused 49.6%
Sad 50%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 50.4%
Confused 49.5%
Disgusted 49.5%
Calm 49.6%
Happy 49.5%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-23
Gender Female, 50.3%
Confused 49.5%
Sad 50.1%
Disgusted 49.5%
Calm 49.6%
Happy 49.7%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Calm 49.7%
Sad 50%
Surprised 49.6%
Disgusted 49.5%
Angry 49.6%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 12-22
Gender Female, 50.1%
Sad 50.2%
Surprised 49.6%
Disgusted 49.5%
Calm 49.6%
Angry 49.6%
Happy 49.5%
Confused 49.6%

Microsoft Cognitive Services

Age 18
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.3%
Clock Tower 93.5%
Chair 89.7%

Categories

Imagga

interior objects 92.8%
events parties 5.4%
streetview architecture 1.1%