Human Generated Data

Title

Charity, Children: United States. New York. Ogdensburg. Orphan Asylum: City Hospital and Orphanage, Ogdensburg, N.Y. (Under the direction of the Grey Nuns of the Cross): General Dining Room.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.155.2

Human Generated Data

Title

Charity, Children: United States. New York. Ogdensburg. Orphan Asylum: City Hospital and Orphanage, Ogdensburg, N.Y. (Under the direction of the Grey Nuns of the Cross): General Dining Room.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.155.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.2
Person 99.2
Person 96
Indoors 94.9
Interior Design 94.9
Person 94.1
Person 92.4
Person 90.6
Person 90.2
Person 89.9
Person 89.6
Crowd 88.2
Room 86.1
Person 83.5
Person 82.5
Audience 81.5
People 75.1
Building 66.1
Court 59.9
Cafeteria 57.9
Restaurant 57.9
School 55
Classroom 55

Clarifai
created on 2019-06-05

people 100
many 99.9
group 99.4
group together 99
adult 96.2
administration 96.1
crowd 93.7
child 91.5
leader 90.6
man 89.9
furniture 89.3
home 88.8
wear 88.6
woman 88.5
spectator 87.6
education 85.5
chair 85.1
military 84.4
room 84.2
school 84

Imagga
created on 2019-06-05

people 26.2
man 25.5
business 18.8
person 17.9
classroom 16
male 15.6
room 15.5
city 14.9
building 14.9
architecture 14
old 13.9
singer 13.8
silhouette 13.2
life 12.3
musician 12.1
group 12.1
travel 12
adult 11.7
interior 11.5
businessman 11.5
student 11.4
black 11.4
urban 11.3
modern 11.2
men 11.2
team 10.7
crowd 10.6
office 10.5
couple 10.4
school 10.3
performer 9.6
teacher 9.5
motion 9.4
two 9.3
indoor 9.1
portrait 9
world 9
transportation 9
history 8.9
women 8.7
education 8.6
spectator 8.6
sitting 8.6
historical 8.5
facility 8.3
human 8.2
hall 8.2
gymnasium 8
work 7.8
standing 7.8
airport 7.8
glass 7.8
brass 7.7
window 7.7
move 7.7
sport 7.6
communication 7.5
meeting 7.5
house 7.5
station 7.4
transport 7.3
light 7.2
home 7.2
family 7.1
blackboard 7.1

Google
created on 2019-06-05

Photograph 96.5
Snapshot 87.5
Text 86.9
Room 76.5
Photography 67.8
Adaptation 67
Event 62.7
Crowd 62.7
History 60.4
Stock photography 59.4
Black-and-white 56.4

Microsoft
created on 2019-06-05

person 98.6
clothing 92
people 65.1
room 47.5
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 52.7%
Confused 45.1%
Sad 45.9%
Disgusted 45%
Angry 45.1%
Happy 45%
Calm 53.9%
Surprised 45.1%

AWS Rekognition

Age 12-22
Gender Female, 54.7%
Calm 46.8%
Disgusted 45.2%
Confused 45.3%
Happy 45.3%
Angry 45.5%
Sad 51.5%
Surprised 45.3%

AWS Rekognition

Age 12-22
Gender Male, 54%
Disgusted 45.1%
Confused 45.4%
Happy 45%
Calm 49%
Surprised 45.1%
Sad 50%
Angry 45.4%

AWS Rekognition

Age 27-44
Gender Male, 54.3%
Angry 45.2%
Disgusted 45.2%
Calm 53.6%
Surprised 45.1%
Happy 45.1%
Sad 45.4%
Confused 45.3%

AWS Rekognition

Age 16-27
Gender Female, 96.4%
Angry 3%
Calm 56.1%
Disgusted 2.6%
Surprised 1.6%
Sad 32.7%
Happy 2.9%
Confused 1.3%

AWS Rekognition

Age 14-23
Gender Female, 53.3%
Surprised 45%
Happy 45%
Confused 45%
Calm 45%
Disgusted 45%
Angry 45.1%
Sad 54.9%

AWS Rekognition

Age 14-25
Gender Female, 52.4%
Surprised 45.3%
Happy 46.1%
Sad 47%
Angry 46%
Disgusted 49%
Confused 45.4%
Calm 46.3%

AWS Rekognition

Age 10-15
Gender Male, 51%
Happy 45.1%
Sad 45.1%
Disgusted 45%
Calm 54.6%
Surprised 45.1%
Confused 45.1%
Angry 45%

AWS Rekognition

Age 15-25
Gender Female, 54.8%
Sad 52.7%
Confused 45.1%
Angry 45.9%
Calm 45.6%
Surprised 45.2%
Happy 45.4%
Disgusted 45.2%

AWS Rekognition

Age 27-44
Gender Female, 53.4%
Calm 45.3%
Confused 45.1%
Sad 53.3%
Surprised 45.2%
Happy 45.5%
Disgusted 45.2%
Angry 45.5%

AWS Rekognition

Age 4-9
Gender Male, 52.6%
Angry 45.3%
Calm 50.3%
Confused 45.3%
Happy 46.7%
Sad 45.6%
Disgusted 45.1%
Surprised 46.5%

AWS Rekognition

Age 35-52
Gender Female, 54.1%
Sad 45.2%
Angry 45%
Happy 54.7%
Disgusted 45%
Calm 45.1%
Surprised 45%
Confused 45%

AWS Rekognition

Age 11-18
Gender Female, 52.8%
Calm 53.9%
Surprised 45.2%
Confused 45.2%
Sad 45.3%
Angry 45.2%
Disgusted 45.2%
Happy 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.8%
Angry 45.9%
Confused 45.4%
Calm 45.5%
Disgusted 52.2%
Happy 45.2%
Surprised 45.2%
Sad 45.6%

AWS Rekognition

Age 38-59
Gender Male, 51.9%
Disgusted 45.2%
Sad 47.6%
Calm 49.2%
Confused 45.5%
Happy 46.7%
Surprised 45.3%
Angry 45.5%

AWS Rekognition

Age 16-27
Gender Female, 52.6%
Calm 50.4%
Disgusted 45.6%
Sad 47.5%
Happy 45.5%
Confused 45.1%
Surprised 45.3%
Angry 45.6%

AWS Rekognition

Age 6-13
Gender Female, 53.6%
Calm 48.5%
Surprised 45.2%
Happy 45.5%
Disgusted 45.2%
Angry 45.3%
Sad 50.2%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 53.3%
Disgusted 45.3%
Confused 45.1%
Calm 45.3%
Surprised 45.1%
Happy 45.2%
Sad 53.5%
Angry 45.5%

AWS Rekognition

Age 15-25
Gender Female, 53.2%
Sad 48.4%
Angry 45.8%
Calm 47.8%
Confused 46%
Happy 45.4%
Disgusted 45.9%
Surprised 45.8%

AWS Rekognition

Age 20-38
Gender Female, 53.2%
Happy 46.5%
Sad 45.6%
Confused 45.2%
Calm 51.5%
Angry 45.5%
Disgusted 45.3%
Surprised 45.4%

AWS Rekognition

Age 38-59
Gender Female, 50.5%
Sad 46.8%
Calm 45.5%
Disgusted 51.5%
Confused 45.4%
Angry 45.4%
Surprised 45.1%
Happy 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Surprised 45.6%
Happy 51.6%
Confused 45.6%
Calm 46%
Disgusted 45.3%
Sad 45.5%
Angry 45.4%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Angry 49.6%
Calm 50%
Sad 49.7%
Surprised 49.6%
Disgusted 49.5%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.5%
Disgusted 49.5%
Sad 50.4%
Calm 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 54.1%
Calm 46.5%
Confused 45.2%
Sad 51.4%
Surprised 45.3%
Happy 46.1%
Disgusted 45.1%
Angry 45.5%

AWS Rekognition

Age 14-25
Gender Female, 50.5%
Angry 49.6%
Sad 50%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Disgusted 49.5%
Happy 49.6%

AWS Rekognition

Age 14-23
Gender Female, 50.5%
Calm 49.7%
Angry 49.6%
Happy 49.6%
Sad 50%
Surprised 49.6%
Confused 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Confused 46.8%
Angry 45.9%
Disgusted 45.3%
Calm 46.1%
Happy 48.9%
Surprised 45.7%
Sad 46.4%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Happy 49.6%
Sad 49.6%
Disgusted 49.7%
Calm 49.8%
Surprised 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 49.7%
Sad 50.1%
Angry 49.5%
Confused 49.6%
Happy 49.5%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Angry 49.5%
Confused 49.5%
Calm 49.7%
Surprised 49.5%
Sad 50%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 11-18
Gender Female, 50.3%
Angry 49.7%
Happy 49.6%
Confused 49.5%
Surprised 49.6%
Sad 49.7%
Disgusted 49.6%
Calm 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Surprised 49.5%
Happy 49.5%
Confused 49.6%
Calm 49.6%
Disgusted 49.5%
Angry 49.6%
Sad 50.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.7%
Sad 49.9%
Angry 49.5%
Surprised 49.5%
Disgusted 49.6%
Confused 49.5%
Happy 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 49.7%
Sad 49.9%
Disgusted 49.5%
Angry 49.7%
Surprised 49.6%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.2%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 50.4%
Angry 49.5%

AWS Rekognition

Age 4-7
Gender Female, 50.5%
Calm 49.5%
Happy 49.6%
Confused 49.5%
Sad 50.2%
Angry 49.5%
Surprised 49.5%
Disgusted 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Angry 49.6%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%
Happy 49.6%
Surprised 49.6%
Sad 50.1%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Calm 50.1%
Disgusted 49.6%
Surprised 49.5%
Confused 49.5%
Angry 49.6%
Sad 49.6%
Happy 49.6%

AWS Rekognition

Age 38-57
Gender Female, 50.5%
Surprised 49.5%
Disgusted 49.7%
Angry 49.6%
Sad 49.7%
Happy 49.5%
Confused 49.6%
Calm 50%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Disgusted 49.5%
Sad 50.3%
Calm 49.5%
Confused 49.5%
Happy 49.6%
Surprised 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Disgusted 49.6%
Surprised 49.6%
Sad 49.6%
Angry 49.6%
Happy 49.5%
Calm 50.1%

AWS Rekognition

Age 12-22
Gender Female, 54.8%
Angry 45.3%
Calm 45.8%
Confused 47.5%
Happy 47.7%
Sad 46.6%
Disgusted 45.4%
Surprised 46.8%

AWS Rekognition

Age 16-27
Gender Male, 50.4%
Angry 49.6%
Sad 49.7%
Disgusted 49.5%
Happy 49.5%
Confused 49.6%
Calm 50%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Surprised 49.5%
Sad 49.7%
Calm 49.8%
Happy 49.5%
Angry 49.9%
Disgusted 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Sad 50.1%
Happy 49.5%
Surprised 49.6%
Disgusted 49.7%
Confused 49.5%
Calm 49.6%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.8%
Disgusted 49.5%
Sad 49.6%
Calm 49.8%
Confused 49.6%
Angry 49.6%
Happy 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.5%
Calm 50.2%
Sad 49.6%
Surprised 49.5%
Disgusted 49.6%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.6%
Confused 49.6%
Calm 49.9%
Disgusted 49.6%
Happy 49.6%
Surprised 49.6%
Sad 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Disgusted 49.6%
Sad 49.9%
Calm 49.6%
Confused 49.6%
Happy 49.6%
Surprised 49.6%
Angry 49.7%

AWS Rekognition

Age 11-18
Gender Female, 50.4%
Calm 49.6%
Disgusted 49.6%
Happy 49.6%
Surprised 49.5%
Sad 50.1%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 4-9
Gender Female, 50.1%
Disgusted 49.5%
Sad 49.5%
Calm 50.4%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Categories

Imagga

interior objects 96.5%
streetview architecture 1.5%
paintings art 1.2%

Text analysis

Amazon

GENERAL
GENERAL DINING-ROOM
DINING-ROOM

Google

GENERAL DINING-ROOM
GENERAL
DINING-ROOM