Human Generated Data

Title

Charity, Children: United States. New York. Ogdensburg. Orphan Asylum: City Hospital and Orphanage, Ogdensburg, N.Y. (Under the direction of the Grey Nuns of the Cross): A School-Room.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.155.1

Human Generated Data

Title

Charity, Children: United States. New York. Ogdensburg. Orphan Asylum: City Hospital and Orphanage, Ogdensburg, N.Y. (Under the direction of the Grey Nuns of the Cross): A School-Room.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.155.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Room 99.8
Indoors 99.8
Classroom 99.8
School 99.8
Human 99.2
Person 99.2
Person 99.1
Person 97.8
Person 96.3
Person 93.9
Person 90.6
Person 83.4
Person 78.9
Person 51

Clarifai
created on 2019-06-05

people 99.9
many 99.5
group 99.3
group together 98.8
adult 97.3
woman 95.6
man 95.1
child 92
crowd 91.7
administration 91.5
wear 90.5
leader 87
audience 86.9
spectator 86
room 83.6
music 83.2
furniture 82.8
outfit 81.4
recreation 80.1
military 79.6

Imagga
created on 2019-06-05

people 33.4
room 30.7
person 29.9
man 28.9
classroom 27.8
couple 24.4
male 23.4
senior 19.7
teacher 19.1
indoors 18.4
together 18.4
business 17.6
home 17.5
adult 17.1
hall 16.4
men 16.3
happy 16.3
restaurant 14.5
group 14.5
smiling 14.5
women 14.2
businessman 14.1
old 13.9
table 13.8
sitting 13.7
love 13.4
elderly 13.4
interior 13.3
life 13
professional 12.9
planner 12.9
indoor 12.8
happiness 12.5
meeting 12.2
office 11.6
family 11.6
spectator 11.3
celebration 11.2
two 11
educator 10.9
student 10.8
portrait 10.3
mature 10.2
modern 9.8
drinking 9.6
chair 9.5
party 9.4
work 9.4
smile 9.3
team 8.9
cheerful 8.9
new 8.9
success 8.8
older 8.7
education 8.6
corporate 8.6
adults 8.5
window 8.5
communication 8.4
aged 8.1
lifestyle 7.9
holiday 7.9
day 7.8
human 7.5
leisure 7.5
inside 7.4
businesswoman 7.3
building 7.2
computer 7.2
romantic 7.1

Google
created on 2019-06-05

Photograph 97.3
People 94.1
Snapshot 89
Room 76.5
Photography 67.8
Event 62.7
Stock photography 62.1
History 60.4
Family 56.9
Black-and-white 56.4

Microsoft
created on 2019-06-05

person 96.6
clothing 86.9
posing 85.2
group 79.4
people 58.2
old 57.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Female, 52.5%
Disgusted 45%
Confused 45.1%
Calm 45.9%
Angry 45.1%
Happy 45%
Sad 53.8%
Surprised 45%

AWS Rekognition

Age 9-14
Gender Male, 77.5%
Angry 1.3%
Confused 1%
Calm 81.7%
Surprised 1.4%
Sad 13.4%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 4-9
Gender Female, 50.2%
Calm 46.9%
Disgusted 45.2%
Confused 45.6%
Happy 45.3%
Angry 47.6%
Sad 49%
Surprised 45.4%

AWS Rekognition

Age 9-14
Gender Male, 54.5%
Calm 47.6%
Disgusted 45%
Confused 45.2%
Happy 45%
Angry 49.1%
Sad 48%
Surprised 45.1%

AWS Rekognition

Age 17-27
Gender Male, 53.8%
Sad 51.6%
Disgusted 45.2%
Surprised 45.2%
Happy 45.3%
Confused 45.3%
Calm 47.1%
Angry 45.3%

AWS Rekognition

Age 6-13
Gender Male, 54.2%
Confused 45.3%
Disgusted 45.1%
Surprised 45.2%
Sad 47.1%
Angry 45.6%
Happy 45.1%
Calm 51.6%

AWS Rekognition

Age 10-15
Gender Male, 50.6%
Happy 45.1%
Sad 48.9%
Disgusted 45.2%
Angry 45.3%
Surprised 45.3%
Calm 50%
Confused 45.2%

AWS Rekognition

Age 11-18
Gender Male, 54.9%
Disgusted 45.1%
Surprised 45.5%
Sad 46.4%
Angry 47.1%
Happy 45%
Confused 45.7%
Calm 50.1%

AWS Rekognition

Age 26-44
Gender Female, 51.5%
Sad 46.7%
Angry 50.5%
Happy 45.1%
Disgusted 45.1%
Calm 47%
Surprised 45.2%
Confused 45.5%

AWS Rekognition

Age 14-23
Gender Male, 54.4%
Angry 47%
Confused 45.7%
Calm 50.8%
Disgusted 45.1%
Happy 45.1%
Surprised 45.9%
Sad 45.5%

AWS Rekognition

Age 20-38
Gender Male, 51%
Sad 46.4%
Surprised 45%
Confused 45%
Angry 53.5%
Happy 45%
Calm 45.1%
Disgusted 45%

AWS Rekognition

Age 6-13
Gender Female, 52.7%
Sad 49.2%
Angry 46.3%
Happy 45.4%
Surprised 45.4%
Confused 45.6%
Calm 46.4%
Disgusted 46.6%

AWS Rekognition

Age 10-15
Gender Female, 50.3%
Surprised 45.1%
Happy 45.1%
Confused 45.4%
Calm 49.8%
Disgusted 45.2%
Sad 47.8%
Angry 46.6%

AWS Rekognition

Age 4-9
Gender Female, 53.9%
Disgusted 45.4%
Confused 45.2%
Surprised 45.1%
Calm 45.8%
Happy 45.1%
Angry 47%
Sad 51.3%

AWS Rekognition

Age 14-23
Gender Female, 50.4%
Surprised 49.5%
Sad 50.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Disgusted 45.2%
Confused 45.4%
Sad 45.7%
Angry 45.6%
Happy 46.5%
Surprised 45.3%
Calm 51.3%

AWS Rekognition

Age 15-25
Gender Male, 50.3%
Calm 49.8%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Sad 50%
Surprised 49.5%
Confused 49.6%

AWS Rekognition

Age 45-63
Gender Female, 50.2%
Confused 49.5%
Happy 49.5%
Sad 50.4%
Disgusted 49.5%
Angry 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Calm 45.3%
Disgusted 45.1%
Sad 46.7%
Happy 45%
Confused 45.1%
Surprised 45%
Angry 52.8%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Sad 50.4%
Surprised 49.5%

AWS Rekognition

Age 17-27
Gender Female, 51.6%
Angry 46.5%
Happy 46.2%
Confused 45.7%
Surprised 46%
Sad 46.1%
Disgusted 46.1%
Calm 48.4%

AWS Rekognition

Age 16-27
Gender Male, 53.2%
Sad 51.3%
Confused 45.7%
Angry 45.7%
Calm 46.6%
Surprised 45.5%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Sad 50.3%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 20-38
Gender Male, 53.1%
Angry 45.4%
Confused 45.5%
Calm 50.9%
Surprised 45.4%
Sad 46.7%
Happy 45.4%
Disgusted 45.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.8%
Angry 49.6%
Sad 49.8%
Confused 49.5%
Surprised 49.6%
Happy 49.5%
Disgusted 49.6%

AWS Rekognition

Age 19-36
Gender Male, 50.4%
Calm 50.1%
Happy 49.5%
Confused 49.5%
Sad 49.8%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.3%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Sad 50.4%
Confused 49.5%

AWS Rekognition

Age 48-68
Gender Male, 50.1%
Angry 49.7%
Disgusted 49.5%
Sad 50.3%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Calm 49.5%
Happy 49.5%
Sad 50.3%
Angry 49.6%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.1%
Disgusted 49.5%
Sad 50.1%
Calm 49.5%
Confused 49.5%
Happy 49.8%
Surprised 49.6%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Calm 49.6%
Happy 49.6%
Sad 49.9%
Angry 49.6%
Confused 49.6%
Disgusted 49.6%
Surprised 49.6%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 11
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Text analysis

Amazon

A
A SCHOOL- ROOM
SCHOOL- ROOM

Google

S7S GENO warm04ut don heeattly argaung mthe hut thint stal Want intita ofh thust tsahi all ENA Arabet A SCHOOL- ROOM
S7S
GENO
warm04ut
don
heeattly
argaung
mthe
hut
thint
stal
Want
intita
ofh
thust
tsahi
all
ENA
Arabet
A
SCHOOL-
ROOM