Human Generated Data

Title

Charity, Children: United States. New York. Syracuse. Onandaga Orphan Asylum: Orphan Asylum of Ononadaga County, N.Y.: Dining-room

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.673.1

Human Generated Data

Title

Charity, Children: United States. New York. Syracuse. Onandaga Orphan Asylum: Orphan Asylum of Ononadaga County, N.Y.: Dining-room

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.5
Human 99.5
Person 99.4
Person 98.9
Person 98.8
Person 98.6
Person 97.3
Room 96.5
School 96.5
Classroom 96.5
Indoors 96.5
Person 96.3
Person 94.8
Person 93
Person 92.2
Person 89
Person 88.6
Person 87.6
Person 86
Person 78.4
Person 78
Person 77.3
Building 73.6
Person 69.2
Person 62.9
Clinic 56.2

Clarifai
created on 2019-06-07

people 100
many 100
group 99.7
group together 99.4
adult 98.3
administration 96.9
leader 95.3
woman 95
education 93.7
man 93.6
school 91.7
crowd 91.1
several 88.5
audience 87.6
teacher 85.4
spectator 83.1
wear 82.5
classroom 81
war 80.5
military 80

Imagga
created on 2019-06-07

barbershop 35.8
bride 32.6
groom 31.6
shop 30.4
people 30.1
couple 29.6
wedding 29.4
hairdresser 28.3
dress 28
love 23.7
mercantile establishment 23.3
married 23
person 22.1
happy 20.7
happiness 20.4
two 20.3
man 19.5
adult 18.8
women 18.2
bouquet 17.9
family 17.8
male 17.7
men 17.2
marriage 17.1
portrait 16.8
room 15.5
place of business 15.4
celebration 15.1
nurse 14.1
old 13.9
ceremony 13.6
smile 13.5
gown 13.5
together 13.1
new 13
home 12.8
romantic 12.5
husband 12.4
smiling 12.3
veil 11.8
hospital 11.5
wife 11.4
salon 10.9
mother 10.7
senior 10.3
day 10.2
flower 10
wed 9.8
romance 9.8
fashion 9.8
bridal 9.7
flowers 9.6
holiday 9.3
worker 9.2
life 9
human 9
outdoors 9
cheerful 8.9
kiss 8.8
indoors 8.8
elderly 8.6
loving 8.6
boutique 8.6
teacher 8.5
church 8.3
tradition 8.3
traditional 8.3
care 8.2
professional 8.2
lady 8.1
interior 8
medical 7.9
hair 7.9
matrimony 7.9
chair 7.8
attractive 7.7
establishment 7.6
elegance 7.6
future 7.4
mature 7.4
park 7.4
patient 7.4
historic 7.3
girls 7.3
lifestyle 7.2
suit 7.2
religion 7.2
work 7.1
face 7.1

Google
created on 2019-06-07

Class 78.9
Room 76.5
Event 73.3
Child 72.8
State school 71.6
Uniform 59.9
Monochrome 54.4
Classroom 51.6

Microsoft
created on 2019-06-07

person 98.4
clothing 97.5
group 92
people 81.1
woman 70.8
man 65
human face 53
clothes 18.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Male, 50%
Sad 51.1%
Confused 45.3%
Calm 47.5%
Angry 45.6%
Disgusted 45.2%
Happy 45.1%
Surprised 45.2%

AWS Rekognition

Age 16-27
Gender Male, 51.9%
Confused 45.1%
Disgusted 45%
Surprised 45%
Sad 54.4%
Happy 45.2%
Angry 45.1%
Calm 45.1%

AWS Rekognition

Age 27-44
Gender Male, 50.4%
Disgusted 45.6%
Surprised 45.3%
Confused 45.2%
Sad 45.9%
Happy 45.2%
Calm 52.4%
Angry 45.3%

AWS Rekognition

Age 17-27
Gender Female, 51%
Confused 45.6%
Calm 47.7%
Happy 47.9%
Disgusted 45.6%
Sad 46.7%
Angry 45.5%
Surprised 46%

AWS Rekognition

Age 17-27
Gender Female, 50.8%
Disgusted 45.2%
Surprised 45.1%
Confused 45.1%
Sad 52.4%
Happy 46.6%
Calm 45.3%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 45.3%
Surprised 45.3%
Confused 45.3%
Calm 49%
Angry 45.5%
Happy 45.3%
Sad 49.4%

AWS Rekognition

Age 27-44
Gender Female, 51%
Surprised 46.1%
Confused 45.7%
Disgusted 46.4%
Angry 46.1%
Calm 47.9%
Happy 45.3%
Sad 47.4%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Happy 50.1%
Angry 49.5%
Calm 49.7%
Sad 49.6%
Confused 49.6%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Sad 49.8%
Surprised 49.6%
Disgusted 49.6%
Calm 49.7%
Angry 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.5%
Surprised 49.6%
Happy 49.9%
Calm 49.6%
Angry 49.6%
Sad 49.8%
Confused 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Sad 50.4%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 49.6%
Angry 49.6%
Calm 49.9%
Surprised 49.6%
Disgusted 49.5%
Sad 49.6%
Confused 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.6%
Confused 49.5%
Happy 49.9%
Calm 49.6%
Surprised 49.5%
Angry 49.6%
Sad 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Angry 49.6%
Surprised 49.7%
Sad 49.7%
Confused 49.7%
Happy 49.6%
Calm 49.6%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Angry 49.6%
Happy 49.5%
Confused 49.7%
Disgusted 49.5%
Sad 49.7%
Surprised 49.7%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Happy 49.7%
Sad 49.6%
Surprised 49.7%
Angry 49.6%
Calm 49.6%
Disgusted 49.6%
Confused 49.6%

AWS Rekognition

Age 11-18
Gender Female, 50.1%
Angry 49.6%
Happy 49.7%
Confused 49.6%
Disgusted 49.7%
Sad 49.6%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 49.6%
Calm 49.5%
Sad 49.6%
Confused 49.6%
Disgusted 49.8%
Surprised 49.6%
Happy 49.8%

AWS Rekognition

Age 11-18
Gender Female, 50.3%
Surprised 49.5%
Happy 49.5%
Calm 49.6%
Angry 49.7%
Disgusted 49.9%
Sad 49.7%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Male, 50.3%
Confused 49.5%
Disgusted 49.6%
Surprised 49.6%
Sad 49.7%
Happy 49.5%
Angry 49.6%
Calm 49.9%

AWS Rekognition

Age 27-44
Gender Male, 50%
Surprised 49.5%
Disgusted 49.5%
Angry 49.6%
Confused 49.5%
Calm 49.9%
Happy 49.5%
Sad 49.9%

AWS Rekognition

Age 14-25
Gender Male, 50.3%
Angry 49.7%
Confused 49.6%
Disgusted 49.8%
Surprised 49.6%
Calm 49.6%
Sad 49.5%
Happy 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Disgusted 49.9%
Surprised 49.6%
Sad 49.7%
Confused 49.5%
Calm 49.6%
Happy 49.7%
Angry 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Calm 50.2%
Happy 49.6%
Surprised 49.6%
Disgusted 49.5%
Sad 49.6%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Angry 49.6%
Sad 50.2%
Happy 49.5%
Disgusted 49.7%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.5%
Sad 49.5%
Angry 49.5%
Confused 49.5%
Calm 50.3%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Sad 50%
Confused 49.6%
Disgusted 49.6%
Angry 49.6%
Happy 49.7%
Surprised 49.6%
Calm 49.6%

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 94.3%
a group of people standing in front of a building 94.2%
a group of people standing in front of a crowd 94.1%