Human Generated Data

Title

Charity, Hospitals: United States. New York. Ogdensburg. City Hospital and Orphanage: Grey Nuns of the Cross: City Hospital and Orphanage, Ogdensburg, N.Y. (Under the direction of the Grey Nuns of the Cross): Little Girls at Dumbell-Exercise.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.113.1

Human Generated Data

Title

Charity, Hospitals: United States. New York. Ogdensburg. City Hospital and Orphanage: Grey Nuns of the Cross: City Hospital and Orphanage, Ogdensburg, N.Y. (Under the direction of the Grey Nuns of the Cross): Little Girls at Dumbell-Exercise.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.113.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.4
Human 99.4
Person 99.3
Person 98.9
Person 98.8
Person 98.6
Person 98.3
Person 98.3
Person 97.5
Person 95.6
Person 92.1
Classroom 88.9
School 88.9
Indoors 88.9
Room 88.9
Person 87.1
Person 85.8
Kindergarten 81.1
Person 80.1
Person 78
Porch 77.2
Apparel 77.2
Clothing 77.2
Person 66.3
People 65
Person 62.2
Plaid 59.9
Tartan 59.9
Shoe 56.3
Footwear 56.3

Clarifai
created on 2019-06-07

people 100
child 99.9
group 99.9
many 99.9
group together 99.2
elementary school 97.8
education 97.5
school 97.2
administration 97
boy 95.1
several 93.9
wear 93.8
adult 91.4
room 90.9
war 90.2
military 88.1
teacher 88
classroom 85.7
outfit 81.2
sibling 80.9

Imagga
created on 2019-06-07

kin 39
people 26.7
clothing 18.6
man 15.4
adult 15.3
old 14.6
women 14.2
dress 13.5
traditional 13.3
child 13
fashion 12.8
person 12.6
outfit 12.6
happiness 12.5
happy 12.5
history 12.5
statue 12.3
portrait 12.3
city 11.6
family 11.5
uniform 11.4
male 11.3
ancient 11.2
culture 11.1
face 10.6
travel 10.5
group 10.5
decoration 10.1
holiday 10
children 10
interior 9.7
sculpture 9.7
weapon 9.7
style 9.6
art 9.4
men 9.4
world 9.4
tradition 9.2
historic 9.2
religion 9
couple 8.7
antique 8.5
friends 8.4
religious 8.4
black 8.4
color 8.3
entertainment 8.3
human 8.2
tourism 8.2
helmet 8.2
girls 8.2
hat 8.2
room 8.1
celebration 8
boutique 7.8
standing 7.8
army 7.8
shop 7.8
mother 7.7
military 7.7
war 7.7
daughter 7.6
casual 7.6
fun 7.5
sword 7.5
vintage 7.4
building 7.4
military uniform 7.4
retro 7.4
shopping 7.3
attendant 7.3
cheerful 7.3
business 7.3
new 7.3
lifestyle 7.2
musician 7.1
life 7
architecture 7

Google
created on 2019-06-07

Photograph 95
Vintage clothing 68.9
Monochrome 60.1
History 57.6
Black-and-white 56.4
Style 51

Microsoft
created on 2019-06-07

person 99
clothing 97.9
child 93.9
group 89.7
toddler 83.4
posing 83
standing 77
human face 74.4
girl 69.3
smile 61
people 60.2
old 57.6
dress 57.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Female, 54.8%
Angry 45.1%
Calm 53.1%
Confused 45.1%
Happy 45.2%
Surprised 45.1%
Disgusted 45.1%
Sad 46.4%

AWS Rekognition

Age 6-13
Gender Female, 52.6%
Angry 45.1%
Confused 45%
Disgusted 45%
Surprised 45%
Calm 45.3%
Sad 54.5%
Happy 45.1%

AWS Rekognition

Age 9-14
Gender Female, 52.7%
Surprised 45.3%
Disgusted 45.2%
Happy 49.5%
Sad 46.8%
Angry 45.2%
Calm 47.9%
Confused 45.1%

AWS Rekognition

Age 10-15
Gender Female, 52%
Calm 46.1%
Sad 49.9%
Surprised 45.2%
Disgusted 47.9%
Angry 45.6%
Confused 45.2%
Happy 45.1%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Disgusted 45.2%
Angry 45.2%
Sad 51.3%
Happy 45.9%
Calm 47%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 14-25
Gender Female, 51.2%
Disgusted 45.3%
Surprised 45.3%
Confused 45.3%
Calm 49.6%
Angry 45.9%
Happy 45.7%
Sad 47.8%

AWS Rekognition

Age 10-15
Gender Male, 51.2%
Disgusted 45.1%
Confused 45.2%
Angry 46.1%
Calm 49.5%
Sad 49%
Surprised 45.1%
Happy 45%

AWS Rekognition

Age 12-22
Gender Female, 54.1%
Sad 53%
Calm 46.5%
Disgusted 45.2%
Confused 45%
Surprised 45.1%
Happy 45.1%
Angry 45.2%

AWS Rekognition

Age 16-27
Gender Female, 51.4%
Sad 51.8%
Angry 45.5%
Calm 46.9%
Surprised 45.2%
Disgusted 45.2%
Happy 45.2%
Confused 45.2%

AWS Rekognition

Age 10-15
Gender Female, 54.6%
Sad 46.4%
Calm 52%
Angry 45.2%
Disgusted 45.2%
Confused 45.1%
Surprised 45.1%
Happy 46%

AWS Rekognition

Age 14-25
Gender Male, 54.7%
Calm 53.3%
Disgusted 45.1%
Angry 45.9%
Sad 45.4%
Surprised 45.1%
Confused 45.2%
Happy 45.1%

AWS Rekognition

Age 11-18
Gender Female, 52.6%
Disgusted 45.1%
Confused 45.2%
Surprised 45.1%
Calm 45.9%
Happy 45.4%
Angry 45.2%
Sad 53%

AWS Rekognition

Age 11-18
Gender Female, 52.9%
Calm 45.1%
Angry 45%
Disgusted 45%
Surprised 45%
Happy 45%
Confused 45%
Sad 54.8%

AWS Rekognition

Age 35-52
Gender Female, 53.7%
Sad 52.4%
Happy 45.1%
Angry 46.3%
Surprised 45.1%
Disgusted 45.2%
Confused 45.2%
Calm 45.8%

AWS Rekognition

Age 4-9
Gender Female, 50.7%
Confused 45.2%
Calm 47%
Happy 45.3%
Disgusted 45.1%
Sad 51.9%
Angry 45.3%
Surprised 45.1%

AWS Rekognition

Age 14-25
Gender Female, 50.2%
Angry 45.6%
Sad 49.7%
Surprised 45.2%
Confused 45.2%
Happy 45.1%
Calm 49.1%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54%
Happy 45.2%
Angry 45.2%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%
Calm 45.4%
Sad 53.9%

AWS Rekognition

Age 10-15
Gender Female, 53.8%
Disgusted 45.1%
Calm 50.7%
Confused 45.4%
Sad 47.9%
Angry 45.4%
Surprised 45.5%
Happy 45.1%

AWS Rekognition

Age 4-9
Gender Female, 54.6%
Disgusted 45.1%
Surprised 45.1%
Confused 45.1%
Sad 53.3%
Happy 45.2%
Calm 45.8%
Angry 45.4%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 56.3%