Human Generated Data

Title

Charity, Children: United States. New York. Buffalo. St. Mary's Infant Asylum and Maternity Hospital: St. Mary's Infant Asylum and Maternity Hospital, Buffalo, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.296.1

Human Generated Data

Title

Charity, Children: United States. New York. Buffalo. St. Mary's Infant Asylum and Maternity Hospital: St. Mary's Infant Asylum and Maternity Hospital, Buffalo, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.296.1

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 99.2
Human 99.2
Person 98.7
Furniture 97.9
Person 97.8
Person 97.6
Person 95.8
Person 92.2
Person 91.2
Clinic 91.1
Person 90.8
Person 88.1
Hospital 87.8
Person 85
Painting 69.8
Art 69.8
Bed 60.7
Operating Theatre 59.8
Crib 56.1
Person 47.1

Imagga
created on 2022-06-04

sax 100
wind instrument 35.6
man 27.5
musical instrument 18.9
male 17.7
person 16.2
black 15.6
adult 15.2
people 15.1
music 13.6
grunge 11.9
style 11.9
art 11.7
room 11.4
musician 11.3
vintage 10.7
old 10.4
rock 10.4
guitar 10.4
dark 10
human 9.7
portrait 9.7
stringed instrument 9.7
antique 9.5
play 9.5
city 9.1
sexy 8.8
building 8.7
musical 8.6
studio 8.4
fashion 8.3
silhouette 8.3
one 8.2
brass 8.1
dirty 8.1
concert 7.8
men 7.7
oboe 7.7
player 7.5
house 7.5
sound 7.5
retro 7.4
entertainment 7.4
street 7.4
light 7.3
lifestyle 7.2
body 7.2
bowed stringed instrument 7.2
singer 7.2
hair 7.1
performer 7.1

Google
created on 2022-06-04

Chair 86.2
Art 85.1
Vintage clothing 75.3
Room 67.4
Machine 65.8
Table 65.5
History 63.3
Stock photography 61.9
Sitting 60
Visual arts 59.7
Classic 58.4
Retro style 56.1
Paper product 56
Monochrome 55.9
Collection 50.5

Microsoft
created on 2022-06-04

clothing 98.6
text 96.4
person 90.1
man 83.5
old 79.1
photograph 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Female, 84.5%
Sad 99.9%
Calm 11.1%
Fear 7.3%
Surprised 6.9%
Confused 2%
Angry 1.6%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 0-3
Gender Female, 97.7%
Sad 99.6%
Calm 29.6%
Surprised 7%
Fear 6.3%
Disgusted 1.2%
Angry 0.9%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 87.4%
Surprised 7.2%
Sad 6.7%
Fear 6%
Angry 0.8%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 9-17
Gender Female, 98.9%
Sad 98.2%
Calm 39.8%
Surprised 6.6%
Fear 6.4%
Confused 1.4%
Disgusted 1%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 0-3
Gender Male, 90.7%
Sad 99.6%
Surprised 18.6%
Calm 13%
Fear 6.5%
Confused 2.6%
Disgusted 1.1%
Angry 0.7%
Happy 0.6%

AWS Rekognition

Age 0-3
Gender Male, 86.9%
Calm 76.8%
Sad 9.2%
Fear 7.4%
Surprised 7%
Confused 3.7%
Angry 1.9%
Disgusted 1.1%
Happy 0.8%

AWS Rekognition

Age 1-7
Gender Female, 98.2%
Calm 75.2%
Surprised 9.7%
Fear 9.7%
Sad 3.2%
Confused 2.5%
Angry 2.2%
Happy 1.9%
Disgusted 1.8%

AWS Rekognition

Age 1-7
Gender Male, 73.9%
Calm 85.8%
Fear 9.1%
Surprised 7.5%
Sad 2.6%
Confused 2.4%
Happy 0.4%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 1-7
Gender Female, 85.8%
Calm 52.4%
Fear 44.9%
Surprised 6.7%
Angry 3.9%
Sad 2.9%
Confused 1.1%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 0-6
Gender Female, 93.2%
Fear 46.4%
Calm 34.5%
Sad 18.4%
Surprised 7.9%
Happy 2.4%
Angry 1.9%
Confused 1.5%
Disgusted 1.3%

AWS Rekognition

Age 2-8
Gender Male, 84.5%
Calm 67.4%
Sad 27.1%
Fear 8.9%
Surprised 6.6%
Confused 3.2%
Happy 1.3%
Disgusted 0.5%
Angry 0.4%

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 69.8%

Text analysis

Amazon

573

Google

573