Human Generated Data

Title

Charity, Children: United States. New York. Buffalo. St. Mary's Infant Asylum and Maternity Hospital: St. Mary's Infant Asylum and Maternity Hospital, Buffalo, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.296.1

Human Generated Data

Title

Charity, Children: United States. New York. Buffalo. St. Mary's Infant Asylum and Maternity Hospital: St. Mary's Infant Asylum and Maternity Hospital, Buffalo, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Human 99.2
Person 99.2
Person 98.7
Furniture 97.9
Person 97.8
Person 97.6
Person 95.8
Person 92.2
Person 91.2
Clinic 91.1
Person 90.8
Person 88.1
Hospital 87.8
Person 85
Art 69.8
Painting 69.8
Bed 60.7
Operating Theatre 59.8
Crib 56.1
Person 47.1

Imagga
created on 2022-06-04

sax 100
wind instrument 35.6
man 27.5
musical instrument 18.9
male 17.7
person 16.2
black 15.6
adult 15.2
people 15.1
music 13.6
grunge 11.9
style 11.9
art 11.7
room 11.4
musician 11.3
vintage 10.7
old 10.4
rock 10.4
guitar 10.4
dark 10
human 9.7
portrait 9.7
stringed instrument 9.7
antique 9.5
play 9.5
city 9.1
sexy 8.8
building 8.7
musical 8.6
studio 8.4
fashion 8.3
silhouette 8.3
one 8.2
brass 8.1
dirty 8.1
concert 7.8
men 7.7
oboe 7.7
player 7.5
house 7.5
sound 7.5
retro 7.4
entertainment 7.4
street 7.4
light 7.3
lifestyle 7.2
body 7.2
bowed stringed instrument 7.2
singer 7.2
hair 7.1
performer 7.1

Google
created on 2022-06-04

Microsoft
created on 2022-06-04

clothing 98.6
text 96.4
person 90.1
man 83.5
old 79.1
photograph 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Female, 84.5%
Sad 99.9%
Calm 11.1%
Fear 7.3%
Surprised 6.9%
Confused 2%
Angry 1.6%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 0-3
Gender Female, 97.7%
Sad 99.6%
Calm 29.6%
Surprised 7%
Fear 6.3%
Disgusted 1.2%
Angry 0.9%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 87.4%
Surprised 7.2%
Sad 6.7%
Fear 6%
Angry 0.8%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 9-17
Gender Female, 98.9%
Sad 98.2%
Calm 39.8%
Surprised 6.6%
Fear 6.4%
Confused 1.4%
Disgusted 1%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 0-3
Gender Male, 90.7%
Sad 99.6%
Surprised 18.6%
Calm 13%
Fear 6.5%
Confused 2.6%
Disgusted 1.1%
Angry 0.7%
Happy 0.6%

AWS Rekognition

Age 0-3
Gender Male, 86.9%
Calm 76.8%
Sad 9.2%
Fear 7.4%
Surprised 7%
Confused 3.7%
Angry 1.9%
Disgusted 1.1%
Happy 0.8%

AWS Rekognition

Age 1-7
Gender Female, 98.2%
Calm 75.2%
Surprised 9.7%
Fear 9.7%
Sad 3.2%
Confused 2.5%
Angry 2.2%
Happy 1.9%
Disgusted 1.8%

AWS Rekognition

Age 1-7
Gender Male, 73.9%
Calm 85.8%
Fear 9.1%
Surprised 7.5%
Sad 2.6%
Confused 2.4%
Happy 0.4%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 1-7
Gender Female, 85.8%
Calm 52.4%
Fear 44.9%
Surprised 6.7%
Angry 3.9%
Sad 2.9%
Confused 1.1%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 0-6
Gender Female, 93.2%
Fear 46.4%
Calm 34.5%
Sad 18.4%
Surprised 7.9%
Happy 2.4%
Angry 1.9%
Confused 1.5%
Disgusted 1.3%

AWS Rekognition

Age 2-8
Gender Male, 84.5%
Calm 67.4%
Sad 27.1%
Fear 8.9%
Surprised 6.6%
Confused 3.2%
Happy 1.3%
Disgusted 0.5%
Angry 0.4%

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 69.8%

Captions

Microsoft

a group of people sitting in front of a building 74.7%
a group of people sitting and standing in front of a building 74.6%
a group of people standing in front of a building 74.5%

Text analysis

Amazon

573

Google

573