Human Generated Data

Title

Untitled (minstrel show performance)

Date

January 14, 1950

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18057

Human Generated Data

Title

Untitled (minstrel show performance)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

January 14, 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Interior Design 100
Indoors 100
Human 99.5
Person 99.5
Room 98.8
Theater 93.6
Person 92.8
Stage 88.8
Person 88.4
Person 85.7
Person 82.6
Person 82.5
Person 80.8
Person 80.2
Auditorium 79
Hall 79
Leisure Activities 78.8
Performer 78.7
Person 78.4
Crowd 77.6
Person 76.8
Person 73.6
Person 72.7
Person 69.4
People 68
Apparel 60.4
Clothing 60.4
Musician 59.9
Musical Instrument 59.9
Living Room 58.8
Restaurant 57
Audience 56.8
Dress 55.6

Imagga
created on 2022-03-04

balcony 63.4
architecture 37.7
building 33.9
statue 29.7
structure 23.9
city 23.3
sculpture 23.1
landmark 21.7
percussion instrument 20.9
history 20.6
monument 20.5
marimba 18.7
travel 18.3
musical instrument 17.7
historic 17.4
old 17.4
tourism 17.3
house 16
church 15.7
ancient 15.6
marble 15.5
famous 14.9
stone 14.3
palace 13.6
religion 13.4
tourist 12.9
culture 12.8
column 12.5
god 12.4
art 12.4
historical 12.2
fountain 12.2
water 11.3
altar 10.5
flowers 10.4
people 10
temple 10
window 9.7
detail 9.6
home 9.6
antique 9.5
facade 9.5
life 9.3
ornate 9.1
vintage 9.1
hall 9
sky 8.9
museum 8.9
style 8.9
arch 8.7
worship 8.7
cathedral 8.6
wall 8.6
shop 8.4
outdoor 8.4
town 8.3
inside 8.3
counter 8
carving 8
interior 8
urban 7.9
glass 7.8
grand 7.8
religious 7.5
piano 7.5
man 7.4
design 7.3
love 7.1

Google
created on 2022-03-04

Photograph 94.2
Black 89.7
Black-and-white 83.9
Style 83.8
Art 79.3
Table 77.5
Font 77.2
Crowd 75.3
Snapshot 74.3
Chair 73.5
Event 73.3
Suit 73
Monochrome photography 72.7
Monochrome 71.4
Room 69.5
Vintage clothing 69.1
History 66.4
Stock photography 66.1
Visual arts 64.9
Illustration 64.1

Microsoft
created on 2022-03-04

text 96.4
indoor 95
clothing 94.5
person 94.4
woman 68.2
people 57.2

Face analysis

Amazon

Google

AWS Rekognition

Age 6-12
Gender Male, 98.8%
Sad 90.6%
Angry 5.7%
Fear 1.2%
Calm 1.1%
Happy 1%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 36-44
Gender Male, 89.5%
Calm 86.4%
Sad 5.6%
Confused 3.6%
Disgusted 2.5%
Happy 0.9%
Angry 0.5%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 55.2%
Sad 38.8%
Calm 32.1%
Happy 19%
Fear 2.9%
Surprised 2.1%
Confused 1.9%
Disgusted 1.7%
Angry 1.6%

AWS Rekognition

Age 18-26
Gender Female, 92.3%
Sad 81.7%
Happy 6.4%
Calm 4.5%
Disgusted 3.6%
Fear 1.4%
Confused 1.1%
Angry 0.9%
Surprised 0.4%

AWS Rekognition

Age 34-42
Gender Female, 96.2%
Happy 65.4%
Calm 14.1%
Sad 12.5%
Fear 2.4%
Angry 1.8%
Disgusted 1.7%
Confused 1.2%
Surprised 0.8%

AWS Rekognition

Age 12-20
Gender Female, 50.8%
Sad 84.9%
Fear 4%
Confused 2.8%
Calm 2.7%
Disgusted 1.7%
Angry 1.6%
Happy 1.3%
Surprised 1%

AWS Rekognition

Age 26-36
Gender Male, 67.6%
Calm 90.1%
Happy 5.4%
Sad 2.3%
Fear 0.6%
Confused 0.5%
Angry 0.4%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 16-22
Gender Female, 54.3%
Calm 65.2%
Fear 13.9%
Sad 9.6%
Confused 4.5%
Happy 2.9%
Angry 1.9%
Disgusted 1.2%
Surprised 0.7%

AWS Rekognition

Age 38-46
Gender Male, 96.4%
Calm 34.3%
Sad 19.4%
Confused 10.8%
Angry 10.2%
Fear 10%
Disgusted 7.9%
Surprised 3.8%
Happy 3.7%

AWS Rekognition

Age 24-34
Gender Female, 91%
Calm 66.5%
Angry 12.9%
Sad 9.9%
Happy 3.1%
Confused 3%
Fear 2.1%
Disgusted 1.4%
Surprised 1.1%

AWS Rekognition

Age 23-31
Gender Male, 77.8%
Calm 83.7%
Happy 10.9%
Sad 2.6%
Confused 1.2%
Surprised 0.6%
Disgusted 0.6%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Female, 97.4%
Disgusted 21%
Sad 19.4%
Confused 19.2%
Calm 12.5%
Angry 12%
Happy 9.1%
Fear 4.1%
Surprised 2.6%

AWS Rekognition

Age 34-42
Gender Male, 95.9%
Sad 44%
Confused 24.1%
Calm 17.5%
Angry 6.6%
Disgusted 3%
Happy 1.8%
Surprised 1.6%
Fear 1.5%

AWS Rekognition

Age 22-30
Gender Male, 91.4%
Calm 64.9%
Sad 21.5%
Confused 5.9%
Fear 2.8%
Happy 1.9%
Angry 1.2%
Surprised 1.1%
Disgusted 0.8%

AWS Rekognition

Age 34-42
Gender Male, 82.1%
Calm 91.5%
Angry 4.5%
Happy 1.1%
Sad 1%
Disgusted 0.9%
Surprised 0.5%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Female, 85%
Calm 57.7%
Sad 18.6%
Angry 8.6%
Happy 6.3%
Confused 2.8%
Disgusted 2.6%
Surprised 1.9%
Fear 1.4%

AWS Rekognition

Age 28-38
Gender Male, 72.6%
Calm 96.7%
Sad 1.2%
Angry 0.9%
Confused 0.6%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Female, 85.6%
Sad 81.3%
Calm 14%
Confused 1.4%
Happy 1.3%
Fear 0.7%
Angry 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 33-41
Gender Female, 88.3%
Happy 85%
Surprised 3.8%
Fear 3%
Angry 2.8%
Sad 1.7%
Confused 1.5%
Calm 1.2%
Disgusted 1%

AWS Rekognition

Age 16-24
Gender Female, 89.6%
Happy 61.5%
Calm 28.6%
Confused 3.4%
Sad 3.3%
Fear 1.1%
Angry 0.9%
Disgusted 0.8%
Surprised 0.5%

AWS Rekognition

Age 6-14
Gender Male, 97.9%
Calm 99.9%
Disgusted 0%
Sad 0%
Surprised 0%
Fear 0%
Angry 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Female, 53.4%
Calm 77.1%
Sad 11.3%
Fear 4.9%
Surprised 1.9%
Confused 1.8%
Disgusted 1.2%
Angry 0.9%
Happy 0.8%

AWS Rekognition

Age 19-27
Gender Female, 87.4%
Calm 61%
Sad 17.3%
Happy 7.3%
Fear 4.8%
Angry 3.7%
Confused 2.4%
Surprised 1.9%
Disgusted 1.6%

AWS Rekognition

Age 25-35
Gender Female, 87.9%
Calm 75.2%
Sad 10.3%
Angry 5.7%
Confused 3.5%
Happy 2.6%
Disgusted 1.8%
Fear 0.7%
Surprised 0.3%

AWS Rekognition

Age 23-33
Gender Female, 50.4%
Calm 91.6%
Happy 2.5%
Sad 2.3%
Fear 1.5%
Disgusted 1%
Surprised 0.7%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 23-31
Gender Female, 96.9%
Calm 71.9%
Happy 13.1%
Sad 9.9%
Confused 2.3%
Disgusted 1%
Fear 0.8%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 54-62
Gender Female, 84.4%
Happy 44.7%
Calm 39.1%
Sad 8.6%
Disgusted 2%
Fear 1.5%
Angry 1.4%
Surprised 1.4%
Confused 1.3%

AWS Rekognition

Age 18-26
Gender Male, 68.5%
Sad 51.1%
Happy 38.7%
Calm 6.7%
Confused 1.3%
Surprised 0.7%
Angry 0.5%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 21-29
Gender Male, 63%
Sad 23%
Confused 22.2%
Angry 17.8%
Calm 14.3%
Happy 11.5%
Disgusted 4.3%
Surprised 3.6%
Fear 3.2%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 86.4%
Fear 4.1%
Surprised 4%
Angry 1.8%
Sad 1.8%
Confused 0.7%
Disgusted 0.6%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people standing in front of a window 80.4%
a group of people in front of a window 79.5%
a group of people sitting in front of a window 69.1%

Text analysis

Amazon

Et