Human Generated Data

Title

Untitled (minstrel show on stage, people in various costumes)

Date

1951

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18406

Human Generated Data

Title

Untitled (minstrel show on stage, people in various costumes)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Human 99.3
Person 99.3
Person 99.1
Person 98.7
Person 98.7
Person 98.6
Person 97.8
Person 97.1
Person 97
Person 95.6
Person 95.3
Person 94.5
Person 93
Clothing 92.9
Apparel 92.9
Person 92.3
Person 91.6
Person 86.8
Person 73.9
Stage 72.2
Person 66.6
Overcoat 64.2
Coat 64.2
Suit 64.2
Person 64
People 63
Person 62.5
Crowd 60.8
Handrail 58.1
Banister 58.1
Transportation 56.7
Bike 56.7
Bicycle 56.7
Vehicle 56.7
Face 56.4
Female 55.6
Dress 55.2
Person 42.5

Imagga
created on 2022-03-04

people 25.6
musical instrument 17.9
man 17.5
business 16.4
women 15
architecture 14.8
couple 14.8
building 14.6
balcony 14.3
life 14.1
old 13.9
adult 13.4
men 12.9
marimba 12.2
group 12.1
percussion instrument 11.5
indoors 11.4
counter 11.4
male 11.3
new 11.3
home 11.2
window 11
person 10.9
wall 10.4
structure 10.4
portrait 10.3
wind instrument 10.2
happiness 10.2
stone 10.1
house 10.1
city 10
silhouette 9.9
religion 9.8
travel 9.8
brass 9.8
family 9.8
interior 9.7
black 9.7
bride 9.7
crowd 9.6
glass 9.6
love 9.5
monument 9.3
statue 9.1
dress 9
history 8.9
shop 8.9
urban 8.7
scene 8.6
cathedral 8.6
room 8.6
walking 8.5
tourist 8.4
art 8
god 7.6
historical 7.5
human 7.5
church 7.4
wedding 7.3
light 7.3
design 7.3
world 7.2
suit 7.2
holiday 7.2
businessman 7.1
outfit 7

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

clothing 97.5
person 93.8
people 92
man 87.4
standing 84.8
group 79.3
woman 62.2
black and white 56

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 60.4%
Disgusted 12.8%
Happy 11%
Confused 5.6%
Angry 4%
Sad 3.8%
Surprised 1.8%
Fear 0.7%

AWS Rekognition

Age 31-41
Gender Female, 98%
Sad 69.4%
Calm 12.1%
Fear 6.7%
Confused 4.1%
Angry 3.9%
Happy 1.6%
Disgusted 1.2%
Surprised 1.1%

AWS Rekognition

Age 49-57
Gender Female, 90.7%
Sad 37.4%
Happy 19.1%
Calm 18.2%
Angry 6.6%
Disgusted 5.8%
Fear 5.6%
Confused 5.2%
Surprised 2%

AWS Rekognition

Age 53-61
Gender Male, 99.4%
Calm 61.8%
Sad 24.2%
Disgusted 4.3%
Fear 2.8%
Happy 2.5%
Surprised 1.8%
Confused 1.6%
Angry 1.1%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Sad 51.7%
Calm 25.1%
Angry 8.7%
Confused 6.2%
Disgusted 4.7%
Fear 1.4%
Surprised 1.3%
Happy 0.8%

AWS Rekognition

Age 21-29
Gender Female, 67.4%
Sad 74.5%
Calm 18.1%
Angry 2.7%
Confused 2%
Happy 0.8%
Surprised 0.7%
Disgusted 0.6%
Fear 0.6%

AWS Rekognition

Age 28-38
Gender Male, 92.2%
Sad 44.9%
Calm 40.3%
Confused 9.2%
Angry 1.9%
Happy 1.7%
Surprised 1%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Male, 70.7%
Happy 97.9%
Fear 1%
Calm 0.3%
Surprised 0.3%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 97.9%
Confused 29.2%
Calm 28.9%
Sad 26.2%
Disgusted 6.4%
Fear 3.1%
Happy 2.9%
Angry 2%
Surprised 1.3%

AWS Rekognition

Age 20-28
Gender Female, 52.3%
Sad 71.4%
Angry 24.9%
Fear 1%
Confused 0.9%
Disgusted 0.7%
Calm 0.5%
Happy 0.5%
Surprised 0.2%

AWS Rekognition

Age 40-48
Gender Male, 74.7%
Disgusted 36.3%
Confused 25.2%
Sad 15.8%
Calm 15%
Angry 3.2%
Happy 2.1%
Surprised 1.4%
Fear 0.9%

AWS Rekognition

Age 40-48
Gender Male, 89.4%
Sad 59.6%
Calm 33%
Confused 3.5%
Happy 1.2%
Disgusted 1.2%
Surprised 0.7%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 34-42
Gender Female, 90.5%
Sad 85.2%
Confused 4.8%
Calm 3.6%
Disgusted 1.8%
Angry 1.4%
Surprised 1.2%
Happy 1.2%
Fear 0.7%

AWS Rekognition

Age 47-53
Gender Male, 95.3%
Fear 54.4%
Calm 21.8%
Surprised 10.3%
Disgusted 4.7%
Sad 4.2%
Angry 1.8%
Confused 1.8%
Happy 1.1%

AWS Rekognition

Age 33-41
Gender Male, 97.9%
Calm 95.5%
Happy 3.4%
Disgusted 0.3%
Surprised 0.3%
Sad 0.3%
Angry 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Female, 63.5%
Calm 62.4%
Sad 16.8%
Confused 8%
Happy 7.9%
Angry 2.5%
Disgusted 1%
Fear 0.8%
Surprised 0.5%

AWS Rekognition

Age 37-45
Gender Male, 97.6%
Sad 38.2%
Calm 33.4%
Confused 15.3%
Fear 3.1%
Happy 3.1%
Angry 2.5%
Disgusted 2.5%
Surprised 2%

AWS Rekognition

Age 21-29
Gender Male, 99.2%
Sad 75.1%
Confused 15.1%
Fear 4.8%
Angry 1.7%
Happy 0.9%
Disgusted 0.8%
Calm 0.8%
Surprised 0.7%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Confused 51.2%
Calm 17.9%
Sad 13.9%
Disgusted 6.7%
Happy 4%
Fear 2.3%
Surprised 2.1%
Angry 1.9%

AWS Rekognition

Age 10-18
Gender Female, 96.1%
Sad 60%
Calm 19%
Disgusted 12.5%
Fear 5.7%
Angry 1.4%
Surprised 0.5%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 74.4%
Calm 10.4%
Fear 8.3%
Happy 2.5%
Disgusted 1.4%
Surprised 1.3%
Angry 1%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people standing in front of a building 96.4%
a group of people standing in front of a crowd 93.9%
a group of people standing in a room 93.8%

Text analysis

Amazon

804