Human Generated Data

Title

Untitled (minstrel show performance)

Date

January 14, 1950

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18054

Human Generated Data

Title

Untitled (minstrel show performance)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

January 14, 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 99.6
Human 99.6
Person 99.2
Person 99.2
Person 98.3
Audience 97.1
Crowd 97.1
Person 93.6
Indoors 93
Interior Design 93
Stage 92.6
Person 92.5
Person 85.7
Performer 85.3
Person 85.2
Person 85.2
Person 84.6
Person 83.9
Person 83.8
Person 83.5
People 81.2
Person 78.2
Person 77.2
Person 73.8
Person 73.7
Room 67.9
Leisure Activities 61.9
Poster 59
Advertisement 59
Funeral 57.5
Speech 56.1
Jury 55.1

Imagga
created on 2022-03-04

crowd 28.8
group 24.2
people 22.3
balcony 17.9
structure 17.8
black 16.8
old 16.7
silhouette 15.7
building 15.5
marimba 15.2
men 14.6
percussion instrument 13.9
male 13.5
classroom 12.8
billboard 12.8
shelf 12.7
travel 12
musical instrument 11.7
spectator 11.7
room 11.6
art 11.3
women 11.1
architecture 11
signboard 10.3
man 10.1
design 10.1
house 10
vintage 10
person 9.7
scene 9.5
life 9.3
business 9.1
home 8.8
walking 8.5
winter 8.5
row 8.4
city 8.3
history 8
audience 7.8
party 7.7
sky 7.6
stone 7.6
outline 7.6
friends 7.5
fun 7.5
tourism 7.4
stage 7.4
shop 7.4
many 7.4
water 7.3
graphic 7.3
adult 7.2
body 7.2
portrait 7.1
facade 7.1

Google
created on 2022-03-04

Black 89.5
Art 75.3
Font 75.1
Snapshot 74.3
Event 73.3
Team 72.3
Hat 71.2
Monochrome 69.1
Monochrome photography 68.4
Class 67.6
Crew 67.1
Room 64.7
Uniform 63.4
History 63.3
Stock photography 61.8
Crowd 61.3
Audience 60.6
Visual arts 60.5
Suit 57.4
Academic institution 55.8

Microsoft
created on 2022-03-04

person 99.2
clothing 92.3
concert 88.8
outdoor 88.5
man 85.2
black 83.1
white 81.4
group 70.1
text 67.1
people 64.2
human face 57.5
old 41.5
crowd 27.3
line 20.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Female, 55.8%
Calm 39.9%
Happy 32.7%
Sad 19.4%
Disgusted 2.5%
Fear 1.9%
Angry 1.3%
Confused 1.1%
Surprised 1%

AWS Rekognition

Age 35-43
Gender Male, 93.2%
Surprised 87.9%
Calm 7.9%
Confused 1.1%
Disgusted 1.1%
Angry 0.7%
Happy 0.6%
Sad 0.5%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Male, 99.4%
Sad 91.9%
Calm 4.6%
Confused 1.6%
Disgusted 0.6%
Angry 0.5%
Fear 0.5%
Happy 0.2%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Male, 72.4%
Calm 41%
Surprised 12.8%
Disgusted 10.7%
Fear 10.6%
Confused 8.7%
Happy 8.1%
Sad 4.4%
Angry 3.7%

AWS Rekognition

Age 16-24
Gender Female, 62.4%
Calm 62.9%
Sad 24.7%
Happy 7.2%
Confused 2.1%
Angry 1.6%
Disgusted 1%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 50-58
Gender Female, 70.3%
Calm 90.6%
Happy 5.9%
Sad 0.9%
Angry 0.8%
Surprised 0.7%
Disgusted 0.7%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 96.5%
Happy 28.1%
Calm 26.2%
Sad 21.7%
Fear 19%
Disgusted 1.6%
Angry 1.6%
Surprised 1%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Female, 71.7%
Calm 56.3%
Disgusted 14.2%
Sad 12.1%
Angry 7.8%
Happy 3.6%
Fear 3.5%
Surprised 1.5%
Confused 1.1%

AWS Rekognition

Age 34-42
Gender Male, 53.5%
Happy 53.7%
Calm 30.9%
Sad 4.8%
Confused 3.5%
Fear 2.1%
Surprised 2%
Angry 1.8%
Disgusted 1.2%

AWS Rekognition

Age 14-22
Gender Female, 53.6%
Angry 50.7%
Sad 13.9%
Happy 13.3%
Disgusted 6%
Calm 5.1%
Fear 4.2%
Surprised 4.2%
Confused 2.7%

AWS Rekognition

Age 30-40
Gender Male, 92.8%
Sad 44.5%
Calm 26.7%
Confused 16.6%
Disgusted 4.9%
Angry 4.5%
Happy 1.2%
Surprised 0.8%
Fear 0.7%

AWS Rekognition

Age 25-35
Gender Female, 70.7%
Calm 84.1%
Happy 11.2%
Fear 1.9%
Sad 1.8%
Angry 0.3%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Female, 98.5%
Sad 73.7%
Calm 18%
Happy 3.9%
Confused 3.1%
Disgusted 0.5%
Fear 0.3%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 50-58
Gender Female, 99.2%
Confused 68.7%
Happy 9.8%
Sad 7%
Calm 5.4%
Fear 3.9%
Disgusted 2.3%
Angry 1.5%
Surprised 1.3%

AWS Rekognition

Age 25-35
Gender Female, 51.8%
Calm 78.2%
Sad 7.6%
Confused 5%
Angry 4.1%
Disgusted 2.2%
Surprised 1.2%
Happy 1.1%
Fear 0.7%

AWS Rekognition

Age 24-34
Gender Male, 67.1%
Sad 51.6%
Calm 44.6%
Happy 1.4%
Confused 1.3%
Disgusted 0.5%
Angry 0.5%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Female, 77.4%
Happy 63.1%
Sad 13.6%
Fear 11.6%
Calm 6.9%
Angry 2.2%
Disgusted 1.4%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 10-18
Gender Male, 57.4%
Sad 84.4%
Calm 9.8%
Happy 2.8%
Fear 0.8%
Confused 0.7%
Angry 0.6%
Disgusted 0.6%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Female, 91.7%
Happy 47%
Calm 46.3%
Surprised 1.9%
Sad 1.8%
Disgusted 1.5%
Fear 0.8%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 14-22
Gender Female, 83.1%
Calm 75.3%
Sad 6.9%
Fear 6.5%
Happy 4.9%
Confused 2.1%
Angry 1.7%
Disgusted 1.4%
Surprised 1.3%

AWS Rekognition

Age 12-20
Gender Male, 95.6%
Calm 82%
Disgusted 6.2%
Sad 4.6%
Confused 3%
Angry 1.4%
Fear 1.1%
Surprised 1.1%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Male, 75.1%
Calm 66.8%
Sad 28.5%
Confused 1.9%
Angry 0.9%
Disgusted 0.7%
Happy 0.7%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 34-42
Gender Female, 73%
Calm 98.2%
Sad 0.7%
Happy 0.6%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 68.4%
Calm 98%
Happy 0.8%
Sad 0.4%
Confused 0.4%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 16-22
Gender Female, 50%
Calm 76.8%
Fear 8.5%
Sad 4.9%
Confused 3.4%
Disgusted 2.4%
Angry 1.7%
Happy 1.6%
Surprised 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Poster 59%

Captions

Microsoft

a group of people standing in front of a crowd 91.6%
a group of people standing in front of a building 91.5%
a group of people standing in front of a crowd of people 90.4%

Text analysis

Amazon

EE
KODAKSVLELA

Google

YT37A2 XAGOX 13425
XAGOX
13425
YT37A2