Human Generated Data

Title

Untitled (man and woman with minstrel performer in blackface)

Date

1955, negative made later

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19733

Human Generated Data

Title

Untitled (man and woman with minstrel performer in blackface)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1955, negative made later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 100
Apparel 100
Dress 99.4
Person 99.3
Human 99.3
Person 98
Suit 97.8
Coat 97.8
Overcoat 97.8
Person 96.7
Female 93.8
Sleeve 91
Person 90.8
Long Sleeve 88.3
Tuxedo 87.3
Face 83.5
Flag 79.9
Symbol 79.9
Woman 79.7
Hat 73.1
Tie 73
Accessory 73
Accessories 73
Portrait 70
Photo 70
Photography 70
Stage 69.1
Costume 69
Shirt 66
Performer 65.4
Girl 62.7
People 60.3
Door 57.7
Fashion 57.5
Robe 57.5
Evening Dress 57.5
Gown 57.5
Furniture 56.9
Chair 56.9
Skirt 56.9
Sailor Suit 55.6

Imagga
created on 2022-03-05

person 31.4
people 30.1
adult 27.5
nurse 25.8
professional 24.3
clothing 23.7
teacher 22.2
man 22.2
happy 19.4
male 18.4
couple 18.3
dress 17.2
educator 16.7
gown 16.5
bride 16.3
portrait 16.2
medical 15.9
happiness 15.7
uniform 15.7
patient 15.5
health 15.3
women 15
smile 15
wedding 14.7
two 14.4
doctor 13.2
groom 13.1
hospital 12.9
costume 12.7
love 12.6
family 12.5
senior 12.2
coat 11.5
bouquet 11.3
lab coat 11.3
clothes 11.2
worker 10.6
medicine 10.6
indoors 10.5
married 10.5
human 10.5
old 10.4
standing 10.4
vestment 10.3
work 10.2
church 10.2
full length 9.7
together 9.6
day 9.4
life 9.3
room 9.2
traditional 9.1
pretty 9.1
attractive 9.1
lady 8.9
romantic 8.9
looking 8.8
ceremony 8.7
smiling 8.7
profession 8.6
men 8.6
ethnic 8.6
garment 8.6
adults 8.5
elegance 8.4
tradition 8.3
fashion 8.3
occupation 8.2
religion 8.1
handsome 8
celebration 8
business 7.9
holiday 7.9
wed 7.9
flowers 7.8
student 7.8
corporate 7.7
culture 7.7
child 7.7
suit 7.6
marriage 7.6
catholic 7.5
care 7.4
lifestyle 7.2
surgeon 7.2
bright 7.1
hair 7.1
cool 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 98.1
dress 95.9
person 88.6
clothing 85.1
footwear 80.9
standing 80.2
woman 79.1
posing 70.5
black 65.4
black and white 63.9
old 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.1%
Calm 98.9%
Happy 0.7%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 45-51
Gender Male, 97.8%
Happy 58.7%
Surprised 35.3%
Confused 2.7%
Sad 0.9%
Disgusted 0.8%
Calm 0.7%
Fear 0.7%
Angry 0.3%

AWS Rekognition

Age 53-61
Gender Male, 97.9%
Happy 80.1%
Sad 7.6%
Fear 4.5%
Angry 2.3%
Surprised 2.1%
Confused 1.4%
Calm 1.2%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 73.1%
Tie 73%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.4%
a vintage photo of a group of people posing for a picture 93.3%
a group of people posing for a photo 93.2%

Text analysis

Amazon

UNITED
THE
THE UNITED STATE
TOCK
STATE
PURINE RYSEANCH FARM TOCK
PURINE
RYSEANCH
FARM
MJI7--YT37A°--X

Google

UNITED
M R--YT3RA°2- -XAGON UNITED
M
R--YT3RA°2-
-XAGON