Human Generated Data

Title

Untitled (minstrel show performance)
Date

January 14, 1950
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18059

Human Generated Data

Title

Untitled (minstrel show performance)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

January 14, 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Human 99.7
Person 99.7
Person 99.6
Person 99.4
Person 99.4
Person 99.3
Person 99.1
Person 99
Clothing 98.8
Apparel 98.8
Person 97.6
Person 97.6
Person 94.7
Person 93
Person 92.9
Person 85.7
Suit 84.6
Coat 84.6
Overcoat 84.6
Indoors 81.3
Room 81.3
Person 81
People 75
Evening Dress 72.3
Robe 72.3
Gown 72.3
Fashion 72.3
Female 71.7
Person 70.2
Person 68.2
Dress 68
Person 64.3
Skin 63.7
Person 60.2
Performer 60
Stage 59.6
Tuxedo 58.7
Wedding 58.4
Crowd 58.3
Pub 58
Face 55.5
Bar Counter 55.3

Imagga
created on 2022-03-04

marimba 40.2
balcony 37.2
percussion instrument 33.9
musical instrument 30.2
building 23.5
architecture 23.4
structure 19.5
people 18.4
house 17.5
old 17.4
city 15.8
home 13.5
wall 12.9
window 12.9
historic 12.8
travel 12.7
ancient 12.1
fence 12
women 11.9
interior 11.5
man 11.4
picket fence 11.4
light 11.3
urban 11.3
design 11.2
dress 10.8
life 10.7
style 10.4
business 10.3
shop 10.1
traditional 10
world 9.9
history 9.8
group 9.7
crowd 9.6
flowers 9.6
person 9.4
tourism 9.1
fashion 9
adult 8.9
facade 8.9
indoors 8.8
couple 8.7
men 8.6
art 8.5
male 8.5
store 8.5
stone 8.4
monument 8.4
famous 8.4
exterior 8.3
landmark 8.1
barrier 8.1
love 7.9
holiday 7.9
black 7.8
antique 7.8
scene 7.8
glass 7.8
portrait 7.8
luxury 7.7
chair 7.6
happy 7.5
column 7.4
classic 7.4
lifestyle 7.2
romantic 7.1
happiness 7

Google
created on 2022-03-04

Black-and-white 82.2
Font 78.1
Art 75.9
Picture frame 74.4
Event 73.7
Rectangle 71.3
Monochrome photography 70.6
Room 70.1
Monochrome 70.1
Vintage clothing 67.8
Stock photography 64
Team 62.6
History 62.1
Table 58.4
Photo caption 57.9
Formal wear 55.5
Uniform 55
Visual arts 54.1
Class 53
Pattern 52.5

Microsoft
created on 2022-03-04

clothing 95.9
text 92.7
person 88.9
wedding dress 85.8
woman 83.3
man 81.5
black and white 78.1
dress 77.2
bride 70.4
group 57.8
posing 48.1
line 21.8

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 60.9%
Sad 41.2%
Calm 37.9%
Happy 8%
Angry 5.1%
Fear 2.7%
Confused 2.1%
Surprised 1.7%
Disgusted 1.3%

AWS Rekognition

Age 34-42
Gender Female, 79.6%
Happy 67%
Calm 23.6%
Sad 5.2%
Surprised 1.6%
Fear 0.9%
Confused 0.7%
Disgusted 0.6%
Angry 0.4%

AWS Rekognition

Age 33-41
Gender Male, 51.1%
Calm 51%
Sad 20.7%
Happy 11.2%
Disgusted 9%
Angry 2.9%
Surprised 2.8%
Confused 1.7%
Fear 0.8%

AWS Rekognition

Age 20-28
Gender Male, 55.6%
Calm 94.3%
Sad 1.8%
Happy 1.2%
Disgusted 0.8%
Fear 0.7%
Angry 0.7%
Confused 0.4%
Surprised 0.1%

AWS Rekognition

Age 14-22
Gender Male, 87%
Calm 37.6%
Confused 30.4%
Sad 26.8%
Surprised 1.5%
Disgusted 1.5%
Fear 0.9%
Angry 0.9%
Happy 0.3%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 32.3%
Sad 26.9%
Happy 21.5%
Surprised 10.4%
Confused 4.2%
Disgusted 1.6%
Angry 1.6%
Fear 1.5%

AWS Rekognition

Age 26-36
Gender Female, 71.6%
Sad 41.3%
Happy 29.9%
Calm 15.3%
Angry 6.4%
Disgusted 3.1%
Confused 1.7%
Surprised 1.6%
Fear 0.8%

AWS Rekognition

Age 28-38
Gender Male, 63.9%
Calm 98.3%
Sad 1.1%
Surprised 0.2%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 34-42
Gender Male, 95.2%
Sad 96.2%
Calm 2.8%
Happy 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.1%
Calm 71.8%
Happy 15.4%
Sad 8.1%
Angry 1.8%
Confused 1.1%
Fear 0.8%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 97.7%
Disgusted 98.3%
Sad 1.3%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0%
Calm 0%
Happy 0%

AWS Rekognition

Age 37-45
Gender Female, 65.1%
Calm 83.8%
Sad 6.8%
Angry 2.9%
Confused 2.1%
Disgusted 1.6%
Happy 1%
Fear 0.9%
Surprised 0.9%

AWS Rekognition

Age 48-54
Gender Female, 55.8%
Confused 55%
Disgusted 27%
Sad 13.5%
Angry 1.2%
Calm 1.1%
Happy 1%
Surprised 0.8%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Female, 52.2%
Sad 60.6%
Calm 10.2%
Confused 9.6%
Angry 6.3%
Disgusted 5.7%
Surprised 4.4%
Fear 1.9%
Happy 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 88.2%
a group of people posing for a photo in front of a window 83.8%
a group of people standing in front of a window 83.3%

Text analysis

Amazon

93
KODVKSVEELX