Human Generated Data

Title

Untitled (middle-aged man and younger woman dancing and chatting on dance floor)
Date

1935-1955
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10222

Human Generated Data

Title

Untitled (middle-aged man and younger woman dancing and chatting on dance floor)

People

Artist: Martin Schweig, American 20th century

Date

1935-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.1
Apparel 99.1
Human 99.1
Person 99.1
Person 98.9
Person 96.8
Gown 86.5
Wedding 86.5
Robe 86.5
Fashion 86.5
Wedding Gown 86.5
Female 86
Evening Dress 84.9
Painting 71.9
Art 71.9
People 71.5
Woman 70.7
Person 70.3
Person 63.1
Dress 62.8
Girl 62.4
Face 59.9
Crowd 56.3
Bar Counter 56
Pub 56

Imagga
created on 2022-01-22

groom 77
bride 70.1
dress 66
wedding 63.5
love 48.2
dancer 43.6
person 40.1
bouquet 39.6
married 37.4
happiness 35.3
marriage 34.2
couple 33.1
adult 32.7
fashion 32.4
gown 32.2
performer 31.1
veil 28.4
teacher 25.5
attractive 25.2
people 25.1
happy 24.5
bridal 24.3
romance 24.1
flowers 23.5
entertainer 22.8
wife 22.8
portrait 22.7
flower 21.5
educator 21
celebration 20.8
hair 19.8
model 19.5
elegance 19.3
engagement 18.3
smile 17.8
wed 17.7
women 17.4
day 17.3
two 17
romantic 16.9
human 16.5
ceremony 16.5
face 16.3
style 16.3
clothing 15.5
professional 15.1
lady 14.6
sensuality 14.5
gorgeous 14.5
sexy 14.5
man 14.1
clothes 14.1
pretty 14
cheerful 13.8
cute 13.6
male 13.5
posing 13.3
event 13
newlywed 12.8
husband 12.7
life 12.6
commitment 11.8
smiling 11.6
dinner dress 11.5
blond 11.5
studio 11.4
hand 11.4
together 11.4
outdoors 11.2
dance 11
matrimony 10.8
skirt 10.4
passion 10.3
luxury 10.3
future 10.2
holiday 10
joy 10
holding 9.9
marry 9.8
charm 9.8
fun 9.7
necklace 9.7
hope 9.6
black 9.6
traditional 9.2
make 9.1
interior 8.9
tenderness 8.8
femininity 8.7
formal 8.6
rose 8.4
outdoor 8.4
feminine 8.4
summer 8.4
long 8.3
one 8.2
world 8.1
looking 8
engaged 7.9
nuptials 7.9
wall 7.7
hairstyle 7.6
charming 7.6
costume 7.5
art 7.3
pose 7.3
lifestyle 7.2
suit 7.2
family 7.1

Google
created on 2022-01-22

Coat 93.2
Picture frame 90.3
Suit 85.6
Gesture 85.3
Style 83.8
Black-and-white 82.5
Dance 80.8
Flash photography 80.5
One-piece garment 79.5
Smile 79.4
Formal wear 78.2
Gown 78
Vintage clothing 76.4
Art 75
Event 74.4
Happy 74.3
Monochrome photography 72.7
Room 71.1
Monochrome 68
Entertainment 63.7

Microsoft
created on 2022-01-22

person 99.4
dress 98.4
dance 98
text 96.8
wall 95.1
indoor 93.6
wedding dress 92.8
standing 92.2
clothing 85.7
bride 85.3
woman 84.1
posing 80.2
old 50.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 76.4%
Calm 99.9%
Angry 0%
Fear 0%
Surprised 0%
Sad 0%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 28-38
Gender Male, 98.7%
Calm 47.9%
Angry 25.8%
Happy 16.1%
Sad 5%
Disgusted 3%
Surprised 1%
Fear 0.8%
Confused 0.4%

AWS Rekognition

Age 18-26
Gender Male, 71.4%
Calm 100%
Angry 0%
Disgusted 0%
Surprised 0%
Sad 0%
Happy 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 58.8%
Calm 87.6%
Fear 7.9%
Sad 1.3%
Surprised 1.2%
Angry 0.8%
Disgusted 0.6%
Happy 0.3%
Confused 0.3%

AWS Rekognition

Age 35-43
Gender Female, 53.7%
Calm 92.1%
Sad 4.2%
Disgusted 1%
Happy 0.9%
Angry 0.6%
Fear 0.4%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Female, 56.8%
Calm 97%
Sad 1.3%
Happy 0.5%
Fear 0.4%
Disgusted 0.3%
Angry 0.2%
Confused 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Wedding Gown 86.5%
Painting 71.9%

Captions

Microsoft

a vintage photo of a man and a woman posing for a picture 83.7%
a vintage photo of a man and woman posing for a picture 80.7%
a vintage photo of a man and a woman posing for the camera 78.7%

Text analysis

Amazon

PROOF
SAINT
SAINT LOUIS
LOUIS
MARTIN
MARTIN SCHWEIG
SCHWEIG

Google

MARTIN
SCHWEIG
ut)
PROOF
SAINT
LOUIS
ut) PROOF MARTIN SCHWEIG SAINT LOUIS