Human Generated Data

Title

Untitled (young copule in formal wear)

Date

c. 1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1414

Human Generated Data

Title

Untitled (young copule in formal wear)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Accessories 100
Tie 100
Accessory 100
Clothing 99.9
Apparel 99.9
Person 98.4
Human 98.4
Plant 97.6
Person 96.1
Blossom 91.4
Flower 91.4
Fashion 90.1
Gown 90.1
Suit 89.6
Overcoat 89.6
Coat 89.6
Robe 89.4
Flower Arrangement 88.6
Flower Bouquet 88.6
Wedding 87.1
Wedding Gown 75.6
Tuxedo 74.3
Face 67.6
Evening Dress 64.1
Bride 63.6
Portrait 62.6
Photography 62.6
Photo 62.6
Female 60.1
Bridegroom 56.1

Imagga
created on 2022-01-22

bow tie 100
necktie 100
garment 55.5
couple 42.7
bride 42.2
groom 41
love 37.9
wedding 37.7
clothing 33.5
happy 33.2
dress 32.6
people 31.8
portrait 29.1
man 28.9
happiness 27.4
married 26.9
marriage 25.7
two 25.4
smile 25
adult 24.7
bouquet 24.5
person 24.5
smiling 23.2
male 22.1
attractive 18.9
flowers 18.3
romance 17.9
together 17.5
men 17.2
wife 17.1
family 16.9
bridal 16.5
lady 16.2
mature 15.8
husband 15.5
celebration 15.2
senior 15
face 14.9
gown 14.7
old 14.6
home 14.4
romantic 14.3
day 14.1
women 13.5
pair 13.2
relationship 13.1
fashion 12.8
veil 12.7
cheerful 12.2
human 12
outdoors 12
pretty 11.9
engagement 11.6
lifestyle 11.6
holding 11.6
elderly 11.5
mother 10.8
flower 10.8
tradition 10.2
holiday 10
traditional 10
bridegroom 9.9
daughter 9.8
affectionate 9.7
sexy 9.6
loving 9.5
hair 9.5
rose 9.4
joy 9.2
pose 9.1
aged 9.1
summer 9
tuxedo 8.9
wed 8.8
grandmother 8.8
ceremony 8.7
brunette 8.7
affection 8.7
tie 8.5
elegance 8.4
suit 8.1
waiter 8
child 8
interior 8
romanticism 7.9
look 7.9
standing 7.8
hope 7.7
tender 7.7
laugh 7.7
youth 7.7
grandma 7.6
employee 7.6
20s 7.3
book 7.3
new 7.3
black 7.2
cute 7.2
life 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 99.5
posing 97.8
flower 97.1
clothing 93
text 91.6
wedding dress 90.5
bride 89.5
smile 84.6
human face 82.7
woman 81.4
dress 77.3
standing 76.8
wedding 69.4
old 67.9
necktie 23.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Happy 99.1%
Surprised 0.3%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 82.8%
Happy 10.8%
Surprised 3%
Angry 1.2%
Confused 0.8%
Sad 0.7%
Fear 0.5%
Disgusted 0.4%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Person 98.4%

Captions

Microsoft

a man and a woman posing for a photo 96.8%
a man and woman standing in front of a mirror posing for the camera 87.9%
a person standing in front of a mirror posing for the camera 87.8%

Text analysis

Amazon

AND
OF
THE
WITHIN
PBOOF
THIS
THIS PBOOF IS THE
IS
SHOULD
DAYS
WITHIN EN DAYS
EN
OF THE SCIWEIR
AND SHOULD any
SCIWEIR
any

Google

THIS PBOOF IS THE R OF THE SCH AND SHOULD WITHIN TEN D VS
SCH
D
VS
THIS
SHOULD
PBOOF
IS
OF
R
AND
TEN
THE
WITHIN