Human Generated Data

Title

Untitled (Mr. and Mrs. Leicester Faust)
Date

1920s
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.854

Human Generated Data

Title

Untitled (Mr. and Mrs. Leicester Faust)

People

Artist: Martin Schweig, American 20th century

Date

1920s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Person 99.1
Human 99.1
Person 99.1
Person 98.1
Person 97.9
Person 97.7
Person 97.7
Person 97.6
Robe 97.5
Fashion 97.5
Person 97.4
Wedding 97.1
Person 96.8
Person 96.2
Person 96.1
Person 96
Gown 95.8
Bride 94
Person 93.7
Bridesmaid 90.4
Wedding Gown 77.2
Tie 75.5
Accessories 75.5
Accessory 75.5
Tie 69

Imagga
created on 2022-01-08

kin 100
bride 43.8
wedding 37.7
groom 36.9
dress 36.1
attendant 31.4
love 30
couple 28.8
bouquet 24.5
happiness 21.9
statue 21.2
married 21.1
art 19.2
marriage 19
people 18.4
sculpture 18.3
portrait 18.1
flowers 17.4
happy 16.9
gown 16.7
veil 16.7
bridal 16.5
old 16
wed 15.7
religion 15.2
celebration 15.2
fashion 15.1
face 14.9
church 14.8
man 14.8
two 14.4
adult 13.8
culture 13.7
person 13.6
traditional 13.3
monument 13.1
ceremony 12.6
history 12.5
wife 12.3
detail 12.1
romantic 11.6
flower 11.5
male 11.4
ancient 11.2
day 11
stone 11
husband 10.9
marble 10.7
attractive 10.5
outdoors 10.5
romance 9.8
family 9.8
together 9.6
look 9.6
women 9.5
historical 9.4
smile 9.3
travel 9.2
costume 9.1
tourism 9.1
lady 8.9
commitment 8.9
antique 8.8
catholic 8.8
decoration 8.7
engagement 8.7
god 8.6
religious 8.4
elegance 8.4
park 8.2
closeup 8.1
matrimony 7.9
architecture 7.8
party 7.7
summer 7.7
holy 7.7
loving 7.6
head 7.6
decorative 7.5
city 7.5
style 7.4
tradition 7.4
historic 7.3
girls 7.3
smiling 7.2
color 7.2
life 7

Google
created on 2022-01-08

Wedding dress 94.9
Dress 91.6
Bride 89.3
Bridal clothing 87
Bridal party dress 86.5
Suit 83.7
Gown 83
Headgear 81.8
Happy 79.4
Sleeve 77.8
Formal wear 77.6
Bridal accessory 77
Vintage clothing 75.6
One-piece garment 75.3
Beauty 75.2
Classic 74.9
Event 74
Headpiece 71.1
Wedding 69
Wedding ceremony supply 67.1

Microsoft
created on 2022-01-08

person 98.8
wedding dress 97.5
bride 95.6
dress 93.5
group 90.1
posing 88.8
woman 86.2
clothing 82.8
wedding 79.5
text 77.1
white 64.2
old 62.6
team 29.2
clothes 15.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 85.6%
Calm 98.5%
Confused 1.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 99.9%
Happy 0%
Confused 0%
Surprised 0%
Fear 0%
Angry 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 91.4%
Happy 4%
Confused 1.6%
Angry 1%
Surprised 0.7%
Disgusted 0.6%
Fear 0.4%
Sad 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 97.7%
Confused 0.7%
Surprised 0.6%
Angry 0.3%
Happy 0.3%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Male, 99.3%
Happy 96.2%
Calm 1.1%
Sad 0.8%
Confused 0.6%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 95.9%
Angry 1.9%
Confused 0.8%
Surprised 0.8%
Happy 0.3%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 94%
Sad 2.8%
Fear 1.8%
Angry 0.7%
Happy 0.2%
Surprised 0.2%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 82.9%
Calm 99.4%
Confused 0.3%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 57.8%
Confused 19.1%
Disgusted 16%
Surprised 3%
Sad 1.7%
Fear 1%
Happy 0.8%
Angry 0.7%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Calm 90.1%
Confused 4.7%
Fear 4%
Sad 0.4%
Surprised 0.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Female, 99.8%
Confused 96.3%
Calm 3.5%
Surprised 0%
Fear 0%
Sad 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 97.8%
Confused 1.2%
Happy 0.5%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 95.8%
Calm 99.6%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 91.4%
Calm 96%
Happy 1.3%
Confused 0.6%
Surprised 0.5%
Disgusted 0.5%
Angry 0.4%
Sad 0.4%
Fear 0.3%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Wedding Gown 77.2%
Tie 75.5%

Captions

Microsoft

Ludwig Barnay, Freya Stark posing for a photo 97.1%
Ludwig Barnay, Freya Stark posing for the camera 97%
Ludwig Barnay, Freya Stark posing for a picture 96.9%