Human Generated Data

Title

Untitled (wedding group portrait)
Date

1930s
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.865

Human Generated Data

Title

Untitled (wedding group portrait)

People

Artist: Martin Schweig, American 20th century

Date

1930s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.9
Apparel 99.9
Person 99.2
Human 99.2
Person 98.7
Person 98.6
Person 98.3
Person 98.2
Person 97.9
Person 97.9
Person 97.7
Person 97.3
Person 97.1
Robe 96.7
Fashion 96.7
Person 96
Person 95.8
Gown 95.6
Person 95.1
Person 94.7
Person 94.1
Person 93
Wedding 92.4
Plant 91.9
Person 90.9
Person 90
Bride 85.2
Wedding Gown 85.2
Flower 83.4
Blossom 83.4
Flower Bouquet 81.6
Flower Arrangement 81.6
Person 78.4
Suit 76.1
Coat 76.1
Overcoat 76.1
Female 73.9
Evening Dress 64.7
Person 63.3
People 61.5
Woman 57.8
Photography 55.4
Photo 55.4

Imagga
created on 2022-01-08

groom 87
brass 72.4
wind instrument 56.2
bride 44.1
couple 43.5
wedding 40.4
dress 38.8
musical instrument 38.1
love 34.7
people 31.2
happy 27.5
married 26.8
happiness 26.6
man 26.2
marriage 25.6
kin 25.4
cornet 24.8
bouquet 24.6
two 23.7
adult 22.5
flowers 20
male 19.8
gown 19.5
person 18.5
wife 18
together 17.5
portrait 17.5
family 16.9
bridal 16.5
ceremony 16.5
fashion 15.8
smile 15.7
attractive 15.4
celebration 15.1
women 15
wed 14.7
veil 14.7
flower 14.6
romantic 14.2
smiling 13.7
husband 13.3
new 12.9
church 12.9
men 12.9
outdoors 12.7
elegance 12.6
day 12.5
romance 11.6
home 11.2
summer 10.9
cheerful 10.6
room 10
matrimony 9.8
commitment 9.8
holiday 9.3
mother 9.3
joy 9.2
outdoor 9.2
pose 9
park 9
old 9
suit 9
human 9
indoors 8.8
standing 8.7
hands 8.7
lifestyle 8.7
party 8.6
face 8.5
pair 8.5
black 8.4
hand 8.3
style 8.2
lady 8.1
life 8
posing 8
hair 7.9
brunette 7.8
engagement 7.7
pretty 7.7
formal 7.6
loving 7.6
holding 7.4
tradition 7.4
decoration 7.3
group 7.2
clothing 7.2
art 7.2
interior 7.1

Google
created on 2022-01-08

Wedding dress 93.5
Bride 92.2
Coat 89.8
Bridal clothing 89.2
Dress 89.2
Standing 86.4
Gown 85.5
Flash photography 84.7
Suit 83.6
Happy 83.5
Bridal party dress 82.9
Flower 80.8
Formal wear 78.4
Classic 77.6
Flower Arranging 77.6
Vintage clothing 76.8
Bridal accessory 75.8
Event 74.4
Bouquet 74
Wedding ceremony supply 73.3

Microsoft
created on 2022-01-08

person 98.8
posing 98.8
wedding dress 98.5
bride 97.3
group 96.8
wall 95.4
text 94.3
indoor 88.9
standing 88.6
clothing 88.4
dress 88.3
flower 87.5
woman 87.2
wedding 87.1
old 86.4
people 77.5
man 64.6
dressed 34.6
clothes 31.7
vintage 31.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Happy 98.5%
Calm 0.5%
Confused 0.5%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 96.6%
Calm 2%
Confused 0.3%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 99.7%
Confused 0.1%
Angry 0.1%
Happy 0%
Surprised 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 94.6%
Calm 89.8%
Happy 4%
Confused 2.2%
Surprised 1.6%
Angry 1.3%
Sad 0.4%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 99.4%
Happy 0.2%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Sad 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 16-22
Gender Male, 97.7%
Calm 89.7%
Confused 5.9%
Happy 1.4%
Angry 1.1%
Surprised 0.6%
Fear 0.5%
Sad 0.4%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 98.8%
Surprised 0.4%
Happy 0.3%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 87.6%
Angry 4.6%
Confused 2.1%
Surprised 1.6%
Happy 1.6%
Fear 0.9%
Sad 0.9%
Disgusted 0.6%

AWS Rekognition

Age 24-34
Gender Female, 76.2%
Happy 99%
Surprised 0.4%
Calm 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 75.8%
Happy 19.1%
Surprised 1.2%
Angry 1.1%
Confused 1%
Disgusted 0.6%
Fear 0.6%
Sad 0.5%

AWS Rekognition

Age 18-26
Gender Female, 57.1%
Calm 90.4%
Confused 4.7%
Angry 2.2%
Surprised 1%
Sad 0.8%
Happy 0.6%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Female, 94.9%
Calm 99.3%
Surprised 0.2%
Confused 0.2%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 16-22
Gender Female, 99.1%
Calm 99.1%
Confused 0.3%
Happy 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 98.6%
Happy 0.5%
Surprised 0.2%
Confused 0.2%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 96.3%
Happy 1.9%
Surprised 0.5%
Confused 0.4%
Angry 0.3%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%

AWS Rekognition

Age 34-42
Gender Female, 100%
Calm 99.6%
Surprised 0.1%
Confused 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Calm 95.2%
Confused 0.9%
Happy 0.9%
Disgusted 0.8%
Surprised 0.8%
Sad 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 98.3%
Angry 0.8%
Confused 0.7%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Suit 76.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 98.3%
a vintage photo of a group of people posing for a picture 98.2%
a group of people posing for a photo 98.1%

Text analysis

Amazon

SCHWEIG
ST.LOUIS.

Google

SCHWEIG ST. LOUIS
SCHWEIG
ST.
LOUIS