Human Generated Data

Title

Untitled (wedding party)
Date

1920s
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.835

Human Generated Data

Title

Untitled (wedding party)

People

Artist: Martin Schweig, American 20th century

Date

1920s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Person 99.4
Human 99.4
Person 99.3
Person 99.2
Person 98.9
Person 98.9
Robe 96.8
Fashion 96.8
Wedding 96.2
Gown 94.6
Person 94.6
Person 91.9
Person 91.5
Person 90.9
Person 90.4
Bride 89
Person 88.3
Person 85.9
Painting 85.2
Art 85.2
Person 83.4
Person 73.3
Bridesmaid 62.6
Wedding Gown 50.3
Person 42.8

Imagga
created on 2022-01-08

afghan hound 47.2
hound 37.6
groom 30.4
gravestone 30.2
hunting dog 29.9
stone 27.3
bride 26.8
memorial 26.8
dress 25.3
kin 23.2
wedding 23
dog 19.4
people 18.4
love 17.3
couple 16.5
structure 16.4
marriage 16.1
cemetery 15.7
married 15.3
old 14.6
happiness 14.1
group 12.9
gown 12.7
bridal 12.6
happy 12.5
tourism 12.4
person 12.2
ancient 12.1
outdoors 11.9
park 11.5
black 11.4
bouquet 11.3
fashion 11.3
travel 11.3
art 10.8
man 10.7
statue 10.6
antique 10.5
rock 10.4
sky 10.2
two 10.2
male 9.9
domestic animal 9.9
history 9.8
wed 9.8
adult 9.7
canine 9.7
landscape 9.7
girls 9.1
column 8.9
lady 8.9
veil 8.8
marble 8.7
sculpture 8.6
wife 8.5
outdoor 8.4
summer 8.4
halibut 8.1
women 7.9
holiday 7.9
architecture 7.8
portrait 7.8
ceremony 7.8
attractive 7.7
culture 7.7
style 7.4
celebration 7.2
life 7.1
romantic 7.1
grass 7.1
day 7.1

Google
created on 2022-01-08

Wedding dress 94.4
Dress 90.7
Bridal clothing 87.5
Happy 83.5
Gown 83.2
Plant 82.2
Bride 81.9
Bridal party dress 80.4
One-piece garment 77.9
Formal wear 77.3
Vintage clothing 77
Tints and shades 76.9
Bridal accessory 73
Event 72.9
Rectangle 71.3
Suit 69.4
Room 68.1
Classic 67.6
A-line 66.5
Plantation 66.2

Microsoft
created on 2022-01-08

wedding dress 99.4
bride 98.9
wedding 95.9
dress 94.9
text 83
woman 70.4
white 62

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 97.9%
Calm 97.1%
Happy 2.6%
Sad 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 95.8%
Calm 98.6%
Happy 0.5%
Confused 0.3%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 99.7%
Happy 0.1%
Confused 0.1%
Sad 0.1%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 99.9%
Sad 0%
Surprised 0%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 99.3%
Happy 0.3%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Happy 99.8%
Calm 0.1%
Surprised 0%
Confused 0%
Fear 0%
Angry 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Happy 75.1%
Calm 22.3%
Confused 0.7%
Surprised 0.6%
Sad 0.4%
Angry 0.3%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 38-46
Gender Female, 99.4%
Happy 97.8%
Calm 0.7%
Surprised 0.4%
Confused 0.3%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Sad 0.2%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 75%
Sad 18.7%
Happy 3.3%
Angry 1%
Confused 0.8%
Fear 0.5%
Surprised 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 99.8%
Happy 0%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 99.4%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Female, 99.8%
Calm 76.5%
Confused 21.5%
Angry 0.6%
Happy 0.4%
Surprised 0.4%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Male, 93.7%
Calm 96.7%
Happy 0.9%
Confused 0.7%
Sad 0.6%
Surprised 0.5%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 99.3%
Happy 99.1%
Calm 0.4%
Confused 0.1%
Sad 0.1%
Fear 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 85.2%
Wedding Gown 50.3%

Captions

Microsoft

a group of people posing for a photo 84.1%
a group of people posing for a picture 84%
a group of people posing for the camera 83.9%

Text analysis

Amazon

SCHWEIG
ST.LOUIS

Google

SCHWEIG ST. LOUIS
SCHWEIG
ST.
LOUIS