Human Generated Data

Title

Untitled (group portrait of wedding party posed in room with columns and oriental rug)

Date

1949

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9275

Human Generated Data

Title

Untitled (group portrait of wedding party posed in room with columns and oriental rug)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.8
Person 98.8
Person 97.9
Person 94.4
People 94
Person 94
Person 93.2
Person 92.7
Person 92
Person 90.6
Person 88.9
Person 88.8
Art 88.8
Painting 88.8
Person 88.3
Person 84.2
Person 82.5
Person 79.2
Person 77.9
Person 75.3
Gown 73.9
Clothing 73.9
Wedding 73.9
Wedding Gown 73.9
Fashion 73.9
Robe 73.9
Apparel 73.9
Person 73.8
Person 70.4
Family 61.5
Jury 59.9
Toy 59.3
Hula 55.5

Imagga
created on 2022-01-23

brass 44
wind instrument 41.4
musical instrument 32.8
wedding 25.7
dress 25.3
bride 23.9
groom 22.7
cornet 21.8
love 20.5
people 18.9
celebration 18.3
couple 18.3
married 17.2
bouquet 17
two 15.2
life 15.1
adult 15
women 15
portrait 14.9
man 14.8
gown 14.7
marriage 14.2
happiness 13.3
bridal 12.6
flower 12.3
face 12.1
fashion 12
person 12
men 12
decoration 11.8
day 11.7
veil 11.7
ceremony 11.6
party 11.2
church 11.1
happy 10.6
art 10.6
old 10.4
outdoors 10.4
flowers 10.4
boutique 10.4
traditional 10
wed 9.8
romantic 9.8
human 9.7
wife 9.5
elegance 9.2
male 9.2
black 9
religion 8.9
interior 8.8
scene 8.6
holiday 8.6
husband 8.6
clothes 8.4
summer 8.3
city 8.3
outfit 8.1
history 8
romance 8
afghan hound 7.9
together 7.9
luxury 7.7
trombone 7.6
building 7.5
future 7.4
tradition 7.4
detail 7.2
color 7.2
activity 7.2
statue 7.1
clothing 7.1
hair 7.1
smile 7.1
family 7.1
world 7
sky 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

wedding dress 99.2
bride 98.1
dress 96.7
woman 86.9
wedding 85.7
standing 85.2
clothing 82.4
person 79.7
group 76.7
text 67.4
posing 59.3
old 47.1

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 99.3%
Calm 95.8%
Happy 1.1%
Sad 0.8%
Confused 0.8%
Surprised 0.7%
Disgusted 0.5%
Angry 0.2%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Sad 80.1%
Angry 5.8%
Happy 5.5%
Calm 3.5%
Surprised 1.8%
Fear 1.3%
Disgusted 1.1%
Confused 0.9%

AWS Rekognition

Age 39-47
Gender Male, 98.2%
Calm 46.3%
Happy 45.1%
Sad 2.6%
Confused 1.8%
Disgusted 1.7%
Surprised 1.6%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 96.7%
Sad 64.6%
Surprised 13.2%
Happy 8.3%
Calm 5.1%
Fear 3.3%
Angry 2%
Disgusted 1.9%
Confused 1.6%

AWS Rekognition

Age 41-49
Gender Male, 68.1%
Happy 58.4%
Calm 28%
Sad 10.1%
Disgusted 1.1%
Confused 0.7%
Surprised 0.6%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Male, 98.2%
Confused 35.9%
Sad 35%
Calm 8.6%
Happy 7.7%
Surprised 4.6%
Fear 3.1%
Disgusted 2.9%
Angry 2.2%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 33.2%
Sad 24.5%
Happy 17.5%
Surprised 12.1%
Angry 5.8%
Confused 3.5%
Disgusted 1.7%
Fear 1.6%

AWS Rekognition

Age 36-44
Gender Male, 77.4%
Sad 45%
Happy 19.8%
Disgusted 17.8%
Calm 9.1%
Confused 3.6%
Angry 2.1%
Surprised 2.1%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Female, 91.8%
Happy 59.7%
Calm 28.3%
Sad 5.1%
Confused 2.5%
Fear 1.3%
Surprised 1.2%
Angry 1.1%
Disgusted 0.9%

AWS Rekognition

Age 27-37
Gender Male, 87%
Calm 84.3%
Sad 6.2%
Surprised 3.5%
Happy 2.9%
Confused 1.1%
Angry 0.8%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 36-44
Gender Male, 87.3%
Calm 51.6%
Surprised 21.4%
Happy 12.3%
Sad 5.5%
Confused 4%
Disgusted 2.3%
Fear 1.8%
Angry 1.1%

AWS Rekognition

Age 38-46
Gender Male, 87.5%
Calm 63.1%
Happy 15.2%
Sad 9.4%
Confused 4.6%
Angry 3.4%
Disgusted 2.7%
Surprised 1.2%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 62.9%
Happy 43.3%
Sad 31.7%
Calm 19.3%
Confused 1.9%
Surprised 1.1%
Angry 1%
Fear 1%
Disgusted 0.8%

AWS Rekognition

Age 26-36
Gender Male, 51.2%
Happy 62.6%
Surprised 16.3%
Calm 7.8%
Confused 5.5%
Sad 3.5%
Disgusted 2.8%
Angry 1%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Female, 99.8%
Happy 98.5%
Surprised 1%
Calm 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 99.1%
Sad 51.5%
Happy 23.6%
Calm 17.1%
Confused 3.7%
Angry 1.3%
Surprised 1.2%
Disgusted 1%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 88.8%
Wedding Gown 73.9%

Captions

Microsoft

a group of people standing in front of a window 87.5%
a group of people standing in front of a building 87.4%
a group of people standing in a room 87.3%

Text analysis

Amazon

KODVK-SVEEL