Human Generated Data

Title

Untitled (group portrait of men and women in regalia)
Date

c. 1950
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13324

Human Generated Data

Title

Untitled (group portrait of men and women in regalia)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Suit 98.7
Overcoat 98.7
Coat 98.7
Human 98.1
Person 97.8
Person 97.2
Gown 97.1
Fashion 97.1
Robe 97.1
Person 96.7
Person 95.7
Wedding 95.6
Person 95.3
Person 95.1
Dress 94.9
Person 94.7
Person 94.1
Female 93.7
Person 93.6
Person 93.5
Bride 92.3
Wedding Gown 92.3
Person 91.5
Person 90.8
Tuxedo 90.4
Person 90.3
Person 90.3
Person 89.2
Bridegroom 86.5
Person 83.4
Woman 79.9
Face 78.6
People 73.3
Evening Dress 71.4
Person 71.1
Portrait 65.4
Photography 65.4
Photo 65.4
Plant 60.9
Girl 55.9

Imagga
created on 2022-01-22

groom 69.1
couple 40.9
bride 40.6
dress 38.8
wedding 35.9
people 33.5
love 30.8
married 27.8
bouquet 26.6
man 25.5
adult 25
person 24.1
happiness 23.5
marriage 22.8
happy 22.5
male 22
singer 21.1
two 20.3
gown 19.6
musician 17.7
together 16.6
performer 16.2
family 16
wind instrument 15.9
brass 15.8
women 15.8
bridal 15.6
attractive 15.4
flowers 14.8
kin 14.6
fashion 14.3
smile 14.2
wife 14.2
men 13.7
musical instrument 13.7
romantic 13.4
flower 13.1
wed 12.8
celebration 12.8
veil 12.7
professional 12.7
ceremony 12.6
portrait 12.3
husband 11.8
suit 11.8
elegance 11.7
outfit 11.7
romance 11.6
life 11.4
group 11.3
human 11.2
outdoors 11.2
nurse 10.9
smiling 10.8
new 10.5
pretty 10.5
entertainer 10.5
standing 10.4
cornet 10.4
day 10.2
holding 9.9
commitment 9.8
cheerful 9.7
summer 9.6
holiday 9.3
attendant 9.2
outdoor 9.2
pose 9.1
style 8.9
room 8.8
home 8.8
engagement 8.7
black 8.7
pair 8.5
teacher 8.4
church 8.3
lady 8.1
lifestyle 7.9
hair 7.9
hands 7.8
model 7.8
party 7.7
dance 7.7
loving 7.6
joy 7.5
future 7.4
tradition 7.4
business 7.3
activity 7.2
interior 7.1
businessman 7.1
indoors 7

Google
created on 2022-01-22

Dress 93
Wedding dress 92.1
Coat 90.2
Bride 87.3
Suit 82.3
Formal wear 78.1
Happy 77.8
Vintage clothing 75.3
Gown 74.9
Event 74.2
Classic 71.7
One-piece garment 71.5
Stock photography 64.7
Room 63.1
Monochrome photography 62.5
History 59.1
Photo caption 57.8
Ceremony 57.2
Flash photography 56.5
Retro style 56

Microsoft
created on 2022-01-22

posing 99.9
wall 99.8
person 98.8
standing 96.7
text 96.4
wedding dress 95.1
dress 95.1
old 94.4
bride 92.6
suit 90.8
woman 89.7
clothing 89.3
group 82.1
smile 76.6
white 73.9
black 72.9
wedding 69
people 59.9
man 55.2
vintage 41.7
clothes 41.5
dressed 37.1
team 25.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 49.4%
Calm 27.8%
Surprised 8.2%
Angry 5%
Sad 4.2%
Fear 2%
Disgusted 1.9%
Confused 1.5%

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 75.8%
Happy 8.9%
Surprised 6.3%
Fear 2.9%
Angry 2.2%
Confused 1.6%
Sad 1.4%
Disgusted 0.9%

AWS Rekognition

Age 68-78
Gender Female, 99.3%
Calm 97.6%
Happy 0.7%
Confused 0.4%
Surprised 0.4%
Angry 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 99.3%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Calm 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 49-57
Gender Female, 100%
Happy 98.5%
Calm 0.7%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 40-48
Gender Female, 100%
Happy 95.9%
Surprised 2.1%
Angry 0.6%
Fear 0.4%
Calm 0.4%
Sad 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 66-76
Gender Male, 99.2%
Calm 82.1%
Angry 6.1%
Happy 3.5%
Confused 2.7%
Disgusted 1.8%
Surprised 1.6%
Sad 1.3%
Fear 0.8%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Calm 99.3%
Surprised 0.5%
Angry 0.1%
Happy 0.1%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Female, 93.8%
Calm 87.7%
Happy 9.2%
Surprised 0.9%
Sad 0.5%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 96.3%
Angry 1.6%
Happy 0.7%
Confused 0.6%
Sad 0.4%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 95.5%
Surprised 1.5%
Sad 1.3%
Confused 0.7%
Angry 0.6%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Female, 99.5%
Calm 95.9%
Confused 1.1%
Surprised 0.8%
Happy 0.8%
Angry 0.5%
Sad 0.5%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 98%
Confused 1%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%
Sad 0.1%

AWS Rekognition

Age 58-66
Gender Male, 100%
Angry 39.3%
Happy 36.8%
Calm 14.5%
Fear 3.3%
Surprised 2.2%
Sad 1.9%
Confused 1.4%
Disgusted 0.6%

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 99.2%
Surprised 0.3%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 57-65
Gender Male, 99.8%
Calm 100%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Happy 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Female, 100%
Calm 70.6%
Happy 17.4%
Surprised 4.3%
Confused 2.3%
Angry 1.9%
Fear 1.4%
Disgusted 1.1%
Sad 1%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 98.2%
a vintage photo of a group of people posing for a picture 98.1%
a group of people posing for a photo 98%

Text analysis

Amazon

PROOF
BURIAN-MOSS PROOF
BURIAN-MOSS
G

Google

BURIAN-MOSS PROOF
BURIAN-MOSS
PROOF