Human Generated Data

Title

Untitled (newlywed bride and groom kissing at reception as guests look on)

Date

1963

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9879

Human Generated Data

Title

Untitled (newlywed bride and groom kissing at reception as guests look on)

People

Artist: Martin Schweig, American 20th century

Date

1963

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9879

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 99.4
Person 98.8
Person 98.5
Person 98.4
Person 97.6
Dress 96
Person 95.4
Person 92.9
Person 90.5
Person 90.4
Female 88.2
Shoe 87.2
Footwear 87.2
Gown 86
Fashion 86
Robe 85
Person 83.1
Wedding 82.8
Person 82.3
People 77.1
Person 74.6
Crowd 70.8
Wedding Gown 70.8
Woman 70.6
Suit 69.3
Coat 69.3
Overcoat 69.3
Photography 66.8
Photo 66.8
Girl 65.7
Portrait 61.8
Face 61.8
Person 60.4
Bride 58.3
Party 57.2
Bridegroom 56.6
Indoors 56.5

Clarifai
created on 2023-10-27

people 99.9
group 99.6
dancing 99
child 98.7
woman 98
man 96.4
music 95.7
adult 95.3
education 95.3
group together 94.9
many 94.1
bridesmaid 93.4
wear 93.1
school 92.6
dancer 90.9
adolescent 90
teacher 90
elementary school 89.8
actress 87.9
several 87.4

Imagga
created on 2022-01-28

groom 48.5
couple 36.6
people 35.7
bride 33.6
wedding 31.3
adult 31.1
dress 29.8
man 29.6
male 28.4
teacher 26.9
love 26
happiness 25.8
happy 25.7
person 25.4
oboe 24
violin 23.1
married 23
bowed stringed instrument 22.7
musical instrument 21.7
men 21.5
marriage 20.9
stringed instrument 19.5
two 19.5
professional 19.2
educator 19.1
bouquet 18.9
wife 18
women 17.4
husband 17.3
family 16.9
businessman 16.8
wind instrument 16.2
suit 16.2
singer 16
group 15.3
business 15.2
celebration 15.1
together 14
modern 14
hands 13.9
musician 13.8
smiling 13.7
elegance 13.4
day 13.3
hand 12.9
corporate 12.9
ceremony 12.6
attractive 12.6
romantic 12.5
meeting 12.2
brass 11.7
bridal 11.7
romance 11.6
smile 11.4
new 11.3
pair 11.3
office 11.2
home 11.2
performer 11
lifestyle 10.8
gown 10.7
executive 10.7
fashion 10.5
indoors 10.5
life 10.5
outdoors 10.4
flowers 10.4
woodwind 10.4
portrait 10.3
room 10.1
businesswoman 10
holding 9.9
team 9.8
handsome 9.8
veil 9.8
cheerful 9.7
black 9.6
rose 9.4
holiday 9.3
teamwork 9.3
matrimony 8.9
success 8.8
interior 8.8
engagement 8.7
formal 8.6
businesspeople 8.5
senior 8.4
pretty 8.4
old 8.4
church 8.3
successful 8.2
clothing 8.1
job 8
commitment 7.9
work 7.8
table 7.8
party 7.7
flower 7.7
outdoor 7.6
entertainer 7.6
joy 7.5
human 7.5
traditional 7.5
mature 7.4
tradition 7.4
looking 7.2

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

person 98.2
dance 95.9
clothing 95.5
dress 92.9
woman 89.9
text 84.2
player 69.5
posing 60.1
female 28.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Female, 56.3%
Happy 70.3%
Sad 20.9%
Calm 3%
Confused 1.9%
Disgusted 1.5%
Surprised 0.9%
Fear 0.7%
Angry 0.7%

AWS Rekognition

Age 31-41
Gender Male, 96.8%
Sad 52.4%
Calm 37%
Confused 3.8%
Fear 2.2%
Surprised 1.5%
Disgusted 1.2%
Happy 1.1%
Angry 0.8%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Happy 76.4%
Calm 6.2%
Disgusted 5%
Fear 3.7%
Surprised 3.2%
Sad 2.3%
Angry 1.7%
Confused 1.5%

AWS Rekognition

Age 47-53
Gender Male, 85.3%
Calm 87.6%
Happy 7.1%
Confused 2.2%
Fear 1.4%
Sad 0.7%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 54-64
Gender Male, 86.9%
Sad 64.8%
Happy 23.2%
Fear 4.9%
Confused 2.3%
Angry 1.9%
Calm 1.7%
Disgusted 0.7%
Surprised 0.5%

AWS Rekognition

Age 48-56
Gender Male, 82%
Calm 42.3%
Sad 20.3%
Confused 20.3%
Happy 7%
Disgusted 6.4%
Surprised 1.6%
Angry 1.4%
Fear 0.6%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Calm 99.6%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 94%
Calm 98.7%
Sad 0.4%
Fear 0.2%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person
Shoe
Person 99.5%
Person 99.4%
Person 98.8%
Person 98.5%
Person 98.4%
Person 97.6%
Person 95.4%
Person 92.9%
Person 90.5%
Person 90.4%
Person 83.1%
Person 82.3%
Person 74.6%
Person 60.4%
Shoe 87.2%

Text analysis

Amazon

3

Google

MJI7--YT3RA°2--XAQ
MJI7--YT3RA°2--XAQ