Human Generated Data

Title

Untitled (people kissing across table)

Date

c. 1950

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18984

Human Generated Data

Title

Untitled (people kissing across table)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.6
Apparel 99.6
Human 98.4
Person 98.4
Person 97.2
Person 96.2
Person 95.4
Dress 86
Party 85.4
Female 84.3
Indoors 83
Room 82.1
Face 82.1
Fashion 79.9
Robe 79.9
Wedding 76.9
Gown 76.3
Overcoat 75.4
Coat 75.4
Beverage 73.1
Drink 73.1
Woman 69.2
Wedding Gown 66.7
Bridegroom 66.5
Photo 66.3
Portrait 66.3
Photography 66.3
People 65.9
Suit 65.1
Bar Counter 64.9
Pub 64.9
Crowd 62.3
Alcohol 60.5
Leisure Activities 58.8
Costume 56.8
Furniture 56.2
Bride 55.1

Imagga
created on 2022-03-05

people 30.1
man 25.5
kin 24.4
adult 23.5
male 23.5
couple 21.8
smiling 21
women 20.5
person 19.6
happy 19.4
portrait 17.5
love 17.3
men 16.3
dress 16.2
room 15.7
two 15.2
home 15.1
groom 14.8
bride 14.4
family 14.2
mother 14.1
happiness 14.1
indoors 12.3
cheerful 12.2
wedding 11.9
together 11.4
group 11.3
fun 11.2
lifestyle 10.8
friends 10.3
business 10.3
senior 10.3
sitting 10.3
mature 10.2
salon 10.2
child 9.9
togetherness 9.4
holiday 9.3
leisure 9.1
old 9
human 9
life 9
world 8.8
hair 8.7
husband 8.7
boy 8.7
face 8.5
bouquet 8.5
color 8.3
fashion 8.3
holding 8.2
indoor 8.2
teenager 8.2
romantic 8
businessman 7.9
black 7.9
day 7.8
teacher 7.8
clothing 7.6
enjoying 7.6
one 7.5
outdoors 7.5
camera 7.4
daughter 7.3
parent 7.3
sexy 7.2
smile 7.1
modern 7

Google
created on 2022-03-05

Hairstyle 95.1
Black 89.6
Black-and-white 86.1
Style 84.1
Chair 79.5
Monochrome photography 76.3
Picture frame 76.3
Monochrome 75.3
Art 74.9
Fun 73.5
Event 72.9
Font 70.5
Vintage clothing 70.5
Room 69.8
Sitting 67.6
History 64.5
Stock photography 63.7
Couch 63.4
Classic 61.7
Conversation 60.6

Microsoft
created on 2022-03-05

person 97
text 95.9
black and white 89.2
clothing 80.9
wedding dress 70.6
dance 59.2
bride 56.1
man 55.6
woman 52.2

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.7%
Sad 30.5%
Surprised 25.6%
Confused 17.4%
Calm 12.3%
Angry 4.9%
Fear 4.3%
Disgusted 3.9%
Happy 1.1%

AWS Rekognition

Age 41-49
Gender Male, 100%
Happy 48.2%
Fear 16.2%
Angry 16%
Calm 8.5%
Surprised 4.5%
Disgusted 2.4%
Sad 2.3%
Confused 1.8%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 64.4%
Confused 27.9%
Sad 2.6%
Happy 2.1%
Disgusted 1.4%
Surprised 0.6%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Calm 28.4%
Confused 25.7%
Surprised 23.6%
Angry 10%
Sad 5.8%
Disgusted 4%
Fear 1.4%
Happy 1.1%

AWS Rekognition

Age 23-31
Gender Male, 95.2%
Calm 87%
Fear 6.5%
Sad 5.3%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Male, 77.1%
Happy 30.9%
Calm 23.5%
Surprised 17.2%
Sad 8.5%
Confused 7.1%
Angry 4.7%
Disgusted 4.3%
Fear 3.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Suit 65.1%

Captions

Microsoft

a group of people standing in a room 91.2%
a group of people in a room 90.7%
a man standing in front of a group of people in a room 84.5%

Text analysis

Amazon

80A
Madden
PrigG55
B

Google

YT37A°2-XAGOA
80A YT37A°2-XAGOA
80A