Human Generated Data

Title

Untitled (young couple kissing in front of fireplace while two others look on)

Date

1941

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9028

Human Generated Data

Title

Untitled (young couple kissing in front of fireplace while two others look on)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Person 99.3
Human 99.3
Person 98.9
Person 96.9
Robe 92.4
Fashion 92.4
Shoe 90.9
Footwear 90.9
Gown 90.8
Wedding 88.3
Evening Dress 85.3
Female 83.3
Wedding Gown 74.9
Person 72.2
People 68.5
Woman 67.4
Bride 60.9
Portrait 56.6
Photography 56.6
Face 56.6
Photo 56.6

Imagga
created on 2022-01-23

wind instrument 39.7
brass 38.5
musical instrument 32
sax 31.9
man 26.9
people 23.4
person 21.5
male 21.3
cornet 20.3
silhouette 19.9
black 15.6
sexy 15.2
businessman 14.1
symbol 13.5
crowd 13.4
couple 13.1
lights 13
adult 12.8
nighttime 11.7
team 11.6
business 11.5
sport 11.5
music 11.1
flag 11
portrait 11
cheering 10.8
bright 10.7
audience 10.7
stadium 10.7
happy 10.6
device 10.6
job 10.6
patriotic 10.5
vibrant 10.5
nation 10.4
play 10.3
design 10.1
dark 10
president 9.8
horn 9.7
boss 9.6
guitar 9.4
work 9.4
teacher 9.2
occupation 9.2
businesswoman 9.1
stringed instrument 9.1
fashion 9
player 9
fun 9
style 8.9
icon 8.7
musician 8.7
model 8.5
grunge 8.5
teamwork 8.3
violin 8.2
window 8.2
women 7.9
supporters 7.9
speech 7.8
boy 7.8
art 7.8
leader 7.7
educator 7.5
presentation 7.4
vivid 7.4
star 7.4
professional 7.4
bowed stringed instrument 7.3
active 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.6
dress 97.4
wedding dress 96.8
bride 93.1
clothing 89.3
woman 84.7
standing 81.7
person 76.9
wedding 69.9
posing 69.2
old 55.7

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 90.3%
Calm 96.9%
Happy 1.9%
Sad 0.6%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 90.9%

Captions

Microsoft

a group of people posing for a photo 79.5%
an old photo of a group of people posing for the camera 76.4%
a group of people standing in front of a window 72.4%

Text analysis

Amazon

MJIR
MJIR ЗТАЯТIИ ARDA
ARDA
ЗТАЯТIИ

Google

MJIR 3TAЯТИ АЗДА
MJIR
3TAЯТИ
АЗДА