Human Generated Data

Title

Untitled (elderly couple looking at table of golden wedding anniversary cards and gifts)

Date

1961

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9850

Human Generated Data

Title

Untitled (elderly couple looking at table of golden wedding anniversary cards and gifts)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.5
Person 99.5
Room 99.4
Indoors 99.4
Person 98.6
Dressing Room 96
Apparel 95.2
Clothing 95.2
Furniture 82.3
Sleeve 65.2
Robe 56.8
Fashion 56.8
Long Sleeve 56.1
Shop 55.4

Imagga
created on 2022-01-28

blackboard 58.4
home 33.5
interior 32.7
room 32.2
house 27.6
indoors 24.6
people 22.9
man 22.2
male 20.6
grand piano 20.1
adult 19.8
furniture 19
modern 18.9
luxury 18.9
table 18.4
smiling 18.1
couple 17.4
women 17.4
person 17.4
happy 16.9
piano 16.2
living 16.1
light 16
love 15.8
happiness 14.9
architecture 14.8
design 14.6
sitting 14.6
comfortable 14.3
window 13.9
indoor 13.7
floor 13
cheerful 13
percussion instrument 12.6
sofa 12.6
relaxation 12.6
apartment 12.5
stringed instrument 12.4
keyboard instrument 12.4
decor 12.4
lifestyle 12.3
senior 12.2
two 11.9
family 11.6
together 11.4
men 11.2
groom 11.1
style 11.1
inside 11
chair 11
elegance 10.9
smile 10.7
husband 10.5
old 10.4
life 10.2
pretty 9.8
domestic 9.7
office 9.6
residential 9.6
decoration 9.4
relax 9.3
business 9.1
attractive 9.1
fireplace 9.1
portrait 9.1
dress 9
new 8.9
structure 8.8
professional 8.8
bedroom 8.7
30s 8.7
work 8.6
hotel 8.6
loving 8.6
elegant 8.6
musical instrument 8.6
glass 8.6
real 8.5
bed 8.5
wife 8.5
mature 8.4
color 8.3
wood 8.3
laptop 8.2
clothing 8.1
computer 8
looking 8
celebration 8
wall 7.9
day 7.8
casual clothing 7.8
bride 7.7
elderly 7.7
health 7.6
estate 7.6
togetherness 7.6
meeting 7.5
romance 7.1
romantic 7.1
patient 7.1
face 7.1
working 7.1
nurse 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 93.5
wedding dress 91.5
indoor 91
black and white 75.1
bride 70.2
vase 67.3
dress 66.9
clothing 66.7
woman 51.5

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 97.4%
Calm 99.1%
Sad 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 54-64
Gender Male, 85.7%
Calm 92.6%
Sad 6.4%
Confused 0.4%
Surprised 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 95.1%
Calm 40%
Happy 36.3%
Sad 8.5%
Surprised 3.9%
Disgusted 3.6%
Fear 3.2%
Angry 2.3%
Confused 2.3%

AWS Rekognition

Age 12-20
Gender Female, 54.2%
Disgusted 32.4%
Angry 19.6%
Fear 17.2%
Sad 12.9%
Calm 12.8%
Confused 2.6%
Happy 1.5%
Surprised 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people in a room 85.7%
a group of people standing next to a window 67.7%
a group of people standing in front of a window 67%

Text analysis

Amazon

50
GOLDEN
12
GOLDEN 03%
2
MJ17--YT3--AOX
of
BOX
03%
the

Google

COLDES
MJI7--
XACON
-
COLDES MJI7-- YT3A°2- - XACON
YT3A°2-