Human Generated Data

Title

Untitled (man dressed as Santa Claus seated on beach with woman)
Date

c. 1960
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10772
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man dressed as Santa Claus seated on beach with woman)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.5
Apparel 99.5
Furniture 98.6
Chair 98.6
Person 98.4
Human 98.4
Person 97.9
Dress 96.3
Female 92.3
Nature 90.3
Outdoors 88.9
Ocean 88.7
Water 88.7
Sea 88.7
Face 86.9
People 86.8
Sitting 81.7
Woman 79.3
Pants 78.5
Shoreline 78.4
Beach 78.1
Coast 78.1
Photo 74.6
Portrait 74.6
Photography 74.6
Girl 73.6
Hat 67.7
Kid 67.4
Child 67.4
Sand 63.3
Family 56.5

Imagga
created on 2022-01-15

child 37.8
kin 37.3
mother 29.9
parent 27.8
happy 27.6
people 23.4
family 22.2
happiness 21.9
smiling 21
portrait 20.7
adult 20.6
lifestyle 18.8
cute 18.6
male 18.4
kid 17.7
cheerful 17.1
person 16.7
clothing 16.5
blond 16.4
outdoors 16.4
dress 16.3
fun 15.7
couple 15.7
smile 15.7
fashion 14.3
pajama 14.2
man 14.1
attractive 14
girls 13.7
love 13.4
little 13.2
face 12.8
joy 12.5
lady 12.2
play 12.1
pretty 11.9
casual 11.9
old 11.8
childhood 11.6
boy 11.3
expression 11.1
youth 11.1
playing 10.9
model 10.9
leisure 10.8
park 10.7
baby 10.5
father 10.5
sexy 10.4
son 10.4
home 10.4
sitting 10.3
summer 10.3
women 10.3
daughter 10.2
sibling 10
dad 9.7
nightwear 9.7
look 9.6
bride 9.6
two 9.3
mature 9.3
human 9
body 8.8
together 8.8
hair 8.7
eyes 8.6
adorable 8.3
holding 8.3
children 8.2
world 8.2
style 8.2
looking 8
posing 8
black 7.8
color 7.8
husband 7.8
married 7.7
healthy 7.6
kids 7.5
senior 7.5
one 7.5
brother 7.5
wedding 7.4
water 7.3
indoor 7.3
life 7
indoors 7

Google
created on 2022-01-15

Hat 87.5
Chair 81.7
Adaptation 79.3
Tints and shades 77
Vintage clothing 75.4
Monochrome photography 72.8
Monochrome 71.2
Sun hat 71.1
Classic 68.5
Room 67
Sitting 65.9
Stock photography 64.1
Art 63.7
Pattern 63.1
Suit 60.6
Rectangle 60.5
Photographic paper 59.8
Paper product 56.9
Retro style 55.6
Photo caption 55.3

Microsoft
created on 2022-01-15

text 99.6
clothing 97.4
person 95.4
woman 78
dress 71
old 68.8
black and white 68.6
beach 60.5
footwear 56.9
posing 36

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 85.7%
Happy 98.9%
Sad 0.4%
Calm 0.3%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a vintage photo of a person 88.2%
a vintage photo of a man and a woman posing for a picture 70.1%
a vintage photo of a man and woman posing for a picture 65.4%

Text analysis

Amazon

49246