Human Generated Data

Title

Untitled (Steinmetz Christmas card: Mimi, Lois and Joe seated on family dog)

Date

1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11951

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Steinmetz Christmas card: Mimi, Lois and Joe seated on family dog)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 96.8
Human 96.8
Person 96.1
Advertisement 94.6
Dog 90.4
Mammal 90.4
Animal 90.4
Canine 90.4
Pet 90.4
Person 90.3
Text 83.1
Dog 82.3
Horse 64.7
Flyer 64.5
Paper 64.5
Brochure 64.5
Poster 63.1
Costume 57.1

Imagga
created on 2022-01-15

book jacket 100
jacket 86.7
wrapping 65.9
comic book 50.2
covering 44.2
print media 20.1
man 18.8
black 18.6
vintage 16.5
person 15.9
art 15.3
stamp 14.5
mail 14.3
dance 14.2
symbol 14.1
silhouette 14.1
sport 14
postmark 13.8
postage 13.7
old 13.2
portrait 12.9
letter 12.8
postal 12.7
close 12
male 11.3
grunge 11.1
money 11.1
currency 10.8
envelope 10.7
people 10.6
retro 9.8
posing 9.8
post 9.5
unique 9.5
closeup 9.4
paper 9.4
culture 9.4
adult 9.3
power 9.2
dirty 9
sunset 9
one 9
color 8.9
philately 8.9
bill 8.6
cash 8.2
active 8.1
ancient 7.8
motion 7.7
artist 7.7
painted 7.6
dark 7.5
fun 7.5
dollar 7.4
global 7.3
aged 7.2
body 7.2
bank 7.2
dancer 7.1
hair 7.1
women 7.1
face 7.1
summer 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 100
book 99.3
cartoon 95.5
illustration 95.4
monitor 90.3
animal 89.4
poster 89.1
screen 86.5
sign 78.5
dog 74.8
drawing 73.4
sketch 54.1
different 46.6
image 33.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 88.9%
Calm 80.9%
Sad 12.5%
Happy 1.6%
Fear 1.4%
Angry 1.2%
Confused 1.2%
Disgusted 1%
Surprised 0.2%

AWS Rekognition

Age 48-56
Gender Male, 92%
Calm 94.5%
Sad 2.1%
Surprised 1.6%
Happy 1.1%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 29-39
Gender Female, 73.8%
Calm 49.3%
Sad 25.1%
Happy 18.2%
Confused 2.2%
Disgusted 2%
Fear 1.7%
Surprised 0.9%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%
Dog 90.4%
Horse 64.7%
Poster 63.1%

Captions

Microsoft

a screen shot of a dog 81.8%
a screen shot of a dog in front of a book 52.6%
a screen shot of a dog in front of a sign 52.5%

Text analysis

Amazon

PUT
and
IN
PRINT
THE
and PETER PAN
PAN
THIS PRINT IN WHITE LETTERS
THIS
JOE
PETER
CHRISTMAS
MERRY THE STEINMETZ'S CHRISTMAS
LETTERS
LOIS,
WHITE
STEINMETZ'S
MERRY
GREETING
PUT FINISHED GREETING
FINISHED
'36
MIMI,
VELA
ax

Google

FINISHED
THIS
CHRISTMAS
THE
JOE
'36
LOIS,
PUT FINISHED GREETNG THIS PRINT IN WHITE LETTERS MERRY CHRISTMAS THE STEINMETZ's '36 MIMI, LOIS, JOE and PETER PAN MJIHYT3RA2 ARDA
PRINT
PETER
ARDA
GREETNG
WHITE
STEINMETZ's
MIMI,
and
PUT
IN
LETTERS
MERRY
PAN
MJIHYT3RA2