Human Generated Data

Title

Untitled (Steinmetz Christmas card: Joe, Lois And Mimi riding family dog)

Date

1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12067

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Steinmetz Christmas card: Joe, Lois And Mimi riding family dog)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 97.1
Human 97.1
Person 95.7
Advertisement 95.4
Person 88.2
Canine 87.4
Pet 87.4
Animal 87.4
Dog 87.4
Mammal 87.4
Text 83.1
Dog 68.8
Brochure 68
Flyer 68
Paper 68
Poster 63.8
Costume 55.1

Imagga
created on 2022-01-15

jacket 100
book jacket 100
wrapping 84.4
covering 56.5
comic book 37.7
black 18
vintage 16.5
sport 15.6
man 15.4
print media 15.1
silhouette 14.9
stamp 14.5
mail 14.4
old 13.9
postmark 13.8
postage 13.8
grunge 13.6
person 13.6
symbol 12.8
postal 12.8
dance 12
close 12
letter 11.9
portrait 11.6
envelope 10.7
retro 10.6
post 10.5
money 10.2
art 10.1
power 10.1
people 10
dirty 9.9
currency 9.9
posing 9.8
adult 9.8
paper 9.4
male 9.2
active 9
sunset 9
one 9
color 8.9
philately 8.9
unique 8.5
global 8.2
paint 8.1
closeup 8.1
dancer 7.7
party 7.7
motion 7.7
culture 7.7
painted 7.6
fine 7.6
bill 7.6
dark 7.5
style 7.4
water 7.3
cash 7.3
aged 7.2
bank 7.2
hair 7.1
icon 7.1
summer 7.1
sky 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 100
book 98.7
cartoon 94.1
monitor 92.5
poster 90.6
illustration 89.6
screen 85.5
animal 83.7
sign 81
dog 76.2
drawing 73.7
sketch 65.9
mammal 52.8
image 36
different 33.8

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 92.2%
Sad 3.9%
Happy 2.1%
Confused 0.7%
Disgusted 0.4%
Angry 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 99.2%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 70.9%
Happy 52.1%
Calm 24.5%
Sad 19.4%
Confused 1.4%
Fear 1%
Disgusted 0.6%
Surprised 0.5%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Dog 87.4%
Poster 63.8%

Captions

Microsoft

a screen shot of a dog 86.3%
a screen shot of a dog holding a sign 83.4%
a screen shot of a dog in front of a sign 83.3%

Text analysis

Amazon

and
JOE
PETER
PUT
THE
and PETER PAN
PRINT
THIS
LOIS,
PAN
IN
THIS PRINT IN WHITE LETTERS
CHRISTMAS
FINISHED
WHITE
PUT FINISHED GREETING
MERRY THE STEINMETZ'S CHRISTMAS
LETTERS
STEINMETZ'S
MERRY
GREETING
'36
MIMI,
ON
POEP

Google

IN
LETTERS
MERRU
MIMI,
LOIS,
JOE
PUT FINISHED GREETNG THIS PRINT IN WHITE LETTERS MERRU CHRISTMAS THE STEINMETZ's 36 MIMI, LOIS, JOE and PETER PAN
36
PRINT
WHITE
CHRISTMAS
STEINMETZ's
and
PETER
PAN
PUT
FINISHED
THIS
THE
GREETNG