Human Generated Data

Title

Untitled (Steinmetz Christmas card: Mimi, Lois and Joe seated on family dog)
Date

1936
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11954
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Steinmetz Christmas card: Mimi, Lois and Joe seated on family dog)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11954

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 98.5
Human 98.5
Person 96.5
Advertisement 90.1
Dog 90.1
Canine 90.1
Pet 90.1
Animal 90.1
Mammal 90.1
Text 89.8
Person 89.1
Dog 84.9
Dog 77.5
Poster 59.6
Paper 55.6

Clarifai
created on 2023-10-25

people 99.5
print 97.1
canine 97
illustration 95.9
mammal 95.8
dog 95.6
art 95.2
one 94.3
adult 94.2
group 92.5
cavalry 91.6
two 89.9
painting 89.9
man 88.7
lithograph 87.6
engraving 85.2
no person 84.3
woman 84.1
wear 83.1
text 82.6

Imagga
created on 2022-01-15

book jacket 74.6
jacket 58.1
wrapping 44.1
comic book 35.4
covering 29.7
black 19.8
afghan hound 18.5
vintage 18.2
portrait 17.5
hunting dog 16.9
hound 15.9
person 15.8
print media 14.2
man 14.1
old 13.2
hair 12.7
stamp 12.6
mail 12.4
art 12
dog 11.9
postmark 11.8
postage 11.8
people 11.7
close 11.4
face 11.4
letter 11
model 10.9
postal 10.8
symbol 10.8
silhouette 10.8
sport 10.7
retro 10.6
attractive 10.5
sexy 10.4
grunge 10.2
paper 10.2
closeup 10.1
dance 10.1
aged 9.9
adult 9.8
money 9.4
male 9.2
fashion 9
currency 9
one 9
lady 8.9
posing 8.9
philately 8.9
body 8.8
envelope 8.8
slick 8.7
post 8.6
power 8.4
pretty 8.4
outdoors 8.2
style 8.2
women 7.9
color 7.8
horse 7.6
unique 7.6
fun 7.5
dollar 7.4
sensual 7.3
dirty 7.2
dress 7.2
sky 7

Google
created on 2022-01-15

Photograph 94.3
Vertebrate 92.2
Dog 89.3
Picture frame 87.8
Poster 85.4
Mammal 85.4
Carnivore 83.3
Art 81.4
Font 77.3
Working animal 76.1
Snapshot 74.3
Illustration 73.4
Vintage clothing 71.2
Advertising 68.3
Stock photography 62.8
Sporting Group 61.8
Vintage advertisement 60.5
Photo caption 60.4
Fictional character 60.3
Painting 60

Microsoft
created on 2022-01-15

text 100
book 99.8
cartoon 97.2
illustration 95.6
poster 92.7
animal 91.1
screen 89.5
drawing 89.4
sketch 83.7
sign 79.5
dog 75.1
mammal 54.2
horse 54
different 35.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Calm 94.3%
Sad 1.3%
Happy 1.3%
Angry 0.9%
Disgusted 0.8%
Confused 0.7%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 98.1%
Happy 1%
Sad 0.5%
Surprised 0.3%
Confused 0.2%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Female, 54.2%
Calm 49.3%
Sad 22.9%
Happy 22.8%
Confused 2%
Fear 1%
Surprised 1%
Disgusted 0.6%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Dog 90.1%
Poster 59.6%

Categories

Imagga

pets animals 70%
paintings art 28.3%

Text analysis

Amazon

and
and PETER PAN
PETER
JOE
FINISHED
PUT
PRINT
THE
IN
PUT FINISHED GREETING
PAN
THIS PRINT IN WHITE LETTERS
CHRISTMAS
THIS
MERRY THE STEINMETZ'S CHRISTMAS
LETTERS
GREETING
LOIS,
WHITE
MERRY
STEINMETZ'S
'36
MIMI,
ON
ARQA
MJIE YT37A2 ARQA
YT37A2
MJIE

Google

PUT FINISHED GREENG THIS PRINT IN WHITE LETTERS MERRY CHRISTMAS THE STEINMETZ's '36 MIMI, LoIs, JOE and PETER PAN
PUT
FINISHED
GREENG
THIS
PRINT
IN
WHITE
LETTERS
MERRY
CHRISTMAS
THE
STEINMETZ's
'36
MIMI,
LoIs,
JOE
and
PETER
PAN