Human Generated Data

Title

Untitled (family posed in various military posts for Christmas card)

Date

c. 1945

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7293

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family posed in various military posts for Christmas card)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.5
Human 99.5
Person 99.3
Person 98.8
Person 98.3
Wheel 97.4
Machine 97.4
Person 94.1
Duel 90.8
Outdoors 87.5
Person 87.5
Land 74
Nature 74
Agriculture 69.9
Field 69.9
Countryside 69.9
Photography 62.9
Photo 62.9
Art 60.9
Text 60

Imagga
created on 2022-01-15

wind instrument 40.9
brass 40.1
musical instrument 35.7
trombone 29.1
man 26.2
male 19.8
outdoors 18.8
people 17.8
person 15.8
sax 15.3
field 15
grass 15
outdoor 14.5
sport 14.3
device 14.1
silhouette 13.2
sky 12.7
black 12.6
adult 11.8
park 11.5
businessman 11.5
happy 10.6
active 10.5
couple 10.4
bugle 10.3
men 10.3
summer 10.3
volleyball net 10
sunset 9.9
game 9.8
old 9.7
landscape 9.7
together 9.6
net 9.6
boy 9.6
accordion 9.5
lifestyle 9.4
friends 9.4
equipment 9.3
relax 9.3
leisure 9.1
business 9.1
copy space 9
team 9
success 8.8
wheeled vehicle 8.6
tree 8.5
free 8.4
chair 8.3
holding 8.2
freedom 8.2
environment 8.2
skateboard 8.2
suit 8.1
working 7.9
day 7.8
happiness 7.8
play 7.7
keyboard instrument 7.7
grunge 7.7
two 7.6
joy 7.5
dark 7.5
vacation 7.4
ecology 7.3
teenager 7.3
child 7.2
meadow 7.2
mountain 7.1
work 7.1
country 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99
grass 97.1
black and white 95.8
outdoor 88.5
person 87.7
monochrome 67
man 63.7
grave 54.2

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 68.6%
Happy 77.7%
Calm 16.8%
Confused 1.7%
Surprised 1.4%
Sad 1.1%
Disgusted 0.5%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Female, 64.7%
Happy 98.3%
Surprised 0.7%
Confused 0.3%
Calm 0.2%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 39-47
Gender Female, 82.2%
Happy 89.2%
Calm 5.7%
Surprised 1.4%
Angry 1.4%
Disgusted 0.9%
Confused 0.8%
Fear 0.4%
Sad 0.3%

AWS Rekognition

Age 31-41
Gender Male, 99.1%
Sad 85.2%
Happy 5.5%
Calm 3.4%
Fear 1.8%
Confused 1.3%
Disgusted 1.2%
Surprised 0.9%
Angry 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Wheel 97.4%

Captions

Microsoft

a group of people sitting on a bench 56.4%
a group of people sitting in the grass 56.3%
a group of people that are sitting in the grass 56.2%

Text analysis

Amazon

COMMANDING
TANK
OFFICER
AMBULANCE
TRAIN
ARTILLER
20759.
SUPPLY
HEAVY
MUSICA

Google

20759. ARTILLE AMBULANG SUPPLY TRAIN TANK COMMANDING OFFICER 20759.
20759.
ARTILLE
AMBULANG
SUPPLY
TRAIN
TANK
COMMANDING
OFFICER