Human Generated Data

Title

Untitled (family Christmas card with members posed as military)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10549
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family Christmas card with members posed as military)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.4
Human 99.4
Person 99.3
Person 98.2
Person 97.9
Person 93.6
Person 89.8
Wheel 89.5
Machine 89.5
Duel 85.6
Meal 81.5
Food 81.5
Art 67.3
Outdoors 64.7
People 64.5
Military Uniform 64.2
Military 64.2
Leisure Activities 63
Text 60.3
Drawing 58
Army 57.1
Armored 57.1
Soldier 56

Imagga
created on 2022-01-09

man 21.5
cannon 18.2
silhouette 17.4
musical instrument 16.4
gun 16.4
people 16.2
sky 15.9
male 14.9
landscape 14.9
weapon 14.9
old 13.2
person 13.1
building 13
outdoors 13
outdoor 13
sport 11.4
black 10.8
destruction 10.7
water 10.7
relaxation 10
field 10
leisure 10
architecture 9.4
grunge 9.4
wheeled vehicle 9.3
dark 9.2
wind instrument 9.1
park 9
summer 9
sun 8.8
disaster 8.8
engineer 8.7
device 8.6
men 8.6
adult 8.5
travel 8.4
smoke 8.4
protection 8.2
danger 8.2
sunset 8.1
team 8.1
life 8
day 7.8
boy 7.8
accordion 7.8
nuclear 7.8
sitting 7.7
tree 7.7
winter 7.7
vehicle 7.5
city 7.5
snow 7.5
vacation 7.4
lake 7.3
freedom 7.3
business 7.3
industrial 7.3
dirty 7.2
recreation 7.2
art 7.2
history 7.1

Google
created on 2022-01-09

Musical instrument 96.3
Drum 91.4
Guitar 88.2
Style 83.8
Musician 82.3
Chair 81
Adaptation 79.4
Idiophone 78.1
Grass 78
Tints and shades 76.8
Art 76.3
Snapshot 74.3
String instrument 73.6
Monochrome 72.1
Monochrome photography 72
Folk instrument 71.8
Font 67.7
Recreation 67.5
Vintage clothing 66.6
Sitting 65.5

Microsoft
created on 2022-01-09

person 96.8
text 95.8
black and white 94.9
man 81.7
concert 64.6
musical instrument 64
white 60.3
monochrome 58.4
clothing 51

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 93%
Happy 93.3%
Confused 2.2%
Calm 1.8%
Surprised 1%
Sad 0.6%
Disgusted 0.6%
Angry 0.4%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.1%
Calm 44.8%
Sad 18.4%
Happy 16%
Fear 9.6%
Disgusted 4%
Angry 2.5%
Surprised 2.4%
Confused 2.3%

AWS Rekognition

Age 45-51
Gender Male, 98.3%
Calm 84.2%
Sad 12.4%
Confused 1%
Happy 0.9%
Disgusted 0.5%
Angry 0.4%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Male, 96.5%
Happy 99.9%
Sad 0%
Surprised 0%
Angry 0%
Calm 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 43-51
Gender Female, 80.1%
Sad 34.1%
Calm 21.7%
Happy 20.8%
Fear 7.7%
Disgusted 4.5%
Angry 4.2%
Confused 3.6%
Surprised 3.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.4%
Wheel 89.5%

Captions

Microsoft

a group of people sitting in front of a building 71.9%
a group of people in front of a building 71.8%
a group of people sitting on top of a building 64.7%

Text analysis

Amazon

TANK
OFFICER
COMMANDING
SUPPLY
AMBULANCE
TRAIN
ARTILLER
20758.
NAOOX
NAOOX YYBSAG
MUSCI
YYBSAG

Google

20758. AMBULAN TANK TRAIN COMMANDING OFFICER 20758.
20758.
AMBULAN
TANK
TRAIN
COMMANDING
OFFICER