Human Generated Data

Title

Untitled (family posed in various military posts for Christmas card)

Date

c. 1945

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7295

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family posed in various military posts for Christmas card)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.4
Human 99.4
Person 99.2
Person 99.2
Person 99.1
Person 98.3
Duel 96
Machine 94.5
Wheel 94.5
Vehicle 85.7
Bike 85.7
Bicycle 85.7
Transportation 85.7
Person 79.5
Wheel 71.2
Outdoors 68.1
Clothing 67.6
Apparel 67.6
Plant 62.4
Grass 62.4
Art 58.7
Drawing 58.7
Steamer 58.7
Text 57.8
Soil 57.8
Field 57.5
Leisure Activities 56.8

Imagga
created on 2022-01-15

wheeled vehicle 32.1
tricycle 28
vehicle 21.8
man 18.8
musical instrument 18.7
old 18.1
conveyance 17.5
newspaper 16
outdoor 15.3
outdoors 15
park 14.8
people 14.5
lawn mower 14.3
male 14.2
sky 12.7
landscape 12.6
product 12.3
tool 12.1
grunge 11.9
garden tool 11.7
vintage 11.6
black 11.4
forest 11.3
wind instrument 10.9
person 10.6
brass 10.5
grass 10.3
percussion instrument 10.2
chair 10
tree 10
creation 9.6
winter 9.4
space 9.3
snow 9.3
field 9.2
sport 9.1
leisure 9.1
urban 8.7
couple 8.7
water 8.7
lifestyle 8.7
antique 8.6
sitting 8.6
adult 8.5
summer 8.4
dark 8.3
frame 8.3
silhouette 8.3
device 8.3
retro 8.2
sunset 8.1
trees 8
building 8
art 7.8
cold 7.7
bench 7.7
human 7.5
city 7.5
holding 7.4
environment 7.4
light 7.4
marimba 7.3
color 7.2
history 7.2
day 7.1
businessman 7.1
travel 7
season 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.1
person 95.8
black and white 94.1
outdoor 92
man 83.2
clothing 81.8
musical instrument 62.2

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 94%
Happy 85.5%
Confused 5%
Surprised 3.6%
Calm 1.6%
Disgusted 1.5%
Sad 1.4%
Angry 1%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 96.7%
Calm 59.7%
Happy 34.9%
Sad 1.2%
Confused 1%
Angry 0.9%
Fear 0.9%
Surprised 0.7%
Disgusted 0.7%

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Sad 35.2%
Confused 29.1%
Surprised 10.6%
Calm 7.3%
Happy 6.2%
Disgusted 5.2%
Fear 3.2%
Angry 3.1%

AWS Rekognition

Age 48-54
Gender Male, 84%
Happy 28.3%
Calm 22%
Sad 16.5%
Fear 14.9%
Surprised 6.3%
Confused 5.1%
Disgusted 3.9%
Angry 3%

AWS Rekognition

Age 51-59
Gender Male, 99.2%
Happy 98.9%
Angry 0.4%
Surprised 0.2%
Sad 0.2%
Disgusted 0.1%
Calm 0.1%
Fear 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Wheel 94.5%
Bicycle 85.7%

Captions

Microsoft

a group of people sitting on a bench 63.8%
a group of people riding on the back of a bench 51.7%
a group of people that are sitting on a bench 51.5%

Text analysis

Amazon

TANK
OFFICER
COMMANDING
TRAIN
SUPPLY
AMBULANCE
20753.
20753
ARTILLERI
KODV
so
MOBLE
MART

Google

20753. AMBULANCA SUPPLY TANK TRAIN COMMANDING OFFICER 20753
20753.
SUPPLY
COMMANDING
OFFICER
AMBULANCA
20753
TANK
TRAIN