Human Generated Data

Title

Untitled (family dressed as military personnel for Christmas card)

Date

1942

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11793

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family dressed as military personnel for Christmas card)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99
Human 99
Person 98.6
Person 98.4
Person 98.2
Wheel 97
Machine 97
Person 94.3
Person 86.9
Art 75.8
Bicycle 74.2
Transportation 74.2
Vehicle 74.2
Bike 74.2
Leisure Activities 72.4
Drawing 72.4
Duel 68.8
Meal 68.3
Food 68.3
Outdoors 68.3
Wheel 66.5
Chair 64.3
Furniture 64.3
Text 63.5
Wheel 63.4
Female 61.6
Clothing 56.9
Apparel 56.9
Road 55.7

Imagga
created on 2022-01-15

man 24.2
musical instrument 19.4
cannon 17.6
gun 16
weapon 15.5
people 15
male 14.9
wind instrument 14.4
outdoors 14.2
brass 13.6
sport 13.4
landscape 13.4
old 13.2
person 13.2
outdoor 13
sky 12.7
silhouette 12.4
device 11.9
field 11.7
adult 10.4
black 10.2
trombone 9.9
building 9.3
copy space 9
summer 9
vacation 9
destruction 8.8
grunge 8.5
art 8.5
park 8.4
stringed instrument 8.3
active 8.2
environment 8.2
light 8.2
industrial 8.2
sunset 8.1
sun 8
water 8
grass 7.9
couple 7.8
boy 7.8
men 7.7
relax 7.6
dark 7.5
leisure 7.5
holding 7.4
competition 7.3
business 7.3
protection 7.3
suit 7.2
recreation 7.2
activity 7.2
day 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 95.8
outdoor 95.5
black and white 92.9
person 89.4
man 63.7
monochrome 60.9

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 71.5%
Fear 17.8%
Sad 5.8%
Confused 1.4%
Disgusted 1.4%
Happy 0.8%
Surprised 0.8%
Angry 0.6%

AWS Rekognition

Age 39-47
Gender Female, 62.9%
Confused 38%
Happy 32.8%
Surprised 11.7%
Sad 6.5%
Calm 4.6%
Angry 3.4%
Disgusted 1.7%
Fear 1.4%

AWS Rekognition

Age 40-48
Gender Male, 96.9%
Happy 99.8%
Sad 0.1%
Surprised 0%
Angry 0%
Fear 0%
Calm 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 47-53
Gender Male, 59.3%
Happy 97.5%
Calm 0.7%
Sad 0.6%
Angry 0.5%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Sad 82.8%
Calm 5.4%
Confused 3.5%
Happy 3.1%
Angry 1.8%
Disgusted 1.7%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 27-37
Gender Female, 95.9%
Happy 86%
Fear 3.3%
Angry 2.6%
Sad 2.4%
Surprised 2.2%
Disgusted 1.6%
Calm 1.1%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99%
Wheel 97%
Bicycle 74.2%

Captions

Microsoft

a group of people sitting on the side of a road 64.2%
a group of people sitting on the side of a building 62.5%
a group of people sitting on the side of the road 62.4%

Text analysis

Amazon

OFFICER
TANK
COMMANDING
TRAIN
LANCE
20754.
ARTILLER
SUPPLY
ANBUL LANCE
ANBUL
NOUN
MOSIL
HAPPY

Google

20754. AMBULANCA SPY TRAIN TAN K COMMANDING OFFICER 20754.
20754.
AMBULANCA
SPY
TRAIN
TAN
K
COMMANDING
OFFICER