Human Generated Data

Title

Untitled (group of men from National Maritime Union)

Date

1942

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7116

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of men from National Maritime Union)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Person 99.9
Human 99.9
Person 99.9
Person 99.9
Person 99.9
Person 99.7
Person 97.7
T-Shirt 91.1
Footwear 87.8
Shoe 87.8
Helmet 81.7
Shorts 79.4
Text 68.6
Boy 56

Imagga
created on 2021-12-15

water 20
travel 17.6
person 16.2
ballplayer 15.1
player 14.3
black 13.8
sky 13.4
man 12.9
people 12.8
athlete 12.7
motion 12
beach 11.8
clothing 11.8
container 11.7
summer 10.9
silhouette 10.7
male 10.7
contestant 10
ocean 9.9
outdoor 9.9
tourism 9.9
bottle 9.2
vessel 9.2
landscape 8.9
river 8.9
sea 8.6
stone 8.6
architecture 8.6
wall 8.5
winter 8.5
hand 8.3
city 8.3
park 8.2
art 8.2
coast 8.1
to 8
businessman 7.9
business 7.9
day 7.8
soldier 7.8
men 7.7
statue 7.6
human 7.5
light 7.4
symbol 7.4
success 7.2
dirty 7.2
suit 7.2
sunset 7.2
recreation 7.2
activity 7.2
history 7.1
cool 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.6
clothing 96.6
person 95
baseball 94.7
outdoor 93.8
man 86.7
sports uniform 75.9
black and white 50.6
posing 36.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Male, 99.3%
Happy 43.5%
Calm 32.7%
Fear 10%
Surprised 7%
Disgusted 2.7%
Angry 1.7%
Sad 1.6%
Confused 0.8%

AWS Rekognition

Age 23-37
Gender Male, 58.6%
Calm 42.4%
Happy 37.3%
Angry 8.7%
Sad 3.9%
Fear 3.4%
Surprised 2.8%
Confused 0.7%
Disgusted 0.7%

AWS Rekognition

Age 26-40
Gender Male, 71.1%
Happy 95.5%
Calm 2.7%
Confused 0.8%
Surprised 0.6%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 53-71
Gender Male, 97.5%
Calm 93.5%
Happy 4%
Angry 1%
Surprised 0.7%
Disgusted 0.4%
Sad 0.2%
Fear 0.2%
Confused 0%

AWS Rekognition

Age 56-74
Gender Male, 97.5%
Calm 57.8%
Fear 17.3%
Surprised 12.7%
Happy 6.7%
Sad 2.1%
Angry 2%
Disgusted 0.9%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 87.8%
Helmet 81.7%

Captions

Microsoft

a group of baseball players posing for a photo 78.1%
a group of people posing for a photo 78%
a group of baseball players that are posing for a photo 70.6%

Text analysis

Amazon

UNION
MARITIME
612
ATL MARITIME
ATL
NAT'L MARITIME
17612
L MARITIME
NAT'L
ONION
19 612
L
NATL MARITIME
UNiON
19
NATL
71361

Google

MARITIA
UNION
iON
NAT
19612
MARTIME
MARITIA MARIT MARITL UNION UNION iON UNION UNION 19612 MARTIME MARITIME NAT
MARITL
MARITIME
MARIT