Human Generated Data

Title

Untitled (a group of men from the National Maritime Union)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7129
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (a group of men from the National Maritime Union)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Human 99.9
Person 99.9
Person 99.8
Person 99.8
Person 99.7
Person 99.7
Person 99.7
Shorts 97.4
Person 93.1
People 76.2
T-Shirt 73
Pants 71.5
Crowd 69.5
Hat 69.4
Cap 69.4
Text 69.4
Shoe 68.7
Footwear 68.7
Baseball Cap 66.1
Portrait 62
Face 62
Photo 62
Photography 62
Shirt 59.5
Word 57.9
Jersey 56.2

Imagga
created on 2021-12-15

football helmet 100
helmet 97.6
headdress 73.7
clothing 45.4
man 32.2
athlete 30.2
player 28
sport 26.9
male 25.5
consumer goods 24.6
covering 24.5
person 23.3
people 22.9
ballplayer 21.7
field 15
ball 14.8
competition 14.6
men 14.6
back 14
active 13.5
contestant 13.4
lifestyle 13
adult 13
exercise 12.7
brass 11.7
silhouette 11.6
couple 11.3
play 11.2
fitness 10.8
game 10.7
boy 10.4
sky 10.2
event 10.2
training 10.2
symbol 10.1
playing 10
leisure 10
championship 9.7
outdoors 9.7
summer 9.6
outdoor 9.2
flag 9.2
business 9.1
wind instrument 9
team 9
businessman 8.8
happy 8.8
stadium 8.7
grass 8.7
run 8.7
skill 8.7
goal 8.6
football 8.6
crowd 8.6
running 8.6
club 8.5
action 8.3
health 8.3
human 8.2
audience 7.8
match 7.7
motion 7.7
outside 7.7
soccer 7.7
patriotic 7.7
beach 7.6
nation 7.6
fun 7.5
sports 7.4
speed 7.3
design 7.3
success 7.2
body 7.2
icon 7.1
portrait 7.1
day 7.1
musical instrument 7

Google
created on 2021-12-15

Adaptation 79.3
Font 78.1
Crew 75.3
Monochrome 74.8
Uniform 69.8
Monochrome photography 69
Vintage clothing 64.4
Photo caption 64
Stock photography 62.7
Advertising 59.2
Rectangle 58.6
Team 57.5
Visual arts 50.3

Microsoft
created on 2021-12-15

text 98.7
clothing 96.6
person 92.4
outdoor 87
man 86
footwear 79.9
smile 73.5
baseball 63.9
black and white 57.8
posing 36.7

Face analysis

Amazon

Google

AWS Rekognition

Age 48-66
Gender Male, 97.4%
Calm 86.8%
Happy 7.6%
Sad 1.7%
Angry 1.5%
Fear 1.2%
Surprised 0.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 37-55
Gender Male, 93%
Calm 96.8%
Sad 1.6%
Happy 0.9%
Angry 0.4%
Fear 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 42-60
Gender Female, 75.3%
Fear 61.4%
Calm 30%
Sad 3.7%
Angry 1.6%
Happy 1.5%
Surprised 1%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 47-65
Gender Female, 83.5%
Calm 28%
Happy 27.4%
Sad 18.2%
Fear 13.8%
Angry 4.2%
Confused 3.2%
Surprised 2.8%
Disgusted 2.3%

AWS Rekognition

Age 49-67
Gender Male, 90.1%
Calm 98.7%
Happy 0.5%
Sad 0.3%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 39-57
Gender Male, 60%
Calm 43.7%
Happy 24.2%
Sad 10.8%
Fear 10.8%
Surprised 5%
Angry 2%
Confused 2%
Disgusted 1.6%

AWS Rekognition

Age 22-34
Gender Male, 88%
Angry 39.4%
Surprised 34.3%
Calm 11.7%
Disgusted 5.3%
Fear 3.7%
Happy 3.6%
Confused 1.1%
Sad 0.8%

AWS Rekognition

Age 44-62
Gender Male, 99.4%
Calm 90.4%
Surprised 6.4%
Happy 0.8%
Angry 0.7%
Confused 0.5%
Sad 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 49-67
Gender Male, 94.1%
Calm 98%
Happy 1.1%
Sad 0.3%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 68.7%

Captions

Microsoft

a group of people posing for a photo 89.6%
a group of people posing for the camera 89.5%
a group of people posing for a picture 89.4%

Text analysis

Amazon

UNION
MARITIME
19613.
MARI
MAR
...
ADITIME
NAT/ MAR
RATL MARITIME
NAT/
MATZ MARITIME
NAT'L MARITIME
19513
MATZ
RATL
WAT'L
WAT'L MARITING
MARITING
NAT'L

Google

19613 MAR MARIT UNION ONION MARIT MARITIN NION UNION 613.
MAR
ONION
MARITIN
NION
UNION
MARIT
613.
19613