Human Generated Data

Title

Untitled (men from the navy helping a woman onto a boat)

Date

1942

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7128

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men from the navy helping a woman onto a boat)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.8
Human 99.8
Person 99.8
Person 99.8
Person 99.8
Person 99.5
Person 99.4
Person 98.8
Clothing 98.6
Apparel 98.6
Shorts 97.7
Footwear 97.3
Shoe 97.3
Crowd 96.4
Shoe 95.5
Sailor Suit 92.2
Hat 91.9
People 86.8
Military 82
Huddle 74
Parade 71.9
Shoe 67.7
Officer 67.3
Military Uniform 67.3
Field 62.5
Navy 59.5
Helmet 55.3

Imagga
created on 2021-12-15

uniform 56
military uniform 47
man 31.6
clothing 31.4
person 26.7
male 23.4
athlete 22.6
player 22
people 21.7
ballplayer 21.3
military 20.3
covering 20
war 19.9
consumer goods 19.1
sport 18.4
private 16.2
adult 15.5
men 15.4
gun 14
weapon 13.9
army 13.6
outdoors 13.4
contestant 13.3
aviator 12.9
protection 12.7
battle 12.7
helmet 12.6
day 12.5
equipment 12
occupation 11.9
professional 11.9
game 11.6
soldier 10.7
danger 10
team 9.8
camouflage 9.8
conflict 9.8
standing 9.6
commodity 9.4
street 9.2
travel 9.1
industrial 9.1
portrait 9.1
transportation 9
recreation 9
hat 8.9
pilot 8.8
women 8.7
active 8.6
vehicle 8.6
business 8.5
teamwork 8.3
city 8.3
leisure 8.3
safety 8.3
happy 8.1
activity 8.1
history 8
to 8
job 8
warfare 7.9
combat 7.9
couple 7.8
smile 7.8
defense 7.8
fight 7.7
waiting 7.7
mask 7.7
sky 7.6
guy 7.5
fun 7.5
park 7.4
air 7.4
competition 7.3
smiling 7.2
looking 7.2
worker 7.1
summer 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 99.9
outdoor 99.1
clothing 95.4
text 94.7
man 91.2
ship 81.6
player 72.8
black and white 68.8

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 91.4%
Calm 90.1%
Surprised 3.3%
Sad 2.9%
Confused 1.8%
Angry 1.2%
Happy 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 38-56
Gender Male, 89.9%
Calm 97.8%
Happy 1.4%
Surprised 0.3%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 26-42
Gender Female, 78.3%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-51
Gender Male, 88.1%
Calm 89.7%
Angry 8.1%
Sad 1.3%
Happy 0.4%
Surprised 0.4%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 13-25
Gender Female, 80.9%
Calm 65%
Sad 23.2%
Happy 5.4%
Angry 3.3%
Confused 1.2%
Disgusted 0.8%
Fear 0.7%
Surprised 0.4%

AWS Rekognition

Age 18-30
Gender Female, 56.5%
Calm 69.2%
Surprised 24.8%
Fear 3.7%
Confused 1%
Angry 0.4%
Sad 0.4%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 38-56
Gender Male, 61.3%
Sad 36.5%
Calm 35%
Happy 11%
Fear 9.4%
Angry 3.6%
Confused 2.1%
Surprised 1.7%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 97.3%
Hat 91.9%

Captions

Microsoft

a group of baseball players standing on top of a field 55.5%
a group of baseball players standing on top of each other 55.4%
a group of baseball players that are standing in front of a crowd 55.3%

Text analysis

Amazon

5
19614.

Google

19614. 19614.
19614.