Human Generated Data

Title

Untitled (military man at podium, Ford banner behind)

Date

1946, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.150

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (military man at podium, Ford banner behind)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1946, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.4
Person 99.3
Person 99.3
Person 98.4
Person 98.3
Person 97.4
Crowd 97
Marching 91.2
People 83.3
Suit 77.4
Coat 77.4
Clothing 77.4
Overcoat 77.4
Apparel 77.4
Musical Instrument 76.1
Musician 76.1
Military 75.7
Music Band 74.8
Parade 73.1
Military Uniform 68.7
Person 68.1
Festival 61.2
Armored 60.5
Army 60.5
Troop 57.8
Person 56.4
Person 49.3

Imagga
created on 2022-01-08

ship 26.5
sky 21
city 20.8
architecture 20.3
brass 18.5
water 17.3
structure 17.1
industry 17.1
vessel 16.8
cornet 16.2
travel 16.2
industrial 15.4
building 15.3
tower 15.2
boat 15.1
battleship 14.6
sea 14.2
wind instrument 14
energy 12.6
old 12.5
warship 12.3
urban 12.2
musical instrument 11.8
factory 11.6
port 11.6
gas 11.5
harbor 11.5
tourism 11.5
landscape 11.1
chimney 10.8
river 10.7
pollution 10.6
buildings 10.4
technology 10.4
power 10.1
house 10
environment 9.9
transportation 9.9
summer 9.6
black 9.6
bridge 9.5
stage 9.2
ocean 9.1
history 8.9
fuel 8.7
platform 8.6
skyline 8.5
business 8.5
clouds 8.4
smoke 8.4
oil 8.4
exterior 8.3
silhouette 8.3
transport 8.2
dirty 8.1
equipment 8.1
metal 8
high 7.8
cruise 7.8
pipe 7.8
nautical 7.8
military vehicle 7.7
winter 7.7
window 7.5
vintage 7.4
famous 7.4
town 7.4
vacation 7.4
street 7.4
air 7.4
tourist 7.2
chairlift 7.2
landmark 7.2
scenery 7.2
snow 7.1
billboard 7.1
craft 7.1
steel 7.1

Google
created on 2022-01-08

Flag 83.1
Hat 76.8
Crew 74.4
Font 73.9
Fan 73.9
Event 72.6
Monochrome photography 67.1
Team 66.4
Motor vehicle 66.3
Pole 64.6
Rebellion 63
Monochrome 62.9
Stock photography 61.9
Crowd 61.7
Suit 61.6
History 61.5
Room 61.5
Vintage clothing 61.1
Art 61.1
T-shirt 60.5

Microsoft
created on 2022-01-08

text 98.7
person 88
group 85.9
clothing 84.7
posing 78.7
black and white 77.5
man 76.7
people 70

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 97.7%
Calm 57.1%
Sad 29%
Angry 5.3%
Confused 5.2%
Disgusted 1.2%
Surprised 1%
Fear 0.8%
Happy 0.5%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Calm 77.6%
Confused 9.4%
Sad 3.4%
Surprised 3%
Disgusted 2.4%
Angry 2.4%
Happy 0.9%
Fear 0.9%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 91.9%
Happy 4.7%
Surprised 1.2%
Angry 1%
Confused 0.6%
Sad 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 71.1%
Sad 22.5%
Surprised 2.4%
Disgusted 1%
Confused 0.8%
Angry 0.8%
Fear 0.8%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 68.2%
Surprised 10.3%
Fear 5.2%
Disgusted 5%
Sad 4.8%
Angry 3%
Confused 2.3%
Happy 1.4%

AWS Rekognition

Age 16-24
Gender Male, 99.7%
Calm 96.8%
Confused 1.6%
Happy 0.4%
Sad 0.4%
Angry 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 98.9%
Calm 92.4%
Sad 3%
Confused 2.6%
Angry 0.8%
Disgusted 0.5%
Surprised 0.2%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 98.9%
Surprised 0.4%
Happy 0.2%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 98.3%
Confused 0.6%
Angry 0.3%
Disgusted 0.2%
Sad 0.2%
Fear 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Calm 59.6%
Confused 28.6%
Sad 4.3%
Angry 3%
Disgusted 1.9%
Happy 0.9%
Fear 0.9%
Surprised 0.9%

AWS Rekognition

Age 12-20
Gender Female, 97.4%
Surprised 38.5%
Sad 25.9%
Fear 19.1%
Calm 7.6%
Disgusted 3.6%
Angry 3.3%
Happy 1.7%
Confused 0.3%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 84.4%
Angry 5.2%
Happy 4.2%
Disgusted 1.8%
Sad 1.3%
Fear 1.2%
Surprised 1.1%
Confused 0.8%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Disgusted 95.1%
Happy 2.2%
Sad 1.1%
Calm 0.6%
Angry 0.4%
Fear 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 14-22
Gender Male, 99.6%
Calm 71%
Confused 11.7%
Happy 6.2%
Fear 5.6%
Surprised 2%
Disgusted 1.9%
Angry 1%
Sad 0.5%

AWS Rekognition

Age 31-41
Gender Male, 98.2%
Calm 32.5%
Fear 24.7%
Happy 19.7%
Sad 14.8%
Angry 5%
Confused 1.2%
Surprised 1%
Disgusted 1%

AWS Rekognition

Age 10-18
Gender Female, 54.8%
Disgusted 47.1%
Confused 23%
Angry 11.8%
Calm 5.3%
Fear 4.9%
Surprised 4.3%
Sad 2.9%
Happy 0.8%

AWS Rekognition

Age 20-28
Gender Female, 93.5%
Sad 71.8%
Confused 9.8%
Calm 6.9%
Angry 4.7%
Disgusted 3.6%
Surprised 1.5%
Happy 0.9%
Fear 0.8%

AWS Rekognition

Age 10-18
Gender Male, 99.8%
Calm 64.7%
Fear 16%
Confused 5.7%
Surprised 5.5%
Sad 5.4%
Disgusted 1.2%
Happy 0.8%
Angry 0.7%

AWS Rekognition

Age 31-41
Gender Male, 99.6%
Happy 25.7%
Fear 24.6%
Disgusted 19%
Calm 17.3%
Confused 5.6%
Sad 3.6%
Surprised 3%
Angry 1.2%

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.6%
Suit 77.4%

Captions

Microsoft

a group of people posing for a photo 96.1%
a group of people posing for the camera 96%
a group of people posing for a picture 95.9%

Text analysis

Amazon

Ford

Google

Ford
Ford