Human Generated Data

Title

Untitled (man flipping off springboard in gymnasium)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7649
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man flipping off springboard in gymnasium)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Water 98.8
Person 83.9
Sport 83.2
Sports 83.2
Person 80
Shorts 79.8
Clothing 79.8
Apparel 79.8
Person 77.3
Diving 73.9
Diver 73.9
Person 70.9
Person 69.6
Person 66.5
Person 60.9
Swimming 60.4
Person 58.3
Person 44.1

Imagga
created on 2022-01-08

billboard 24.1
windshield 24
silhouette 21.5
screen 20.3
signboard 19.5
structure 17.9
man 17.5
people 17.3
freight car 17.3
sky 16.6
vehicle 16
car 15.6
wheeled vehicle 15.2
protective covering 15.1
black 14.4
travel 14.1
water 13.3
landscape 12.6
male 12.1
person 11.9
sunset 11.7
adult 11.7
sun 11.3
sea 10.9
light 10.7
scene 10.4
women 10.3
covering 10.1
transportation 9.9
dance 9.5
color 9.4
lifestyle 9.4
sport 9.3
dark 9.2
business 9.1
one 9
technology 8.9
style 8.9
old 8.4
vintage 8.3
tourism 8.2
outdoors 8.2
equipment 8.2
night 8
summer 7.7
grunge 7.7
disk jockey 7.6
hand 7.6
human 7.5
city 7.5
ocean 7.5
transport 7.3
body 7.2
activity 7.2
work 7.1

Google
created on 2022-01-08

Black-and-white 84.3
Style 84
Art 82.6
Performing arts 78.5
Monochrome photography 74.4
Entertainment 74.1
Monochrome 73.4
Event 73.1
Sports 69.5
Recreation 66.3
Stock photography 64.2
Font 62.6
Room 62.4
Visual arts 60.9
Stunt 59.6
Performance art 59.3
Individual sports 58.1
Suit 56.2
Illustration 55.8
Street stunts 54.8

Microsoft
created on 2022-01-08

text 99.2
dance 73.7
skateboard 69.1
black and white 62.8
person 50.7

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 54.5%
Calm 99.3%
Happy 0.3%
Surprised 0.2%
Sad 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Calm 79.7%
Sad 12.5%
Confused 2.6%
Happy 1.6%
Surprised 1.1%
Fear 0.9%
Disgusted 0.9%
Angry 0.7%

AWS Rekognition

Age 18-24
Gender Male, 85.6%
Calm 78.4%
Sad 10.1%
Fear 8.8%
Happy 0.9%
Disgusted 0.7%
Confused 0.5%
Angry 0.4%
Surprised 0.2%

AWS Rekognition

Age 34-42
Gender Male, 96.2%
Sad 77%
Angry 10.1%
Confused 6.4%
Calm 3.2%
Disgusted 1.3%
Fear 1.2%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 16-22
Gender Male, 70.3%
Calm 60.5%
Sad 34.8%
Disgusted 1.5%
Angry 1.3%
Surprised 0.5%
Confused 0.5%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Female, 98%
Calm 88.6%
Sad 4.2%
Happy 2.6%
Angry 1.9%
Disgusted 1.1%
Fear 0.9%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 4-10
Gender Female, 93.3%
Fear 46.5%
Calm 24.4%
Sad 16.2%
Happy 4.6%
Angry 2.6%
Surprised 2.1%
Confused 2%
Disgusted 1.6%

AWS Rekognition

Age 16-24
Gender Female, 89.2%
Calm 80.4%
Happy 16.8%
Sad 0.9%
Confused 0.6%
Angry 0.6%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 96.6%
Calm 85.5%
Sad 13.1%
Confused 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 4-12
Gender Female, 89.2%
Calm 82.6%
Sad 4.8%
Happy 4.7%
Fear 4.5%
Disgusted 1.3%
Angry 0.9%
Confused 0.9%
Surprised 0.4%

AWS Rekognition

Age 14-22
Gender Female, 74.9%
Sad 95.5%
Calm 2.3%
Angry 0.6%
Confused 0.4%
Fear 0.4%
Disgusted 0.3%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 28-38
Gender Male, 84.8%
Calm 86.7%
Sad 7.2%
Happy 3.3%
Confused 1.2%
Angry 0.7%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 33-41
Gender Male, 97.5%
Calm 64.3%
Happy 14.1%
Sad 9.2%
Angry 4.9%
Disgusted 4.1%
Confused 1.7%
Surprised 0.9%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 67.9%
Calm 97.1%
Happy 1.2%
Sad 1.1%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 57.7%
Calm 82.9%
Sad 8.2%
Happy 3.6%
Angry 2.4%
Confused 1%
Fear 0.9%
Disgusted 0.7%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Female, 98.6%
Calm 33.1%
Sad 31%
Disgusted 10.6%
Confused 6.5%
Surprised 6.2%
Fear 5.9%
Angry 3.4%
Happy 3.2%

AWS Rekognition

Age 19-27
Gender Female, 79.3%
Calm 96.2%
Happy 2.3%
Sad 0.9%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a person standing in front of a building 84.5%
a group of people standing in front of a building 83.5%
a person that is standing in front of a building 80.5%

Text analysis

Amazon

28465
69133
YT37A2-MAOOX

Google

846 . 28465.
846
.
28465.