Human Generated Data

Title

Untitled (calesthenics, Camden, New Jersey)
Date

1941, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1029
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (calesthenics, Camden, New Jersey)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1029

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.4
Person 94.2
Person 94.1
Crowd 93.9
Shorts 90.7
Clothing 90.7
Apparel 90.7
Person 85.1
Festival 75.3
Parade 75.2
Person 74.8
People 73.9
Person 67.7
Person 65.5
Person 64
Audience 59.2
Text 59.1
Furniture 58.6

Clarifai
created on 2023-10-25

people 99.6
wear 95.2
group together 94.8
monochrome 93
many 92.6
group 91.1
flag 89.8
woman 88.9
adult 88.6
man 87.3
administration 87
art 73.4
crowd 73.1
retro 71.2
audience 70.6
street 69.7
portrait 67.4
design 66.8
girl 64.5
military 63.5

Imagga
created on 2022-01-08

clothing 28.3
swimsuit 27.7
garment 27
swimming trunks 23.6
covering 16.7
people 16.2
person 13.8
attractive 13.3
black 13.3
consumer goods 12.4
adult 12.3
sexy 12
body 12
flag 11.6
lifestyle 11.6
fashion 11.3
group 11.3
celebration 11.2
pedestrian 10.8
shop 10.6
fun 10.5
pretty 9.8
lady 9.7
style 9.6
crowd 9.6
women 9.5
party 9.4
color 9.4
sport 9.4
cute 9.3
emblem 9.1
interior 8.8
hands 8.7
brassiere 8.6
shoe shop 8.5
maillot 8.3
fit 8.3
cheerful 8.1
supporter 8.1
holiday 7.9
model 7.8
summer 7.7
decoration 7.7
shoes 7.7
healthy 7.6
legs 7.5
happy 7.5
human 7.5
man 7.4
many 7.4
fitness 7.2
art 7.2
male 7.1
travel 7

Google
created on 2022-01-08

Shorts 93.3
White 92.2
Black 89.8
Black-and-white 85.3
Style 84.1
Automotive design 81.2
T-shirt 79.1
Font 78.9
Art 73.8
Monochrome photography 72.5
Event 72.4
Monochrome 71.2
Pattern 70.5
Thigh 70.5
Sportswear 69.2
Team 68
Room 66.5
Visual arts 66.4
Human leg 64.5
Stock photography 63.5

Microsoft
created on 2022-01-08

person 97.6
outdoor 97.2
woman 91.6
text 85.8
clothing 79.3
black and white 60
flag 58.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 44.8%
Calm 40.7%
Happy 5.6%
Confused 3.1%
Angry 3.1%
Disgusted 1.3%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 59.6%
Calm 25.8%
Disgusted 7.4%
Angry 2.2%
Confused 2.2%
Sad 1.9%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Female, 85.6%
Sad 94.6%
Confused 2.6%
Disgusted 0.6%
Fear 0.6%
Calm 0.5%
Angry 0.5%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 23-33
Gender Female, 61.4%
Happy 93.8%
Calm 3.5%
Surprised 0.8%
Confused 0.6%
Sad 0.4%
Fear 0.3%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Female, 99.9%
Happy 42.3%
Sad 31.4%
Disgusted 13.2%
Calm 4%
Surprised 3%
Angry 2.5%
Fear 2.3%
Confused 1.2%

AWS Rekognition

Age 20-28
Gender Female, 99.8%
Calm 80.5%
Sad 17.7%
Confused 0.5%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 6-16
Gender Male, 99.5%
Happy 95.8%
Disgusted 1.1%
Fear 0.8%
Confused 0.7%
Calm 0.5%
Surprised 0.5%
Sad 0.3%
Angry 0.2%

AWS Rekognition

Age 22-30
Gender Female, 79.8%
Calm 70.3%
Confused 15.6%
Angry 5.6%
Surprised 2.6%
Sad 2.2%
Disgusted 1.7%
Fear 1.4%
Happy 0.7%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Happy 45.4%
Calm 16.6%
Disgusted 11.2%
Confused 8.9%
Surprised 5.9%
Fear 5.5%
Sad 4.1%
Angry 2.3%

AWS Rekognition

Age 23-33
Gender Female, 58.9%
Disgusted 99.8%
Calm 0.1%
Confused 0%
Fear 0%
Happy 0%
Angry 0%
Sad 0%
Surprised 0%

AWS Rekognition

Age 31-41
Gender Male, 94.7%
Calm 52.3%
Sad 20.2%
Happy 15.8%
Fear 4.8%
Confused 3.3%
Surprised 2%
Disgusted 0.9%
Angry 0.9%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Sad 66.1%
Disgusted 15.2%
Fear 8.8%
Angry 4.3%
Calm 2.3%
Happy 1.3%
Confused 1.3%
Surprised 0.7%

AWS Rekognition

Age 23-33
Gender Female, 99.3%
Happy 53.3%
Calm 15.2%
Fear 10%
Disgusted 7.7%
Surprised 5.2%
Angry 3.3%
Sad 3%
Confused 2.3%

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Happy 74%
Angry 12.1%
Disgusted 5%
Fear 3.3%
Surprised 3%
Confused 1.3%
Sad 0.7%
Calm 0.6%

AWS Rekognition

Age 36-44
Gender Female, 98.6%
Happy 48%
Calm 27.8%
Disgusted 6.2%
Sad 4.3%
Surprised 3.7%
Confused 3.6%
Fear 3.3%
Angry 3.1%

AWS Rekognition

Age 2-10
Gender Female, 76.2%
Happy 89.2%
Sad 5.4%
Disgusted 2.2%
Fear 1.1%
Angry 0.9%
Surprised 0.6%
Confused 0.4%
Calm 0.1%

AWS Rekognition

Age 20-28
Gender Male, 75.2%
Happy 64.2%
Calm 22.8%
Angry 3.6%
Sad 2.9%
Surprised 2.5%
Confused 1.7%
Fear 1.4%
Disgusted 0.9%

AWS Rekognition

Age 4-10
Gender Male, 100%
Angry 56.2%
Surprised 14.4%
Fear 7.3%
Disgusted 7%
Calm 5%
Sad 4.7%
Happy 3.1%
Confused 2.2%

AWS Rekognition

Age 20-28
Gender Female, 55.7%
Calm 81.2%
Happy 12.7%
Sad 2.9%
Fear 1.1%
Confused 0.7%
Disgusted 0.6%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 22-30
Gender Male, 77.6%
Calm 90.2%
Happy 3.2%
Surprised 2.1%
Fear 1.4%
Confused 1.2%
Disgusted 1%
Sad 0.6%
Angry 0.4%

AWS Rekognition

Age 20-28
Gender Female, 98.8%
Sad 90.1%
Angry 8.5%
Fear 0.8%
Happy 0.2%
Calm 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Happy 34.5%
Disgusted 31.7%
Calm 24.6%
Fear 2.4%
Surprised 2.4%
Angry 1.5%
Confused 1.5%
Sad 1.3%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Disgusted 66.2%
Happy 15.1%
Calm 8%
Sad 4.1%
Angry 2.5%
Confused 1.8%
Surprised 1.2%
Fear 1.2%

AWS Rekognition

Age 20-28
Gender Female, 100%
Disgusted 51.8%
Surprised 18%
Angry 15.9%
Sad 4.8%
Confused 3.9%
Calm 3.1%
Fear 1.3%
Happy 1%

AWS Rekognition

Age 23-31
Gender Female, 76.5%
Disgusted 48.8%
Sad 35.6%
Confused 7.1%
Calm 6.5%
Happy 0.8%
Fear 0.5%
Surprised 0.4%
Angry 0.2%

AWS Rekognition

Age 34-42
Gender Female, 99.8%
Happy 52.4%
Disgusted 29.5%
Calm 7.2%
Surprised 4.6%
Sad 2.6%
Confused 1.9%
Angry 1%
Fear 0.8%

AWS Rekognition

Age 23-33
Gender Female, 100%
Disgusted 89.6%
Happy 7%
Calm 1.4%
Sad 0.6%
Confused 0.6%
Angry 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 95.7%
Angry 75.6%
Happy 10.9%
Fear 4.5%
Sad 2.6%
Disgusted 2.6%
Surprised 1.7%
Confused 1.6%
Calm 0.6%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 96.3%
Calm 2.4%
Sad 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 13-21
Gender Female, 99.5%
Happy 38.7%
Sad 27.6%
Fear 9.8%
Calm 7%
Disgusted 5.7%
Confused 5.5%
Surprised 3.8%
Angry 1.9%

AWS Rekognition

Age 11-19
Gender Male, 99.7%
Calm 88.5%
Happy 7%
Sad 2.1%
Surprised 1.6%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 12-20
Gender Female, 100%
Fear 29.8%
Surprised 20.7%
Sad 18.4%
Happy 10.7%
Confused 10.3%
Disgusted 3.6%
Calm 3.2%
Angry 3.2%

AWS Rekognition

Age 23-31
Gender Female, 100%
Sad 99.2%
Disgusted 0.3%
Calm 0.2%
Happy 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Female, 96.8%
Happy 99.2%
Surprised 0.2%
Confused 0.1%
Calm 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Sad 86.2%
Happy 9.7%
Disgusted 1.3%
Angry 1.1%
Fear 0.7%
Calm 0.5%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 6-14
Gender Female, 98.3%
Happy 60.2%
Surprised 14.8%
Sad 8.7%
Confused 5.9%
Calm 5.1%
Angry 2.6%
Disgusted 1.5%
Fear 1.2%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 77.8%
Sad 13.6%
Confused 2.4%
Fear 2.2%
Surprised 1.9%
Disgusted 0.9%
Angry 0.8%
Calm 0.4%

AWS Rekognition

Age 20-28
Gender Male, 98.1%
Sad 84.3%
Calm 7.4%
Disgusted 3.8%
Surprised 1.5%
Angry 1.3%
Fear 0.8%
Happy 0.6%
Confused 0.4%

AWS Rekognition

Age 2-10
Gender Female, 64.9%
Sad 82.8%
Fear 8.8%
Calm 5.2%
Happy 1.2%
Angry 1%
Disgusted 0.3%
Surprised 0.3%
Confused 0.3%

AWS Rekognition

Age 12-20
Gender Male, 90.7%
Angry 46.3%
Calm 17.4%
Surprised 15.1%
Sad 8.6%
Confused 7.6%
Fear 2.7%
Disgusted 1.2%
Happy 1%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 76.5%
Angry 11.3%
Disgusted 4.4%
Confused 4.4%
Happy 2.2%
Sad 0.6%
Surprised 0.5%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.7%
Sad 43.7%
Angry 40.6%
Fear 8.8%
Disgusted 2.3%
Calm 1.4%
Confused 1.4%
Surprised 1.2%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Male, 99.1%
Sad 48.8%
Confused 24%
Fear 18.5%
Calm 4.8%
Surprised 1.9%
Disgusted 0.9%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 75.1%
Sad 95.7%
Fear 1.4%
Angry 1.3%
Calm 0.7%
Happy 0.3%
Disgusted 0.2%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Female, 90.4%
Fear 99.5%
Sad 0.3%
Angry 0.1%
Calm 0%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 2-8
Gender Female, 99.4%
Happy 96.8%
Sad 1.3%
Angry 0.5%
Disgusted 0.5%
Calm 0.4%
Confused 0.3%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 2-10
Gender Male, 93.5%
Angry 51.2%
Confused 19.1%
Fear 7.8%
Sad 7.4%
Calm 7.4%
Happy 3.5%
Surprised 2.2%
Disgusted 1.4%

AWS Rekognition

Age 21-29
Gender Female, 82.9%
Sad 51.9%
Calm 29.8%
Fear 8.4%
Angry 5.2%
Happy 2.2%
Surprised 1.4%
Disgusted 0.9%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Female, 99.9%
Happy 38.9%
Fear 13.8%
Calm 13.2%
Surprised 9.3%
Angry 7.5%
Confused 6.8%
Disgusted 5.9%
Sad 4.5%

AWS Rekognition

Age 21-29
Gender Female, 85.4%
Sad 35%
Happy 24.8%
Calm 17.6%
Fear 11.5%
Disgusted 4.1%
Angry 3.5%
Confused 1.9%
Surprised 1.7%

AWS Rekognition

Age 19-27
Gender Male, 76.6%
Calm 56.4%
Sad 22.7%
Fear 12.4%
Confused 2.4%
Disgusted 2.1%
Angry 1.8%
Happy 1.3%
Surprised 0.8%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft
created on 2022-01-08

a woman posing for a picture 92.6%
a woman posing for a photo 86.4%
a group of people posing for the camera 73.3%

Text analysis

Amazon

MERICA
B

Google

UERICA
UERICA