Human Generated Data

Title

Untitled (crowd of people wearing matching hats)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10559
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people wearing matching hats)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.7
Human 98.7
Person 98.5
Person 97.9
Crowd 97.4
Audience 97.4
Person 95.1
Person 86.5
Clothing 83.7
Apparel 83.7
People 79.8
Person 79.1
Person 76
Person 68.1
Coat 67.8
Person 66
Person 60.8
Person 44.8

Imagga
created on 2022-01-09

curtain 100
shower curtain 100
blind 85.8
furnishing 85.5
protective covering 57.7
covering 29.6
texture 22.9
pattern 20.5
art 16.9
wallpaper 15.3
design 14.6
glass 14.6
grunge 14.5
black 13.8
surface 13.2
colorful 12.9
material 11.6
colors 11.5
graphic 10.9
rough 10.9
retro 10.6
textured 10.5
old 10.4
floral 10.2
plants 10.2
seamless 9.5
structure 9.2
dark 9.2
decoration 9
light 8.7
flower 8.5
city 8.3
grain 8.3
backdrop 8.2
vibrant 7.9
fresh 7.8
wall 7.8
flowers 7.8
modern 7.7
clothing 7.6
unique 7.6
vintage 7.4
shop 7.3
shoe shop 7.2
fantasy 7.2

Google
created on 2022-01-09

Black-and-white 83.3
Adaptation 79.3
Art 74.9
Monochrome photography 73.2
Monochrome 73
Event 72.2
Crowd 68.3
Room 66.7
Vintage clothing 63
Illustration 62.2
Team 61.7
History 60.6
Photographic paper 55.9
Still life photography 52.7
Audience 51.1

Microsoft
created on 2022-01-09

person 99.3
text 94
outdoor 93.4
clothing 89.1
posing 88.8
man 87.1
group 76.1
player 73.5
white 71.1
people 70.6
woman 53.6
crowd 28
female 27

Face analysis

Amazon

AWS Rekognition

Age 23-31
Gender Male, 96.4%
Calm 83.4%
Sad 7.5%
Happy 3.5%
Confused 1.8%
Angry 1.2%
Disgusted 1.1%
Fear 1%
Surprised 0.5%

AWS Rekognition

Age 33-41
Gender Female, 57.8%
Calm 40.3%
Disgusted 25.5%
Sad 21.9%
Fear 4.5%
Surprised 3.7%
Angry 2.9%
Happy 0.8%
Confused 0.6%

AWS Rekognition

Age 48-56
Gender Male, 99.2%
Calm 100%
Sad 0%
Angry 0%
Happy 0%
Disgusted 0%
Surprised 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 35-43
Gender Female, 97.1%
Calm 75.5%
Confused 8.9%
Angry 6.4%
Surprised 5.5%
Sad 1.4%
Fear 1%
Disgusted 0.8%
Happy 0.5%

AWS Rekognition

Age 45-53
Gender Male, 87.1%
Calm 92.2%
Sad 3.4%
Fear 1.3%
Surprised 1%
Confused 0.8%
Happy 0.8%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 18-26
Gender Female, 50.2%
Fear 89.6%
Happy 5.1%
Calm 3.2%
Sad 1.1%
Disgusted 0.4%
Surprised 0.3%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 99.4%
Sad 0.4%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 41-49
Gender Male, 92.1%
Calm 58.8%
Sad 31.8%
Fear 4.8%
Happy 1.4%
Angry 1.2%
Disgusted 0.7%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Female, 58.2%
Sad 93.6%
Calm 2.8%
Fear 1.9%
Confused 0.7%
Surprised 0.4%
Disgusted 0.3%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Female, 69.4%
Calm 86.9%
Sad 10.2%
Surprised 1.3%
Happy 0.9%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 41-49
Gender Female, 53.4%
Calm 97.9%
Sad 1%
Fear 0.4%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Female, 65.2%
Calm 87.5%
Fear 6.4%
Sad 2.8%
Surprised 0.9%
Happy 0.7%
Disgusted 0.6%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Female, 88.3%
Calm 85.9%
Sad 13.2%
Fear 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 34-42
Gender Male, 60%
Calm 99.6%
Surprised 0.2%
Fear 0.1%
Happy 0%
Disgusted 0%
Angry 0%
Sad 0%
Confused 0%

AWS Rekognition

Age 24-34
Gender Female, 57.5%
Calm 84.6%
Surprised 8.1%
Fear 2.2%
Confused 1.8%
Sad 1.3%
Happy 1%
Disgusted 0.5%
Angry 0.5%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 59.7%
Confused 14.6%
Fear 10.6%
Surprised 8%
Sad 2.5%
Disgusted 1.8%
Angry 1.6%
Happy 1.2%

AWS Rekognition

Age 23-33
Gender Male, 95.9%
Calm 96.7%
Happy 2.4%
Sad 0.5%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 92.1%
Calm 86.8%
Surprised 4.9%
Sad 2.7%
Happy 1.7%
Confused 1.5%
Fear 1.1%
Disgusted 0.7%
Angry 0.5%

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Calm 64.7%
Happy 11.5%
Sad 8.8%
Fear 6.9%
Disgusted 4.1%
Confused 1.8%
Surprised 1.5%
Angry 0.7%

AWS Rekognition

Age 19-27
Gender Male, 92%
Calm 99.8%
Happy 0.1%
Sad 0.1%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 97.5%
Calm 78.8%
Fear 6.5%
Happy 4.6%
Sad 3.4%
Angry 2.7%
Disgusted 2.5%
Confused 0.8%
Surprised 0.7%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Sad 37.6%
Fear 28.8%
Confused 19.7%
Calm 5.5%
Angry 3.1%
Surprised 2.7%
Disgusted 1.8%
Happy 0.7%

AWS Rekognition

Age 40-48
Gender Female, 53.3%
Surprised 42.8%
Fear 37.9%
Calm 12.7%
Sad 2.1%
Confused 1.5%
Disgusted 1.2%
Angry 1.2%
Happy 0.7%

AWS Rekognition

Age 29-39
Gender Male, 99.4%
Calm 65.7%
Fear 33.3%
Surprised 0.3%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0%

AWS Rekognition

Age 18-24
Gender Female, 72.8%
Fear 52.4%
Happy 15.5%
Calm 15%
Confused 7.4%
Surprised 3.8%
Sad 2.5%
Angry 1.7%
Disgusted 1.7%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 50.4%
Sad 27.1%
Disgusted 11%
Confused 3.6%
Surprised 3.5%
Angry 2.5%
Fear 0.9%
Happy 0.9%

AWS Rekognition

Age 28-38
Gender Female, 66.4%
Calm 82.2%
Sad 7%
Surprised 2.8%
Fear 2.6%
Happy 2.3%
Confused 2.1%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 24-34
Gender Female, 77.1%
Happy 77.7%
Surprised 10.2%
Calm 5.5%
Fear 3.1%
Angry 1.4%
Disgusted 1%
Sad 0.7%
Confused 0.5%

AWS Rekognition

Age 27-37
Gender Male, 59.5%
Fear 65%
Calm 30.9%
Surprised 1.9%
Sad 0.8%
Confused 0.8%
Happy 0.3%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 83.7%
Happy 36%
Angry 27.8%
Confused 11.4%
Fear 6.4%
Disgusted 6.1%
Surprised 4.8%
Calm 3.9%
Sad 3.6%

AWS Rekognition

Age 23-33
Gender Male, 94.9%
Calm 93.5%
Sad 2.5%
Surprised 1.6%
Fear 1.4%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 94%
Calm 97.1%
Happy 1.3%
Confused 0.8%
Sad 0.3%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Fear 97.5%
Calm 1.2%
Surprised 0.3%
Happy 0.3%
Sad 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Fear 47.3%
Calm 43.1%
Angry 4.1%
Happy 2%
Sad 1.4%
Surprised 0.9%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Sad 31.8%
Fear 28.2%
Disgusted 10.6%
Happy 10.5%
Calm 8.6%
Angry 4.8%
Confused 2.9%
Surprised 2.5%

AWS Rekognition

Age 7-17
Gender Male, 95.5%
Calm 93.4%
Fear 2.6%
Sad 1.8%
Angry 1.2%
Disgusted 0.4%
Surprised 0.3%
Happy 0.3%
Confused 0.1%

AWS Rekognition

Age 45-53
Gender Male, 98.5%
Calm 89.6%
Happy 6%
Fear 1.4%
Angry 1.3%
Sad 0.7%
Surprised 0.5%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Male, 89.5%
Calm 75.3%
Surprised 15.9%
Confused 3.5%
Happy 3.1%
Disgusted 0.8%
Angry 0.7%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 60.8%
Happy 18.6%
Fear 9.4%
Sad 6%
Disgusted 2.1%
Confused 1.4%
Surprised 0.9%
Angry 0.8%

AWS Rekognition

Age 48-56
Gender Male, 94.9%
Calm 98.9%
Happy 0.4%
Sad 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 11-19
Gender Male, 99.8%
Calm 48%
Happy 34.6%
Sad 10.5%
Confused 2.5%
Fear 2.2%
Surprised 0.9%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 36-44
Gender Male, 71.8%
Sad 64.4%
Calm 29.3%
Happy 2.1%
Fear 1.4%
Confused 1.2%
Disgusted 0.7%
Angry 0.5%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Male, 93%
Calm 96.5%
Sad 2.6%
Happy 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 58.9%
Calm 43.7%
Happy 26.9%
Fear 15.1%
Confused 5.8%
Disgusted 2.3%
Surprised 2.3%
Sad 2.3%
Angry 1.6%

AWS Rekognition

Age 27-37
Gender Male, 97.4%
Happy 32.9%
Calm 20.1%
Surprised 18%
Fear 9.6%
Angry 8.5%
Sad 7.1%
Disgusted 2.5%
Confused 1.3%

AWS Rekognition

Age 24-34
Gender Female, 85.4%
Calm 54.7%
Sad 13.4%
Happy 11.4%
Disgusted 7.4%
Fear 6.8%
Confused 2.5%
Surprised 2%
Angry 1.9%

AWS Rekognition

Age 16-22
Gender Male, 99.4%
Calm 95.4%
Happy 3%
Surprised 0.4%
Sad 0.4%
Disgusted 0.3%
Angry 0.3%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Male, 99.4%
Fear 62.2%
Calm 32.8%
Happy 2.5%
Sad 1.7%
Angry 0.3%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 45-51
Gender Male, 98.4%
Calm 53.7%
Sad 41.1%
Confused 3.2%
Fear 0.6%
Disgusted 0.5%
Happy 0.4%
Angry 0.3%
Surprised 0.3%

AWS Rekognition

Age 31-41
Gender Male, 95.1%
Calm 97.7%
Sad 0.6%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%
Fear 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 94.7%
Fear 61.2%
Calm 13.1%
Sad 8.8%
Surprised 6.8%
Disgusted 3.6%
Angry 2.6%
Happy 2.1%
Confused 1.7%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 95.2%
Surprised 1.6%
Confused 1.3%
Disgusted 0.7%
Happy 0.4%
Angry 0.3%
Sad 0.3%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 90%
Calm 74.3%
Sad 17.9%
Surprised 2.9%
Happy 1.8%
Fear 1%
Disgusted 0.8%
Confused 0.8%
Angry 0.4%

AWS Rekognition

Age 12-20
Gender Male, 99.8%
Happy 59.9%
Calm 31.6%
Sad 2.4%
Surprised 2.3%
Fear 1.1%
Confused 1%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Fear 75.3%
Calm 15.8%
Sad 4.5%
Happy 2.7%
Angry 0.9%
Disgusted 0.4%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Female, 97.4%
Calm 28%
Disgusted 26.1%
Happy 15.7%
Sad 10%
Angry 8.6%
Confused 6.6%
Surprised 3.1%
Fear 2%

AWS Rekognition

Age 11-19
Gender Male, 93%
Calm 74.4%
Disgusted 12.3%
Angry 5.2%
Confused 3.1%
Sad 2.4%
Happy 1.1%
Surprised 0.8%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 58.1%
Sad 39%
Calm 35.3%
Fear 7.9%
Confused 5.2%
Disgusted 4.1%
Surprised 3.3%
Happy 2.9%
Angry 2.4%

AWS Rekognition

Age 25-35
Gender Male, 97.7%
Fear 80%
Calm 12.5%
Sad 2.9%
Angry 1.5%
Disgusted 1.3%
Happy 0.8%
Surprised 0.6%
Confused 0.4%

AWS Rekognition

Age 13-21
Gender Male, 96.7%
Fear 84.9%
Sad 3.9%
Happy 3.9%
Calm 3.7%
Surprised 1.2%
Disgusted 0.9%
Angry 0.7%
Confused 0.7%

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 94.3%
a group of people posing for a photo in front of a crowd 94.2%
a group of people in front of a crowd posing for the camera 94.1%

Text analysis

Amazon

20845
20843.

Google

20845.
20845.