Human Generated Data

Title

Untitled (people wearing matching hats among larger crowd)

Date

1917

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11754

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people wearing matching hats among larger crowd)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1917

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Apparel 93.6
Clothing 93.6
Plant 91.3
Person 81
Human 81
Hat 74.6
Rug 73.7
Person 72.7
Petal 71.8
Flower 71.8
Blossom 71.8
Sunglasses 70
Accessory 70
Accessories 70
Crowd 68.8
Painting 66.3
Art 66.3
People 65.3
Tree 63.4
Girl 61.1
Female 61.1
Leaf 61.1
Vegetation 57.7
Kid 56.3
Child 56.3
Photography 55.9
Photo 55.9
Ivy 55.1
Person 54.7
Person 44.3

Imagga
created on 2022-01-15

texture 38.2
pattern 37.6
surface 32.6
rough 31
sunglasses 30.4
colorful 27.9
retro 27.9
art 27.1
wallpaper 26.8
seamless 26.6
circles 25.9
grain 25.8
colors 25.6
visual 25.1
floral 24.7
unique 24.7
spectacles 24.6
vibrant 24.5
contemporary 24.4
squares 23.4
lines 23.4
plants 23.2
diagram 23
progressive 22.6
graphic 22.6
flowers 22.6
figures 22.2
conceptual 21.2
modern 21
design 19.7
plant 19.6
optical instrument 18.6
flower 18.5
mosaic 16.8
fresh 16.3
glass 15.2
grunge 12.8
patterns 12.3
transducer 11.9
old 11.8
shoe shop 11.3
shiny 11.1
shower curtain 11
black 10.8
backgrounds 10.5
metal 10.5
textured 9.6
backdrop 9.1
device 9
electrical device 9
shape 8.9
shop 8.8
wall 8.8
curtain 8.7
motif 8.6
tile 8.5
container 8.3
gray 8.1
detail 8
close 8
covering 7.9
vintage 7.7
grungy 7.6
canvas 7.6
dark 7.5
many 7.4
industrial 7.3
furnishing 7.2
paper 7.1
silver 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

black and white 81.1
white 78.9
text 73
black 65.3
leaf 60.4
monochrome 54.9
posing 36.7
crowd 28.8

Face analysis

Amazon

AWS Rekognition

Age 33-41
Gender Female, 91.4%
Calm 97.4%
Disgusted 1.2%
Sad 0.6%
Happy 0.4%
Surprised 0.3%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 36-44
Gender Male, 97.7%
Calm 90.7%
Happy 8%
Confused 0.4%
Fear 0.2%
Sad 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 48-56
Gender Male, 95.5%
Calm 52.5%
Surprised 20.7%
Happy 16.5%
Sad 4.6%
Angry 2.1%
Disgusted 1.7%
Fear 1.1%
Confused 0.8%

AWS Rekognition

Age 31-41
Gender Male, 95.7%
Calm 88.4%
Angry 3.8%
Happy 3.7%
Surprised 1.2%
Sad 1%
Disgusted 1%
Confused 0.7%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 69.6%
Sad 90.5%
Calm 4.4%
Happy 3.3%
Disgusted 0.6%
Fear 0.4%
Surprised 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 83.7%
Sad 5.1%
Confused 4.8%
Happy 3%
Disgusted 1%
Surprised 1%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 20-28
Gender Male, 55%
Sad 48.9%
Calm 26.6%
Happy 18%
Fear 2.6%
Angry 1.2%
Surprised 1%
Confused 0.8%
Disgusted 0.8%

AWS Rekognition

Age 22-30
Gender Female, 87.7%
Sad 54%
Happy 18.8%
Calm 11.4%
Fear 7.2%
Angry 3%
Disgusted 2.6%
Confused 2.1%
Surprised 1%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Angry 40.5%
Sad 24.6%
Calm 18.7%
Confused 9.6%
Surprised 2.4%
Disgusted 2.3%
Happy 1.1%
Fear 0.7%

AWS Rekognition

Age 39-47
Gender Male, 66.6%
Calm 29.7%
Sad 26.1%
Happy 16%
Confused 13.1%
Angry 8.3%
Disgusted 2.8%
Fear 2.1%
Surprised 1.9%

AWS Rekognition

Age 31-41
Gender Male, 87.4%
Calm 32.1%
Sad 27.7%
Angry 22.7%
Fear 5.4%
Happy 4.6%
Surprised 3.5%
Confused 2.7%
Disgusted 1.3%

AWS Rekognition

Age 48-54
Gender Male, 99.1%
Calm 58%
Happy 38.1%
Disgusted 1.2%
Sad 1.1%
Surprised 0.6%
Angry 0.5%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 43-51
Gender Male, 95.2%
Surprised 52.3%
Calm 37.9%
Happy 2.2%
Fear 2.1%
Sad 2%
Angry 1.4%
Disgusted 1.1%
Confused 1%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 96.2%
Happy 3.5%
Sad 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 93.2%
Happy 74.9%
Calm 9.3%
Sad 6.6%
Confused 5.8%
Surprised 1.1%
Fear 0.9%
Angry 0.7%
Disgusted 0.7%

Feature analysis

Amazon

Person 81%
Hat 74.6%
Rug 73.7%
Painting 66.3%

Captions

Microsoft

a group of people posing for a photo in front of a crowd 86.9%
a group of people posing for a photo 83.4%
a group of people posing for the camera 83.3%

Text analysis

Amazon

5