Human Generated Data

Title

Untitled (group of men in cowboy hats standing in front of tall fence)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5476

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of men in cowboy hats standing in front of tall fence)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Person 99.5
Person 99.4
Person 99.2
Person 99.2
Person 97.4
Person 96.5
Person 96.4
Person 95.9
Person 95.9
Person 93.1
Outdoors 88.7
Nature 88.4
Advertisement 88.4
Poster 88.4
Person 83.7
Tree 77.6
Plant 77.6
Person 76.1
Snow 73.1
Art 71.9
Ice 71.2
People 68.3
Drawing 67.8
Sketch 58

Imagga
created on 2022-01-23

gravestone 55.9
memorial 47.3
newspaper 47
stone 36.2
product 36.1
grunge 35.8
vintage 33.1
old 32.8
structure 30.8
creation 28.9
daily 25.4
retro 24.6
texture 22.9
film 22.5
negative 22
black 21.6
antique 20.8
art 20.2
frame 20
paint 19
aged 19
grungy 19
ancient 18.2
border 18.1
pattern 17.8
wall 16.7
cemetery 16.4
dirty 16.3
city 15.8
paper 15.7
architecture 15.6
design 14.6
rough 14.6
text 14
space 14
sky 13.4
decoration 12.5
urban 12.2
drawing 12.1
color 11.7
rust 11.6
snow 11.5
decorative 10.9
stained 10.6
travel 10.6
dirt 10.5
canvas 10.4
landscape 10.4
building 10.4
scene 10.4
blank 10.3
graphic 10.2
material 9.8
noise 9.8
textured 9.6
edge 9.6
brown 9.6
damaged 9.5
weathered 9.5
construction 9.4
photographic paper 9.2
history 8.9
scratch 8.8
worn 8.6
business 8.5
house 8.4
letter 8.3
noisy 7.9
burned 7.8
torn 7.7
collage 7.7
aging 7.7
winter 7.7
buildings 7.6
historical 7.5
symbol 7.4
digital 7.3
landmark 7.2
gray 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.8
tree 63.9
old 51
stone 5.6

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 70.7%
Sad 24.8%
Confused 1.1%
Happy 1.1%
Angry 0.8%
Disgusted 0.8%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 34-42
Gender Male, 95.8%
Calm 82.6%
Happy 4.4%
Fear 3.8%
Surprised 3.6%
Disgusted 2.7%
Sad 1.2%
Confused 1%
Angry 0.7%

AWS Rekognition

Age 36-44
Gender Female, 83.8%
Calm 98.2%
Sad 0.9%
Fear 0.3%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 82.3%
Calm 86.7%
Confused 11.3%
Sad 1.1%
Happy 0.5%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 91.4%
Sad 6.1%
Angry 0.8%
Disgusted 0.5%
Confused 0.4%
Happy 0.4%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 67.2%
Calm 40%
Sad 24.4%
Disgusted 11.2%
Fear 10.6%
Happy 5.3%
Angry 4.6%
Confused 2.1%
Surprised 1.9%

AWS Rekognition

Age 25-35
Gender Female, 67.2%
Happy 73.6%
Calm 10%
Disgusted 8.7%
Sad 2.4%
Confused 1.8%
Angry 1.8%
Surprised 1.1%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Male, 98.6%
Calm 99.3%
Sad 0.3%
Happy 0.2%
Surprised 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 97.3%
Calm 93.6%
Disgusted 1.8%
Happy 1.7%
Sad 0.9%
Confused 0.7%
Angry 0.6%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 20-28
Gender Female, 96.8%
Calm 20.9%
Fear 20.1%
Happy 16.8%
Angry 15.1%
Disgusted 9.9%
Sad 8.2%
Surprised 6.4%
Confused 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 88.4%

Captions

Microsoft

a vintage photo of a person 58.6%
a vintage photo of a person 58.5%
a vintage photo of some sort 48.8%

Text analysis

Amazon

SARASOTA,
FLORIDA
26108A
STEINMETZ, SARASOTA, FLORIDA 26108A
STEINMETZ,
RODAK-EVEEIX

Google

26108 A. STEINMETZ, SARASOTA, FLORIDA 2610 BA.
STEINMETZ,
FLORIDA
2610
26108
A.
BA.
SARASOTA,