Human Generated Data

Title

Untitled (couple posing on lawn with adirondack chairs)
Date

c. 1970
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11588
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple posing on lawn with adirondack chairs)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 99.5
Clothing 99.1
Apparel 99.1
Shoe 95.5
Footwear 95.5
Person 94.8
Person 92.3
Shorts 91.7
Outdoors 90.7
Dress 90.3
Nature 90.2
Person 90.2
Bench 89.9
Furniture 89.9
Female 89
Face 85.4
Tree 75.3
Plant 75.3
Woman 73.8
Chair 72.6
Portrait 71.1
Photography 71.1
Photo 71.1
Shoe 70.6
People 67.5
Grass 67.2
Person 66.5
Suit 66.2
Coat 66.2
Overcoat 66.2
Pants 64.8
Weather 64.3
Girl 64.3
Person 61.7
Person 61
Kid 60.2
Child 60.2
Shirt 58.7
Person 57.8
Vehicle 57.4
Transportation 57.4
Water 57.1
Standing 55.7
Sailor Suit 55.5

Imagga
created on 2022-01-15

brass 27.3
wind instrument 24.3
person 21.2
sky 19.8
man 19.5
male 19.2
people 17.9
sunset 17.1
musical instrument 16.8
beach 16.2
summer 15.4
dancer 15.3
silhouette 14.9
outdoors 13.5
landscape 13.4
sea 13.3
bugle 13.2
performer 12.7
water 12.7
adult 12.5
ocean 12.4
field 11.7
outdoor 11.5
stage 11.4
trombone 11.4
sport 11.4
sand 11
sun 10.5
outside 10.3
entertainer 9.6
grass 9.5
men 9.4
clouds 9.3
player 9.3
platform 9.2
travel 9.2
old 8.4
dark 8.4
light 8.3
billboard 8.2
athlete 8.2
device 8.2
danger 8.2
cornet 8
flag 7.9
happiness 7.8
standing 7.8
scene 7.8
cloud 7.7
sunny 7.7
structure 7.7
dusk 7.6
relax 7.6
happy 7.5
world 7.5
evening 7.5
park 7.4
freedom 7.3
active 7.3
protection 7.3
suit 7.2
coast 7.2
holiday 7.2
professional 7.1
sunlight 7.1
love 7.1
businessman 7.1

Google
created on 2022-01-15

Black-and-white 84.2
Font 79.6
Adaptation 79.3
Rectangle 78
Art 77.8
Tints and shades 77.3
Monochrome photography 75.3
Monochrome 74.3
Tree 73.2
Room 69.7
Visual arts 68.1
Vintage clothing 67.8
Painting 65.9
Picture frame 65.8
Photographic paper 61.3
History 57.9
Illustration 56.2
Paper product 54.9
Suit 52.3

Microsoft
created on 2022-01-15

text 99.8
outdoor 94.3
old 68.1
water 66.8
sky 62.3
posing 54.9
vintage 28

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 83.3%
Happy 99.2%
Calm 0.5%
Surprised 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 81.2%
Calm 61.1%
Happy 19.8%
Surprised 8%
Sad 4.5%
Confused 2.3%
Fear 1.7%
Disgusted 1.7%
Angry 0.9%

AWS Rekognition

Age 16-22
Gender Male, 93.3%
Calm 80.7%
Happy 8.6%
Angry 6.9%
Sad 1.6%
Confused 1.1%
Fear 0.5%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Female, 93.7%
Happy 95.3%
Calm 4%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 95.5%
Bench 89.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 78.9%
a vintage photo of a group of people posing for a picture 78.8%
a vintage photo of a group of people posing for a photo 76.8%

Text analysis

Amazon

KAI
ALDHA KAI
ALDHA
66419

Google

ALOHA KAI
ALOHA
KAI