Human Generated Data

Title

Untitled (couple watches as man with camera reveals picture of couple)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7186
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple watches as man with camera reveals picture of couple)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 99
Clothing 97.7
Apparel 97.7
Face 77.5
Person 71.2
Photography 63.8
Photo 63.8
Portrait 63.8
People 63.6
Shorts 62.6
Female 58.8
Car 56.1
Transportation 56.1
Vehicle 56.1
Automobile 56.1
Hat 55.5

Imagga
created on 2022-01-08

bride 33.9
wedding 32.2
people 27.9
dress 24.4
groom 24.1
person 23.9
man 23.5
newspaper 22.7
adult 21
love 20.5
couple 17.4
product 17.3
married 17.3
happiness 16.5
male 16.3
marriage 15.2
clothing 14.7
sky 14.7
happy 14.4
celebration 14.4
creation 14
bouquet 14
gown 13.7
human 12.7
work 12.7
negative 12.3
two 11.9
ceremony 11.6
romantic 11.6
summer 11.6
together 11.4
flowers 11.3
portrait 11
smiling 10.8
veil 10.8
film 10.7
outdoor 10.7
one 10.4
outdoors 10.4
wife 10.4
event 10.2
romance 9.8
husband 9.8
cheerful 9.8
businessman 9.7
women 9.5
sitting 9.4
face 9.2
health 9
suit 9
sea 9
team 9
wed 8.8
lifestyle 8.7
party 8.6
men 8.6
daily 8.5
pair 8.5
clothes 8.4
joy 8.4
fashion 8.3
holding 8.3
freedom 8.2
fun 8.2
religion 8.1
toilet tissue 8
holiday 7.9
sand 7.8
beach 7.7
photographic paper 7.5
leisure 7.5
ocean 7.5
business 7.3
sexy 7.2
looking 7.2
active 7.2
smile 7.1
grass 7.1
day 7.1

Google
created on 2022-01-08

Hat 91.3
Motor vehicle 81
Vintage clothing 73.4
Monochrome photography 70.5
Room 67.6
Monochrome 67.4
Photo caption 65.7
Crew 62.6
Suit 62.4
Sitting 61.9
Font 61
Team 60.4
History 59.9
Classic 57.9
Photographic paper 57.2
Recreation 56.4
Personal protective equipment 54.9
Retro style 51.8
Advertising 50.6

Microsoft
created on 2022-01-08

text 98.6
person 96.7
man 94.5
black and white 88.8
clothing 78.2
posing 76.8
old 46.7

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 75.2%
Happy 44.5%
Fear 21.2%
Sad 19%
Surprised 6.8%
Calm 5.7%
Angry 1.1%
Disgusted 1%
Confused 0.8%

AWS Rekognition

Age 34-42
Gender Male, 99.6%
Sad 50.4%
Calm 33.3%
Confused 9.9%
Angry 2.2%
Happy 1.6%
Surprised 1.2%
Disgusted 0.9%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Car 56.1%

Captions

Microsoft

a man posing for a photo 91.1%
a man and woman posing for a photo 68.6%
a man and a woman posing for a photo 68.5%

Text analysis

Amazon

414
414 60.
60.