Human Generated Data

Title

Untitled (men and women sitting on bench watching couples square dance)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7065
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women sitting on bench watching couples square dance)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.6
Human 99.6
Person 99.5
Person 99.3
Person 99.2
Person 99.1
Person 98.9
Person 98.7
Person 98.1
Person 98.1
Person 96.2
Person 91.2
Person 82.5
Indoors 75.5
Room 75.5
Clinic 71.1
People 68.8
Nature 68.3
Outdoors 66.1
Person 65.9

Imagga
created on 2021-12-15

people 16.2
business 15.8
man 15.1
art 14.6
film 13.8
x-ray film 12.1
male 12
men 12
history 11.6
equipment 11.2
person 11
black 10.2
television 10.1
old 9.7
group 9.7
technology 9.6
glass 9.4
adult 9.3
photographic paper 9.2
modern 9.1
silhouette 9.1
businessman 8.8
symbol 8.7
lab 8.7
couple 8.7
women 8.7
chemistry 8.7
love 8.7
laboratory 8.7
house 8.4
groom 8.2
happy 8.1
light 8
life 8
office 8
home 8
medical 7.9
bride 7.9
day 7.8
chemical 7.8
container 7.7
research 7.6
biology 7.6
historical 7.5
city 7.5
water 7.3
decoration 7.3
design 7.3
celebration 7.2
table 7.1
interior 7.1

Google
created on 2021-12-15

Black-and-white 84.4
Font 82
Adaptation 79.4
Tints and shades 76
Monochrome photography 75.9
Monochrome 75.4
Art 74.1
Event 72.2
Room 70.6
History 64.9
Stock photography 63
Photographic paper 60.8
Photo caption 59.5
Rectangle 56.4
Sitting 55.4
Visual arts 55.1
Vintage clothing 52.2

Microsoft
created on 2021-12-15

text 99.4
person 88.9
clothing 87.6
indoor 85.9
wedding dress 84.9
bride 68
wedding 63.4
black and white 61
man 52.2
woman 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 47-65
Gender Male, 82.6%
Happy 53.9%
Calm 30.4%
Sad 13.4%
Confused 1.1%
Angry 0.5%
Surprised 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 41-59
Gender Male, 81.6%
Happy 86.1%
Calm 5.8%
Sad 4.3%
Surprised 1.6%
Confused 1.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people in front of a window 33.9%
a group of people standing in front of a window 32.3%
a man standing in front of a window 32.2%

Text analysis

Amazon

KEY,
SIESTA
J.
YOUR
FOR
TO
NOT
ANY
TO PROVIDE
HORSES
DO
PROVIDE
USE DO NOT ASSURE ANY
22183
USE
J. J. STEINMETZ. SIESTA KEY, SARASOTA,-FLA.
edga
SAFE HORSES FOR YOUR
ASSURE
ishoes edga
SARASOTA,-FLA.
STEINMETZ.
ACCP
20*
ishoes
SAFE
YAGOY

Google

TO
SARASOTA,
SAF
J.
MCNRDLINORGD TO PROVID SAF U USE 22183. J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
USE
U
22183.
STEINMETZ,
SIESTA
KEY,
MCNRDLINORGD
PROVID
FLA.