Human Generated Data

Title

Untitled (couple eating cotton candy in front of vendor)

Date

1952

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4671

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple eating cotton candy in front of vendor)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.8
Human 99.8
Person 99.6
Clothing 95.9
Apparel 95.9
Face 86.8
Female 80.1
Transportation 74.2
Train 74.2
Vehicle 74.2
Pants 69.7
Portrait 66.6
Photo 66.6
Photography 66.6
Girl 64
People 62.8
Shorts 61.8
Costume 59
Woman 57.6
Kiosk 55.4

Imagga
created on 2021-12-14

nurse 33.3
people 29.6
man 28.9
person 27.3
adult 26.7
male 25.6
groom 23.7
patient 22
hospital 21.8
couple 20.9
dress 18.1
happiness 18
women 17.4
smiling 17.4
men 17.2
bride 16.5
business 16.4
case 16.1
life 15.9
indoors 15.8
professional 15.5
work 15
portrait 14.9
wedding 14.7
happy 14.4
two 14.4
smile 14.2
love 13.4
family 13.3
businessman 13.2
suit 12.6
sick person 12.5
married 12.5
together 12.3
corporate 12
businesswoman 11.8
office 11.3
interior 10.6
modern 10.5
building 10.5
world 10.4
home 10.4
lifestyle 10.1
attractive 9.8
health 9.7
medical 9.7
standing 9.6
marriage 9.5
doctor 9.4
occupation 9.2
room 9.1
pretty 9.1
holding 9.1
human 9
cheerful 8.9
job 8.8
veil 8.8
medicine 8.8
day 8.6
bouquet 8.5
executive 8.3
attendant 8.2
worker 8.2
mother 7.9
child 7.8
traditional 7.5
city 7.5
outdoors 7.5
manager 7.4
company 7.4
new 7.3
group 7.2
black 7.2
looking 7.2
celebration 7.2
team 7.2
romantic 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 98.9
outdoor 96.9
clothing 84.1
person 74
footwear 54.2

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Male, 95.7%
Surprised 50%
Calm 24.4%
Disgusted 10.1%
Happy 9.2%
Angry 3%
Confused 1.5%
Fear 1.1%
Sad 0.5%

AWS Rekognition

Age 29-45
Gender Female, 89.5%
Calm 63.8%
Fear 23.9%
Surprised 6%
Angry 2.2%
Happy 2.2%
Sad 1.3%
Confused 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Train 74.2%

Captions

Microsoft

a group of people posing for a photo 65.2%
a group of people posing for the camera 65.1%
a group of people posing for a picture 65%

Text analysis

Amazon

THE
CONE
CANDY
IN
the
With
D
OLD
34564
MIDI
with
With the CONE I
with The CONE IN THE MIDI
A
C
Enjoys
I
The
DATTON CANDY
CO
young
VI33A2
as
DATTON

Google

CANDY
(A
MIDI
YOng
ON
OLD
With
the
CONEI
IN
YOng ON CANDY OLD A enjoys D With the CONEI (A CONE IN THE MIDI • e e e e • e
THE
e
A
enjoys
D
CONE