Human Generated Data

Title

Untitled (baseball player Ted Williams with boys from Southside School, Sarasota)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5565

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (baseball player Ted Williams with boys from Southside School, Sarasota)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.4
Person 99.2
Person 95.7
Person 93.2
Person 88.5
People 77.9
Clothing 75.2
Apparel 75.2
Outdoors 68.1
Advertisement 65.6
Poster 64.8
Photography 62.7
Photo 62.7
Person 61.5
Portrait 60.8
Face 60.8
Text 60.5
Yard 59.4
Nature 59.4
Croquet 58.4
Sport 58.4
Sports 58.4

Imagga
created on 2022-01-23

people 19.5
crutch 19.3
person 17.8
staff 16
sport 15.8
fashion 14.3
art 14.2
man 14.1
adult 13.8
model 12.4
portrait 12.3
outdoor 12.2
stick 11.8
dress 11.7
pretty 11.2
statue 11.1
active 10.8
male 10.6
lady 10.5
human 10.5
attractive 10.5
old 10.4
hair 10.3
drawing 10.3
black 10.2
grunge 10.2
elegance 10.1
posing 9.8
summer 9.6
style 9.6
body 9.6
power 9.2
hand 9.1
clothing 8.7
lifestyle 8.7
life 8.6
men 8.6
face 8.5
leisure 8.3
sky 8.3
silhouette 8.3
healthy 8.2
exercise 8.2
light 8.2
pose 8.1
sexy 8
women 7.9
love 7.9
color 7.8
travel 7.7
happy 7.5
clothes 7.5
sketch 7.3
business 7.3
fitness 7.2
costume 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

outdoor 98.9
text 98.4
clothing 96.8
person 96.8
man 90.3
drawing 88.4
sketch 75.4
posing 65
group 62
people 60.6

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 65.9%
Happy 91.2%
Confused 2.6%
Sad 2.3%
Calm 1.3%
Disgusted 1.1%
Angry 0.6%
Surprised 0.6%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Male, 98.8%
Happy 94.1%
Calm 5%
Surprised 0.4%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Female, 89.5%
Happy 55.9%
Calm 37.9%
Disgusted 1.6%
Sad 1.6%
Angry 1.1%
Fear 0.8%
Surprised 0.7%
Confused 0.4%

AWS Rekognition

Age 20-28
Gender Female, 82.2%
Calm 85.8%
Sad 5.6%
Happy 5%
Confused 1.5%
Fear 0.9%
Disgusted 0.8%
Angry 0.2%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 93.5%
a group of people posing for a picture 93.4%
a group of people posing for the camera 93.3%

Text analysis

Amazon

SIESTA
KEY,
BOS
J.
BOS TON
TON
J. J. STEINMETZ. SIESTA KEY, SARASOTA,-FLA.
STEINMETZ.
SARASOTA,-FLA.
22550
03892

Google

STEINMETZ,
KEY,
J.
22830
SARASOTA,
TOW
FLA.
BOS TOW 22830 22830 J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
BOS
SIESTA