Human Generated Data

Title

Untitled (men and women playing shuffleboard, Sarasota)

Date

1946

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7137

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women playing shuffleboard, Sarasota)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.4
Person 99.3
Person 99.1
Person 97.5
Person 92.6
Person 91.3
People 88.6
Person 77.6
Sport 73.2
Sports 73.2
Clothing 72.8
Shorts 72.8
Apparel 72.8
Pedestrian 68.1
Person 64.3
Outdoors 62.1
Road 60.2
Team Sport 59.1
Team 59.1

Imagga
created on 2021-12-15

graffito 37.9
sketch 32.6
decoration 25.8
drawing 24.9
city 19.9
carousel 18.7
representation 18.5
people 16.7
urban 16.6
man 16.1
ride 15.8
construction 13.7
business 13.4
architecture 13.3
sport 13
male 12
travel 12
modern 11.9
transportation 11.7
building 11.4
men 11.2
floor 11.2
line 11.1
transport 11
sky 10.8
mechanical device 10.6
outdoors 10.4
light 10
person 9.9
equipment 9.6
structure 9.6
track 9.6
crowd 9.6
motion 9.4
window 9.2
reflection 9.1
office 8.9
interior 8.8
airport 8.8
art 8.7
move 8.6
design 8.4
intersection 8.3
competition 8.2
hall 8.2
new 8.1
activity 8.1
game 8
commuter 7.9
boy 7.8
black 7.8
glass 7.8
wall 7.7
walking 7.6
perspective 7.5
house 7.5
leisure 7.5
silhouette 7.4
technology 7.4
symbol 7.4
street 7.4
water 7.3
speed 7.3
sword 7.3
weapon 7
mechanism 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 92.9
person 84.9
man 74.8
clothing 72.9
dance 71.4
sport 69.9
black 67.4
black and white 54.3
several 10.9

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Male, 57.5%
Calm 80.8%
Sad 8.2%
Surprised 3.4%
Confused 3.4%
Happy 2.8%
Angry 0.8%
Disgusted 0.5%
Fear 0.1%

AWS Rekognition

Age 21-33
Gender Male, 89.2%
Disgusted 62.1%
Calm 33.2%
Angry 1.6%
Surprised 1.4%
Happy 0.9%
Sad 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 48-66
Gender Female, 80.3%
Calm 60.2%
Sad 22.1%
Happy 12.5%
Fear 3.6%
Angry 0.8%
Confused 0.4%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 42-60
Gender Male, 72.7%
Calm 86%
Sad 5.5%
Confused 4.5%
Happy 2%
Surprised 1.1%
Angry 0.6%
Disgusted 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people on a court 88.5%
a group of people standing in front of a building 80.6%
a group of people on the court 80.5%

Text analysis

Amazon

SIESTA
FLA.
KEY,
SARASOTA,
J.
J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
HEADER-AT-
STEINMETZ,
22009.
TONIGHT-DOUBLE
POFLUCK TONIGHT-DOUBLE
CLUB
POFLUCK
ee
KODVK
IN THE SHOTTEL PARED CLUB
IN THE SHOTTEL
PARED

Google

THE SHOFFLPAID POTLUCK TONIGHTCOUBLE HEADER-AT- 2 2009. J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
SHOFFLPAID
2
STEINMETZ,
KEY,
TONIGHTCOUBLE
HEADER-AT-
SARASOTA,
2009.
J.
SIESTA
POTLUCK
THE
FLA.