Human Generated Data

Title

Untitled (people playing shuffleboard at Gulf Beach Motel)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8972
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people playing shuffleboard at Gulf Beach Motel)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.4
Person 99.4
Shorts 99
Clothing 99
Apparel 99
Person 98.1
Person 97.8
Person 97.5
Person 94.8
Person 91.7
Plant 91.2
Arecaceae 91.2
Tree 91.2
Palm Tree 91.2
Person 90
Person 86.2
Water 83.3
Tarmac 76.7
Asphalt 76.7
Female 76.5
Aircraft 75.9
Helicopter 75.9
Transportation 75.9
Vehicle 75.9
Building 75.8
Outdoors 73
Person 70.4
Path 69.5
Road 69.4
Swimming Pool 69.1
Pool 69.1
Face 68.3
Nature 65.1
Screen 64.2
Electronics 64.2
Urban 62.6
Girl 61.7
Leisure Activities 59.2
Architecture 56.2
Person 56.1
Person 55.7
Child 55.7
Kid 55.7
Woman 55

Imagga
created on 2022-01-09

blackboard 37.6
stage 32.5
billboard 25.7
platform 25.5
structure 22.6
signboard 22
city 20.8
television 18.8
architecture 18.7
urban 16.6
travel 16.2
people 14.5
grunge 14.5
sky 14
business 14
board 13.1
design 12.9
sign 12.8
male 12.8
building 12.7
silhouette 12.4
cityscape 12.3
education 12.1
symbol 12.1
man 12.1
black 12
person 11.9
monitor 11.5
classroom 11.4
scene 11.2
room 10.5
street 10.1
tower 9.8
telecommunication system 9.8
old 9.8
businessman 9.7
class 9.6
electronic equipment 9.5
school 9.4
road 9
equipment 9
light 8.7
crowd 8.6
drawing 8.6
men 8.6
skyline 8.5
lights 8.3
tourism 8.2
speed 8.2
transport 8.2
landscape 8.2
dirty 8.1
transportation 8.1
graphic 8
idea 8
night 8
icon 7.9
chalkboard 7.8
film 7.8
teaching 7.8
chalk 7.8
space 7.8
construction 7.7
hand 7.6
bridge 7.6
pattern 7.5
vehicle 7.4
retro 7.4
student 7.2
success 7.2
team 7.2
university 7.2
work 7.1
modern 7

Google
created on 2022-01-09

Black 89.6
Motor vehicle 88.1
Plant 85.2
Rectangle 82
Font 81.7
Tints and shades 77.3
Tree 75
Arecales 74.6
Technology 73.4
Classic 71.1
Art 71.1
Monochrome photography 70.3
Monochrome 69.8
Room 69.3
Vintage clothing 67.4
Palm tree 65.9
Chair 64.3
History 63.5
Vehicle door 62.7
Automotive exterior 61.4

Microsoft
created on 2022-01-09

text 98.5
black 68.7
black and white 62.3

Face analysis

Amazon

Google

AWS Rekognition

Age 11-19
Gender Male, 84.4%
Fear 46.6%
Calm 27.2%
Surprised 6.9%
Disgusted 6.6%
Confused 3.7%
Happy 3.3%
Sad 3%
Angry 2.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helicopter 75.9%

Captions

Microsoft

an old photo of a woman 80.8%
old photo of a woman 79.7%
an old photo of a girl 61.2%

Text analysis

Amazon

42433

Google

MJI7--
42433
YT3A2--AGO
42433 MJI7-- YT3A2--AGO