Human Generated Data

Title

Two Men Digging in Street, New York City

Date

c. 1955 (printed c. 1970s?)

People

Artist: N. Jay Jaffee, American 1921 - 1999

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Artist, P1998.118

Copyright

© The N. Jay Jaffee Trust. All rights reserved. Used by permission. www.njayjaffee.com

Human Generated Data

Title

Two Men Digging in Street, New York City

People

Artist: N. Jay Jaffee, American 1921 - 1999

Date

c. 1955 (printed c. 1970s?)

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.1
Human 99.1
Person 98.7
Bicycle 97.3
Transportation 97.3
Bike 97.3
Vehicle 97.3
Pedestrian 94
Car 93.7
Automobile 93.7
Tarmac 92.2
Asphalt 92.2
Path 86.4
Road 80.4
Shoe 75.4
Clothing 75.4
Footwear 75.4
Apparel 75.4
Car 74.7
Sidewalk 61.5
Pavement 61.5
Word 56
Urban 55.4
Flooring 55.3

Imagga
created on 2021-12-14

newspaper 92.8
product 71.4
creation 55.3
man 28.2
people 22.9
cricket bat 20.4
silhouette 19.9
male 19.9
cricket equipment 18.2
business 15.2
sports equipment 14.1
crutch 14.1
street 13.8
equipment 13.8
person 13.1
men 12.9
building 12.5
outdoors 12
staff 11.9
road 11.7
sport 11.7
walking 11.4
travel 11.3
work 11
city 10.8
active 10.8
outdoor 10.7
businessman 10.6
office 10.1
sunset 9.9
old 9.7
adult 9.7
sky 9.6
chair 9.5
lifestyle 9.4
architecture 9.4
sign 9
summer 9
transportation 9
success 8.8
working 8.8
urban 8.7
stick 8.6
daily 8.5
landscape 8.2
activity 8.1
couple 7.8
sitting 7.7
wall 7.7
walk 7.6
pedestrian 7.3
alone 7.3
group 7.3
support 7.1
life 7.1
worker 7.1
job 7.1
day 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 100
person 92.9
street 88.4
clothing 88.3
footwear 81.1
black and white 80.1
man 70.9

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Male, 94.8%
Calm 93.6%
Sad 4.7%
Angry 0.8%
Surprised 0.4%
Fear 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 34-50
Gender Male, 89.8%
Sad 91.8%
Calm 5%
Fear 2%
Angry 0.6%
Happy 0.4%
Confused 0.1%
Surprised 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Bicycle 97.3%
Car 93.7%
Shoe 75.4%

Captions

Microsoft

a person standing in front of a building 75.1%
a person standing next to a building 71.3%
an old photo of a person 71.2%

Text analysis

Amazon

TRAVEL
TRAVEL BUREAU
BUREAU
ORGANIZATION
M
JOHN
SALVIO
DEMOCRATIC
Leo
JOHN ASSN SALVIO
SIMON
ASSN
PARIS
Coca-Cola
AUTO PARIS
M Juy Juitée
SIMON BROBROS
Juy
AUTO
Juitée
UN
DO
HOLDY FRENCH UN
SKEE DO 0
0
BROBROS
FRENCH
HOLDY
SKEE

Google

Coca
CoalCola
Cola
BROS
ASSN DENOCRATIC AnANATON TRAVEL BUREAL Coca Cola SIMON BROS CoalCola
SIMON
DENOCRATIC
ASSN
AnANATON
TRAVEL
BUREAL