Human Generated Data

Title

Untitled (two men dressed in Santa Claus costumes, New York City)

Date

1954

People

Artist: Weegee (Arthur Fellig), American 1899 - 1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan, 40.2001

Human Generated Data

Title

Untitled (two men dressed in Santa Claus costumes, New York City)

People

Artist: Weegee (Arthur Fellig), American 1899 - 1968

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-29

Person 99.7
Human 99.7
Person 99.1
Person 98.9
Person 98.8
Person 98.7
Military 96.7
Person 96.6
Military Uniform 96.3
Person 96.1
Handrail 93.1
Banister 93.1
Person 91.4
Vehicle 87.4
Automobile 87.4
Transportation 87.4
Car 87.4
Machine 80.5
Wheel 80.5
Apparel 80.4
Clothing 80.4
Soldier 78.9
Army 78.2
Armored 78.2
People 77.9
Officer 66.3
Person 64
Person 61.4
Train 57.6
Crypt 56.7
Person 53.5

Clarifai
created on 2018-02-09

people 100
adult 99.7
one 99.7
group together 99.4
two 99.2
vehicle 99
group 98.8
administration 97.5
many 96.8
man 96.8
wear 96.4
military 96.4
indoors 96.3
transportation system 95.5
home 94.8
several 94.7
four 94.6
three 94.3
woman 93.9
war 93.3

Imagga
created on 2018-02-09

teleprompter 76.6
device 66.3
prompter 61.3
elevator 32.8
architecture 26.7
building 25.2
city 19.1
travel 15.5
light 15.4
urban 14.8
old 13.9
road 13.5
night 13.3
transportation 12.5
transport 11.9
business 10.9
landmark 10.8
religion 10.7
modern 10.5
technology 10.4
structure 9.9
interior 9.7
cinema 9.7
famous 9.3
computer 8.9
temple 8.8
motion 8.6
black 8.4
tunnel 8.2
digital 8.1
construction 7.7
monument 7.5
blur 7.4
tourism 7.4
lights 7.4
gold 7.4
historic 7.3

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

black 66.5

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Calm 53.3%
Surprised 45.1%
Happy 45.1%
Angry 45.3%
Sad 45.8%
Disgusted 45.2%
Confused 45.1%

AWS Rekognition

Age 38-57
Gender Male, 52.6%
Happy 45.3%
Disgusted 46.3%
Surprised 45.3%
Sad 48.1%
Calm 49.2%
Angry 45.5%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Female, 61.9%
Sad 19.3%
Angry 7%
Calm 63.2%
Confused 4.3%
Disgusted 1.7%
Happy 0.9%
Surprised 3.7%

AWS Rekognition

Age 60-80
Gender Male, 98.9%
Sad 10.2%
Disgusted 4.6%
Surprised 10.2%
Confused 8%
Happy 8.4%
Calm 53.6%
Angry 5%

Microsoft Cognitive Services

Age 26
Gender Male

Feature analysis

Amazon

Person 99.7%
Car 87.4%
Wheel 80.5%

Captions

Microsoft

a black sign with white text on a wooden bench 81%
a white sign with black text on a wooden bench 74.3%
a person sitting on a bench 71.4%

Text analysis

Amazon

STREET
INDEPENDENT
SYSTEM
DOWNTOWN
SUBWAY SYSTEM
SUBWAY
EAST
BROOKLYN
HEIGHTS
UPTOWN
SIDE
WASHINGTON
HOUSTON
UPTOWN TO WASHINGTON HEIGHTS
NASSAU
EAST SIDE AND VIA BROOKLYN HOUSTON
DOWNTOWN TO BROADWAY STREET
BRONX
THE
QUEENS
BROADWAY
THE BRONX AND QUEENS NASSAU ST.
AND
ST.
VIA
TO
SPITTL

Google

INDEPENDENT
SUDWAY
SYSTEM
TO
HEIGHTS
BROADWAY-NASSAU
ST.
EAST
VIA
HOUSTON
AND
INDEPENDENT SUDWAY SYSTEM UPTOWN TO WASHINGTON HEIGHTS THE BRONX AND QUEENS DOWNTOWN TO BROADWAY-NASSAU ST. EAST SIDE VIA HOUSTON STREET AND BROOKLYN
UPTOWN
WASHINGTON
DOWNTOWN
BROOKLYN
QUEENS
SIDE
STREET
THE
BRONX