Human Generated Data

Title

Indian Summer, 42nd Street, New York

Date

1949, printed later

People

Artist: Louis Faurer, American 1916 - 2001

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.283

Copyright

© Estate of Louis Faurer

Human Generated Data

Title

Indian Summer, 42nd Street, New York

People

Artist: Louis Faurer, American 1916 - 2001

Date

1949, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Indoors 100
Interior Design 100
Person 99.5
Human 99.5
Person 99.3
Person 98.7
Person 98.6
Person 98.3
Room 96.9
Person 96.9
Person 96.6
Person 95
Person 94.1
Person 92.6
Theater 88.8
Person 86.8
Person 84.6
Cinema 76.5
Text 76.4
Person 74.1
Crowd 64.3
Theme Park 57.7
Amusement Park 57.7
Person 55.8
Steamer 55

Clarifai
created on 2021-04-03

people 99.3
group 97.3
many 96.7
monochrome 96.2
railway 95.2
group together 95.2
theater 93.3
crowd 93.3
street 93.2
transportation system 91.3
train 90.2
travel 87.7
city 87.5
building 85.7
business 85.3
subway system 84.3
commerce 83.8
music 83.6
architecture 83.5
retro 83

Imagga
created on 2021-04-03

architecture 49.6
building 47.5
city 42.5
structure 32.6
bridge 28.3
urban 27.1
railway station 25.3
sky 24.9
station 23.9
cinema 23
facility 23
terminal 22.1
travel 20.4
landmark 19.9
river 19.6
theater 19.4
buildings 18.9
skyline 18.1
pier 17.7
tower 16.1
cityscape 16.1
construction 15.4
famous 14.9
office 14
facade 13.3
tourism 13.2
water 12.7
downtown 12.5
support 12.5
night 12.4
university 12.1
old 11.9
skyscraper 11.7
house 11.4
center 11.3
high 11.3
exterior 11.1
street 11.1
clouds 11
palace 10.7
light 10
modern 9.8
landscape 9.7
tourist 9.6
evening 9.3
ocean 9.3
device 9.1
business 9.1
reflection 9.1
concrete 8.6
sea 8.6
england 8.6
culture 8.6
boat 8.4
town 8.4
historic 8.3
outdoors 8.2
vacation 8.2
industrial 8.2
sunset 8.1
transportation 8.1
bank 8.1
billboard 8
skyscrapers 7.8
scene 7.8
industry 7.7
capital 7.6
monument 7.5
history 7.2
summer 7.1
athletic facility 7

Google
created on 2021-04-03

Microsoft
created on 2021-04-03

text 99.9
person 89.7
black and white 87.6
man 79.6
street 64.3
clothing 58.5

Face analysis

Amazon

Google

AWS Rekognition

Age 13-25
Gender Male, 98.3%
Calm 69.9%
Sad 17.1%
Angry 4.4%
Confused 3.4%
Happy 1.9%
Surprised 1.2%
Fear 1.2%
Disgusted 0.9%

AWS Rekognition

Age 14-26
Gender Male, 93.9%
Calm 84.2%
Happy 7.6%
Angry 2.7%
Sad 2.2%
Disgusted 1.4%
Confused 0.9%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 13-23
Gender Female, 51.8%
Calm 68.3%
Confused 12.4%
Sad 8.4%
Angry 3%
Fear 2.9%
Surprised 2.3%
Happy 2.3%
Disgusted 0.5%

AWS Rekognition

Age 37-55
Gender Male, 97.5%
Calm 70.7%
Angry 10.9%
Sad 6.1%
Disgusted 5.7%
Happy 2.2%
Fear 1.9%
Surprised 1.3%
Confused 1.1%

AWS Rekognition

Age 37-55
Gender Male, 91.1%
Sad 53.4%
Calm 44.6%
Happy 1.1%
Angry 0.3%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 38-56
Gender Male, 94.8%
Calm 52.4%
Angry 21.6%
Sad 15.1%
Confused 5.1%
Fear 2.3%
Disgusted 1.4%
Surprised 1.2%
Happy 0.9%

AWS Rekognition

Age 42-60
Gender Male, 77%
Calm 76.1%
Sad 12.4%
Confused 3.8%
Angry 3.2%
Happy 1.7%
Surprised 1.5%
Disgusted 1.1%
Fear 0.2%

AWS Rekognition

Age 33-49
Gender Female, 67.7%
Angry 38.6%
Calm 31.7%
Sad 15.6%
Confused 5.8%
Surprised 2.3%
Disgusted 2.2%
Happy 2.2%
Fear 1.6%

AWS Rekognition

Age 36-54
Gender Male, 62.4%
Sad 63%
Happy 13.8%
Calm 8.6%
Fear 6.2%
Angry 3.5%
Confused 2.8%
Surprised 1.4%
Disgusted 0.7%

AWS Rekognition

Age 22-34
Gender Female, 78%
Sad 41.7%
Happy 23.4%
Calm 18.1%
Fear 8.7%
Angry 3.9%
Surprised 2.4%
Confused 1.1%
Disgusted 0.6%

AWS Rekognition

Age 28-44
Gender Female, 53.9%
Calm 59.4%
Sad 30.6%
Happy 4.7%
Angry 2.1%
Confused 1.3%
Surprised 0.8%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 38-56
Gender Male, 93.3%
Sad 60.6%
Calm 22.3%
Surprised 7.6%
Confused 3.6%
Angry 3.6%
Happy 1.2%
Fear 0.7%
Disgusted 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

website 24.5%

Text analysis

Amazon

IROQUOIS
COOLED
TRAIL
REFRIGERATION
BY
MONTGOMER
COOLED BY REFRIGERATTON
IROQUOIS TRAIL MONTGOMER PRGE
REFRIGERATTON
UBERI COOLED BY REFRIGERATION
PRGE
UBERI

Google

BY
REFRIGERATION
'IROQUOIS
TRAIL
MONTGOMER
T
UBERTS
PRGE
COOLED
IBERTY
Peebibiiinal
IN FIROQUOIS T COOLED BY REFRIGERATION UBERTS COOLED BY REFRIGERATION PRGE 'IROQUOIS TRAIL MONTGOMER UBERTS MUSEUM IBERTY Peebibiiinal
IN
FIROQUOIS
MUSEUM