Human Generated Data

Title

Untitled (elderly man sitting on city bench)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16096.1

Human Generated Data

Title

Untitled (elderly man sitting on city bench)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.8
Human 99.8
Furniture 99.7
Person 99.7
Clothing 97.5
Apparel 97.5
Sitting 96.3
Footwear 96
Shoe 96
Car 87.7
Vehicle 87.7
Transportation 87.7
Automobile 87.7
Coat 82.4
Overcoat 82.4
Park Bench 77.9
Pedestrian 76.4
Bench 75.2
Path 63.4
Dating 58
Suit 56.4
Female 55.4
Face 55.2

Imagga
created on 2022-02-11

man 30.9
people 28.5
person 26.6
building 25
male 23.4
city 23.3
silhouette 23.2
business 21.9
urban 18.4
adult 17.2
alone 15.5
architecture 15.3
street 14.7
musical instrument 14.6
office 14.4
travel 12.7
modern 12.6
businessman 12.4
black 12
sunset 11.7
lifestyle 11.6
life 11.5
couple 11.3
scholar 10.8
outdoor 10.7
fashion 10.6
window 10.4
corporate 10.3
sky 10.2
town 10.2
outdoors 9.9
attractive 9.1
vacation 9
intellectual 8.9
looking 8.8
standing 8.7
sitting 8.6
walking 8.5
old 8.4
men 7.7
crowd 7.7
walk 7.6
suit 7.6
happy 7.5
human 7.5
world 7.5
professional 7.5
stringed instrument 7.4
shadow 7.2
women 7.1
portrait 7.1
working 7.1
spectator 7
glass 7

Google
created on 2022-02-11

Shoe 95.6
Building 91.5
Sky 84.6
Street fashion 84.2
Adaptation 79.4
Travel 79.1
Morning 78.9
Rectangle 78.5
Luggage and bags 78.2
Tints and shades 77.4
Beauty 75.3
Suit 75.3
Road 75
Leisure 74.8
Bag 73.2
Formal wear 71.2
Sidewalk 69.6
City 69.4
Bench 67.4
Street 65.9

Microsoft
created on 2022-02-11

bench 99.5
outdoor 99
footwear 97.2
clothing 97
street 95.1
person 95
text 91.6
woman 90.5
skyscraper 84.7
sky 72.4
man 72.3
park 64.7
city 53.5
building 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Female, 68.6%
Calm 56.6%
Happy 14.5%
Sad 8.8%
Angry 7%
Surprised 5.7%
Confused 3.5%
Disgusted 2.3%
Fear 1.6%

AWS Rekognition

Age 49-57
Gender Female, 90.8%
Sad 39.7%
Calm 29.2%
Disgusted 9.5%
Angry 7.6%
Happy 5.4%
Confused 3.8%
Surprised 3.3%
Fear 1.6%

AWS Rekognition

Age 23-33
Gender Female, 100%
Angry 24.4%
Happy 20.6%
Sad 18.2%
Calm 15.7%
Surprised 8.6%
Disgusted 6.5%
Fear 3.4%
Confused 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 96%
Car 87.7%
Bench 75.2%

Captions

Microsoft

a man and a woman sitting on a bench reading a book 71.2%
a man and woman sitting on a bench reading a book 66.8%
a person sitting on a bench reading a book 66.7%

Text analysis

Amazon

ROCK
LOANS
BENEFICIAL
ROCK H
USARMY
H
AKOS
3523 ST LOUIS AVE
KODYK
KODYK EIFA
EIFA
FRANCE
Thomp
STER

Google

3523
NIDEED
VBARMY
ww.A
OPTE
BENEFICIAL
ST
AVE
LOANS
ROCK
H
ZACOX
OUFU BENEFICIAL LOANS ww.A ROCK H OPTE 3523 ST LOUIS AVE NIDEED VBARMY ZACOX
OUFU
LOUIS