Human Generated Data

Title

Untitled (crowds in a piazza, Vicenza, Italy)
Date

c. 1890 - c. 1915
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4625

Human Generated Data

Title

Untitled (crowds in a piazza, Vicenza, Italy)

People

Artist: Unidentified Artist,

Date

c. 1890 - c. 1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Downtown 100
Building 100
City 100
Urban 100
Town 100
Pedestrian 99.8
Human 99.8
Person 99.7
Person 99.3
Architecture 99.3
Person 99.2
Person 99.2
Person 98.4
Person 98.4
Person 98
Person 97.9
Person 95.3
Road 95
Street 95
Person 94.7
Person 94.4
Person 93.9
Person 89.1
Person 88.1
Plaza 86.7
Town Square 86.7
Metropolis 84.8
Person 84.8
Person 84.5
Person 79.1
Person 76.9
Walkway 76.5
Path 76.5
Person 71.2
Person 70.8
Person 62.4
Outdoors 59.8
Spire 56.8
Tower 56.8
Steeple 56.8
People 56.2

Imagga
created on 2022-01-29

house 100
residence 100
palace 100
building 97.5
dwelling 61.5
architecture 60.2
city 45
structure 32.5
travel 31
housing 30.3
historic 29.4
old 27.2
street 25.8
landmark 24.4
history 23.3
sky 21.7
tourism 21.5
town 20.4
facade 18.5
ancient 18.2
buildings 17
square 16.3
road 16.3
tower 16.1
historical 16
church 15.8
exterior 15.7
university 15.5
monument 15
urban 14.9
famous 14
architectural 13.5
brick 13.2
tourist 12.8
royal 11.6
college 11.6
castle 11.6
england 11.5
cityscape 11.4
culture 11.1
window 11
day 11
stone 11
houses 10.7
lamp 10.5
landscape 10.4
construction 10.3
government 9.8
outdoors 9.7
statue 9.5
sunny 9.5
national 9.1
hall 8.8
wall 8.7
scene 8.7
united 8.6
capital 8.6
flag 8.6
art 8.5
place 8.4
people 8.4
summer 8.4
aged 8.2
religion 8.1
river 8
balcony 7.9
kingdom 7.8
grand 7.8
dome 7.7
saint 7.7
windows 7.7
classical 7.7
vintage 7.5
home 7.2
snow 7.1
scenic 7

Google
created on 2022-01-29

Building 95.2
Photograph 94.4
White 92.2
Window 91.9
Sky 91.4
Black 90.1
Black-and-white 84
Style 83.8
Travel 82.7
Tints and shades 77.4
City 76.4
Facade 75.9
Road 74.4
Snapshot 74.3
Monochrome 73.9
Monochrome photography 72.6
Pedestrian 70.1
Mixed-use 69.9
Cobblestone 68.2
Urban design 68

Microsoft
created on 2022-01-29

building 99.7
outdoor 98.1
way 90.8
sky 88.9
street 86.1
scene 76.7
person 66.1
people 65.8
city 65.5
sidewalk 60
old 53.6
town 30.9

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Disgusted 76.9%
Sad 12.5%
Confused 2.2%
Fear 1.9%
Angry 1.8%
Surprised 1.8%
Calm 1.6%
Happy 1.3%

AWS Rekognition

Age 21-29
Gender Female, 99%
Sad 51.6%
Angry 34.6%
Disgusted 7.6%
Confused 1.7%
Calm 1.6%
Fear 1.3%
Surprised 0.8%
Happy 0.7%

AWS Rekognition

Age 25-35
Gender Female, 67.3%
Calm 50.1%
Angry 24.7%
Disgusted 7%
Fear 5.5%
Sad 4.9%
Confused 3.5%
Surprised 2.3%
Happy 2%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 93.8%
Sad 4.5%
Confused 0.5%
Angry 0.4%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people walking on a city street 97.1%
a group of people walking down a city street 97%
a group of people walking down a street 96.9%