Human Generated Data

Title

Untitled (city square with crowd, Cividale, Italy)

Date

c. 1890 - c. 1915

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4450

Human Generated Data

Title

Untitled (city square with crowd, Cividale, Italy)

People

Artist: Unidentified Artist,

Date

c. 1890 - c. 1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.7
Person 99.7
Person 99.6
Bike 99.3
Bicycle 99.3
Transportation 99.3
Vehicle 99.3
Machine 99
Wheel 99
Person 97.5
Wheel 96.2
Person 95.1
Person 92.7
Bicycle 91.9
Person 83.2
Sport 79
Sports 79
Cyclist 79
Pedestrian 77.9
Person 72.8
Urban 55.6
Person 50.2

Imagga
created on 2022-01-29

architecture 44.4
city 44.1
building 43.6
street 33.1
old 25.8
travel 23.9
tourism 22.3
umbrella 21.4
house 21.1
urban 21
town 20.4
buildings 18.9
window 18.6
balcony 17.7
stone 17.7
graffito 17.4
canopy 16.6
wall 15.7
tourist 15.6
ancient 15.6
church 14.8
history 14.3
brick 14.1
shelter 13.6
decoration 13.1
scene 13
exterior 12.9
houses 12.6
roof 12.4
monument 12.1
road 11.7
windows 11.5
lamp 11.4
flag 11.3
structure 10.8
historic 10.1
facade 10
landmark 9.9
arch 9.8
home 9.6
sky 9.6
people 9.5
historical 9.4
culture 9.4
palace 9.2
tower 9
architectural 8.7
medieval 8.6
sidewalk 8.5
protective covering 8.4
famous 8.4
alley 8.2
boat 8.1
lantern 7.8
art 7.8
color 7.8
construction 7.7
sculpture 7.6
black 7.2
covering 7.2
day 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 97.6
bicycle 97.5
group 90.2
outdoor 90.2
old 85.7
vehicle 85.6
street 84.1
person 82.6
land vehicle 82.3
wheel 68.4
bicycle wheel 65.9
people 59.1

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 95.6%
Calm 97.4%
Happy 1.8%
Sad 0.3%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 90.2%
Confused 3.8%
Fear 2.5%
Angry 1.3%
Disgusted 0.8%
Sad 0.6%
Surprised 0.5%
Happy 0.2%

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Angry 35%
Calm 25.5%
Sad 25.1%
Surprised 3.7%
Fear 3.1%
Confused 2.9%
Disgusted 2.5%
Happy 2.2%

AWS Rekognition

Age 27-37
Gender Male, 61%
Calm 56.1%
Sad 22.4%
Happy 9.1%
Angry 4.8%
Fear 3.4%
Confused 2.2%
Surprised 1.1%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Bicycle 99.3%
Wheel 99%

Captions

Microsoft

a group of people standing in front of a building 95%
an old photo of a group of people standing in front of a building 92.4%
old photo of a group of people standing in front of a building 92%

Text analysis

Amazon

TRIESTE
MANIFATTURE
CIZTA'DI
4 CIZTA'DI TRIESTE
ALBERG
CAFFELONGOBARIA
4

Google

ALBERS CIZTA DI TRIESTE PMANFATTURE
CIZTA
ALBERS
PMANFATTURE
DI
TRIESTE