Human Generated Data

Title

Jama Masjid, Delhi/Boulevard René Lévesque Ouest, Montréal
Date

2001-2003
People

Artist: Sunil Gupta, Canadian born 1953
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Purchase through the generosity of Jose M. Soriano, 2010.430
Copyright

© Sunil Gupta, courtesy sepiaEYE

Human Generated Data

Title

Jama Masjid, Delhi/Boulevard René Lévesque Ouest, Montréal

People

Artist: Sunil Gupta, Canadian born 1953

Date

2001-2003

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Building 98.5
Architecture 98.5
Dome 98.5
Accessories 87.2
Handbag 87.2
Purse 87.2
Accessory 87.2
Bag 87.2
Poster 70.1
Advertisement 70.1
Person 69.6
Human 69.6
Art 63.7
Person 61.5
Collage 61
Column 59.4
Pillar 59.4
Mosque 57.5

Clarifai
created on 2018-03-22

no person 96.2
architecture 95.1
travel 94.4
religion 91.7
building 90.3
outdoors 89.3
city 88.3
culture 86.4
sky 86.2
traditional 84.3
old 84.3
museum 82.6
design 82.2
art 81.8
people 81.3
tourism 80.9
symbol 80.3
ancient 77.6
temple 77.2
sight 76.6

Imagga
created on 2018-03-22

building 70.7
architecture 57.3
cinema 48.9
structure 47.1
tower 40.3
city 39.3
theater 38.3
landmark 27.1
urban 26.2
sky 26.2
town 26
old 23.7
travel 23.3
church 23.1
cityscape 19.9
wall 18.9
tourism 18.2
street 17.5
historic 17.4
exterior 16.6
cathedral 16.4
history 16.1
buildings 16.1
window 15.9
monument 15.9
famous 15.8
house 15.5
brick 15.1
historical 14.1
religion 13.5
clock 13.1
ancient 13
facade 12.8
tourist 12.7
palace 12.2
construction 12
sketch 11.7
bridge 11.5
capital 11.5
culture 11.1
square 10.9
flag 10.8
river 10.8
tall 10.4
stone 10.2
balcony 10
roof 9.6
center 9.6
drawing 9.5
light 9.4
place 9.3
home 8.8
skyscraper 8.7
houses 8.7
house of cards 8.6
tree 8.5
outdoors 8.2
scene 7.8
dome 7.7
architectural 7.7
downtown 7.7
art 7.2

Google
created on 2018-03-22

art 59.9
modern art 56.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Male, 54.2%
Angry 45.1%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%
Calm 45.5%
Sad 45.1%
Happy 54.1%

AWS Rekognition

Age 6-13
Gender Female, 54.5%
Sad 45.3%
Confused 45%
Surprised 45%
Angry 45%
Disgusted 45%
Happy 54.6%
Calm 45%

AWS Rekognition

Age 26-43
Gender Female, 50.6%
Angry 18%
Confused 6.7%
Disgusted 11.8%
Surprised 5.7%
Calm 37.9%
Sad 9.2%
Happy 10.7%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Purse 87.2%
Person 69.6%

Captions

Microsoft

a group of people posing for a photo 44.2%
a group of men posing for a photo 32.4%
a group of people in a room 32.3%

Text analysis

Amazon

fains

Google

Christmas Joy ETHLENEMCHURCH OF THE NATIVITY th pear where there s hatred let me sow love where theie fath, Where theve is despait bope Where there is darkness lighrand Where there is sadiess oy -000000 OB0BO Grant thut Iy not so macth sek lo be consoled as to console. To be understood as to understand. Tobd loved as to love: For it is an giving that we recent . It เท่ Pandonang thut we are pardoned.Aad it is in dying thut we arr bon to eternal 3
Christmas
Joy
OF
NATIVITY
hatred
love
theie
Where
lighrand
there
sadiess
-000000
Grant
that
thut
arr
to
3
despait
bope
oy
so
consoled
understood
as
it
is
.
we
are
in
THE
fath,
theve
th
pear
let
OB0BO
Iy
be
To
understand.
Tobd
an
recent
เท่
dying
eternal
ETHLENEMCHURCH
s
not
macth
lo
loved
love:
giving
pardoned.Aad
where
me
sow
darkness
sek
console.
For
It
Pandonang
bon