Human Generated Data

Title

Street Scene in Jaipur
Date

20th century
People

Artist: Unknown Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of James E. Robinson III in honor of Stuart Cary Welch and Alve John Erickson, 1997.239

Human Generated Data

Title

Street Scene in Jaipur

People

Artist: Unknown Artist,

Date

20th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of James E. Robinson III in honor of Stuart Cary Welch and Alve John Erickson, 1997.239

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Building 97.9
Outdoors 97.9
Shelter 97.9
Rural 97.9
Nature 97.9
Countryside 97.9
Human 96.8
Person 96.8
Advertisement 96.1
Poster 96.1
Person 92.9
Person 90.8
Person 87.5
Person 87.5
Landscape 87
Person 86.3
Scenery 82.9
Person 82.3
Person 79.9
Yard 77.4
Person 77
Housing 75
Architecture 74.9
Person 72.8
Person 71.9
Crowd 63.5
Aerial View 61.7
Text 59.9
House 58.9
Sand 58.4
Roof 57
Dome 57
Villa 56.8
Person 51.1
Person 49.3

Clarifai
created on 2019-05-22

travel 97.8
summer 96.3
sand 95.3
sky 95.1
beach 93.8
outdoors 93
architecture 92.9
leisure 91.9
vacation 91.2
relaxation 91.2
nature 91.2
sun 90.7
tourism 89.9
water 89.2
people 87.6
seashore 87.5
fair weather 86.6
recreation 86.4
landscape 85.7
tropical 85

Imagga
created on 2019-05-22

beach 100
ocean 40.3
sea 35.2
sky 34.7
travel 34.5
coast 32.3
sand 31.9
water 30.7
landscape 26
tourism 24.8
sun 24.2
summer 23.2
seaside 23
vacation 22.9
coastline 20.7
island 20.1
shore 19
sunset 18.9
city 18.3
horizon 18
clouds 17.8
resort 17.4
seascape 17.2
scenic 16.7
bay 16.4
wave 16.4
tropical 15.3
scene 14.7
holiday 14.3
relax 14.3
relaxation 14.2
paradise 14.1
tree 13.8
dune 13.2
sunny 12.9
scenery 12.6
river 12.5
people 12.3
outdoor 12.2
waves 12.1
day 10.2
architecture 10.2
tourist 10
mountain 9.9
romantic 9.8
coastal 9.7
lake 9.7
fishing 9.6
dusk 9.5
panorama 9.5
cloud 9.5
buildings 9.5
sunrise 9.4
hill 9.4
sunshine 9.4
palm 9.4
destination 9.4
boat 9.3
urban 8.7
rock 8.7
shoreline 8.7
cityscape 8.5
hot 8.4
outdoors 8.2
recreation 8.1
sport 8.1
trees 8
color 7.8
houses 7.7
surf 7.7
old 7.7
evening 7.5
town 7.4
warm 7.4
historic 7.3
road 7.2
building 7.1
sunlight 7.1

Google
created on 2019-05-22

Painting 67.4
Illustration 54.5
Art 50.2

Microsoft
created on 2019-05-22

picture frame 75.2
painting 75.1
sky 68.3
beach 67.7
drawing 62.8
ice skating 58.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-7
Gender Male, 50.4%
Confused 49.7%
Calm 49.7%
Happy 49.5%
Angry 49.8%
Sad 49.7%
Surprised 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Person 96.8%
Poster 96.1%

Categories

Imagga

beaches seaside 45.7%
paintings art 40.9%
nature landscape 9.4%
text visuals 2.2%
sunrises sunsets 1.1%

Captions

Microsoft
created on 2019-05-22

a close up of a sign 64.7%
close up of a sign 57.1%
a sign on a wall 41.8%

Text analysis

Amazon

3820
3r'tt
HICI
WW