Human Generated Data

Title

Market Scene with Figures and Animals

Date

17th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Friends of the Fogg Art Museum Fund, 1951.127.2

Human Generated Data

Title

Market Scene with Figures and Animals

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Friends of the Fogg Art Museum Fund, 1951.127.2

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Human 98.1
Person 98.1
Person 97.8
Art 96.9
Person 94.9
Person 91.3
Person 90.7
Animal 88.8
Bird 88.8
Person 87.1
Painting 86.9
Dog 86.2
Mammal 86.2
Canine 86.2
Pet 86.2
Person 78.4
Mural 76.3
Person 74.5
Person 73.2
Drawing 58.8
Person 46.3

Clarifai
created on 2018-03-24

art 97.2
illustration 97.1
painting 96.1
architecture 93.2
old 92.5
wall 92.3
house 92.2
building 91.4
town 86.1
travel 85.7
city 84.5
print 84.3
ancient 83.5
street 82.1
Gothic 81.7
tree 81.6
religion 81
no person 80.7
symbol 80.7
color 80.1

Imagga
created on 2018-03-24

jigsaw puzzle 96.7
puzzle 78.2
game 54.1
old 37.6
mosaic 32.4
grunge 29.8
vintage 27.3
transducer 24.6
retro 22.9
paper 22
map 21.6
wall 20.4
art 19.6
texture 19.5
electrical device 18.4
travel 18.3
antique 16.5
ancient 15.6
paint 15.4
city 15
building 14.9
tourism 14
graffito 14
pattern 13.7
architecture 13.5
currency 13.5
world 13.3
decoration 13.3
geography 12.5
design 12.4
economy 12.1
device 12
brown 11.8
aged 11.8
house 11.2
money 11.1
cash 11
finance 11
rough 10.9
structure 10.6
worn 10.5
grungy 10.4
artistic 10.4
color 10
painting 9.9
gold 9.9
history 9.8
financial 9.8
scrapbook 9.7
historic 9.2
letter 9.2
dirty 9
landmark 9
surface 8.8
country 8.8
textured 8.8
card 8.5
tile 8.5
wallpaper 8.4
page 8.4
frame 8.3
wealth 8.1
yellow 8
urban 7.9
torn 7.7
collage 7.7
rust 7.7
rustic 7.7
exchange 7.6
painted 7.6
historical 7.5
grain 7.4
global 7.3
business 7.3
religion 7.2
bank 7.2
material 7.1

Google
created on 2018-03-24

art 80.3
history 76.7
miniature 68.6
painting 68.2
middle ages 63.2
artwork 60.1
recreation 58.1
illustration 51.6
creative arts 50.5

Microsoft
created on 2018-03-24

bedclothes 64.5
fabric 11.6
several 10.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-45
Gender Male, 50.2%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.5%
Calm 49.5%
Surprised 49.7%
Happy 50.2%

AWS Rekognition

Age 20-38
Gender Female, 51.8%
Calm 45.1%
Angry 47.6%
Confused 45.4%
Sad 48.3%
Surprised 45.4%
Happy 45.3%
Disgusted 47.9%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Disgusted 49.5%
Angry 50.3%
Happy 49.5%
Sad 49.7%
Confused 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50%
Surprised 49.5%
Sad 49.5%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 50.4%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Sad 50%
Surprised 49.6%
Calm 49.6%
Disgusted 49.6%
Happy 49.5%
Confused 49.5%
Angry 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Disgusted 49.9%
Surprised 49.6%
Angry 49.8%
Sad 49.5%
Happy 49.5%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 26-44
Gender Male, 50.5%
Disgusted 49.5%
Calm 50.3%
Angry 49.5%
Confused 49.6%
Surprised 49.5%
Happy 49.5%
Sad 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.3%
Calm 49.6%
Happy 49.5%
Sad 50.3%
Disgusted 49.5%
Angry 49.6%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50%
Angry 49.7%
Happy 49.6%
Sad 49.7%
Surprised 49.6%
Calm 49.6%
Disgusted 49.8%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Disgusted 49.7%
Surprised 49.6%
Angry 49.9%
Happy 49.6%
Calm 49.6%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.6%
Surprised 49.6%
Calm 49.6%
Disgusted 49.7%
Happy 49.8%
Confused 49.5%
Angry 49.7%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Calm 50%
Disgusted 49.7%
Surprised 49.6%
Confused 49.6%
Sad 49.6%
Angry 49.6%
Happy 49.6%

Feature analysis

Amazon

Person 98.1%
Bird 88.8%
Painting 86.9%
Dog 86.2%

Captions

Azure OpenAI

Created on 2024-01-24

This image depicts a vibrant and busy scene, seemingly from a historical or mythical narrative. At the forefront, there's a bustling commotion with various characters engaged in what appears to be a dramatic event. Some individuals are interacting with animals, including goats and a dog, while others are brandishing weapons or objects as if in conflict. The background features an elaborate architectural setting with domed buildings, indicating a South Asian context, possibly a palace or temple complex. Hills adorned with more structures and a few figures drape the background, adding depth to the scene, while lush trees accentuate the verdant environment. The intricate detail and colorful attire of the figures suggest a ceremonial or significant episode is being depicted, characterized by traditional South Asian art stylings.

Anthropic Claude

Created on 2024-03-29

This image appears to depict a detailed, colorful illustration of an ornate architectural scene with various people, animals, and structures. The central part of the image shows a group of figures dressed in traditional Indian attire, engaged in what seems to be some kind of social gathering or event. Around them, the image features a variety of buildings, gardens, and natural elements, creating a rich and vibrant visual narrative. The overall composition and level of detail suggest this is a work of traditional Indian or South Asian art.