Human Generated Data

Title

A Merry Company in an Interior

Date

1633

People

Artist: Anthonie Palamedesz., Dutch 1601 - 1673

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Peter and Anne Brooke, 2016.244

Human Generated Data

Title

A Merry Company in an Interior

People

Artist: Anthonie Palamedesz., Dutch 1601 - 1673

Date

1633

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Peter and Anne Brooke, 2016.244

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Art 99.9
Painting 99.9
Person 99.7
Human 99.7
Person 97.7
Person 97.5
Person 95.4
Person 94.6
Pet 93
Canine 93
Animal 93
Mammal 93
Dog 93
Person 90.4
Person 89.6
Person 87.9
Person 86.8
Person 73.5
Person 68.5

Clarifai
created on 2018-02-19

people 100
group 99.8
adult 99.7
wear 99
religion 98.2
woman 97.6
child 97
painting 96.9
veil 96.7
mammal 96.4
furniture 95.5
many 95.5
man 95.3
seat 94.8
room 94.5
interaction 92.6
position 92
home 91.4
administration 91.3
education 90.7

Imagga
created on 2018-02-19

man 32.2
person 26.2
male 25.5
people 23.4
teacher 19.5
adult 19.1
men 14.6
danger 14.5
mask 13.8
soldier 13.7
protection 13.6
military 13.5
educator 12.8
two 12.7
old 12.5
clothing 12.2
gun 11.9
professional 11.6
outdoors 11.2
weapon 11
uniform 10.8
couple 10.4
portrait 10.3
camouflage 10
sport 10
happy 9.4
dark 9.2
outdoor 9.2
traditional 9.1
dirty 9
costume 8.9
destruction 8.8
protective 8.8
business 8.5
competition 8.2
industrial 8.2
dress 8.1
religion 8.1
group 8
building 7.9
stalker 7.9
together 7.9
radioactive 7.8
radiation 7.8
standing 7.8
black 7.8
face 7.8
accident 7.8
toxic 7.8
nuclear 7.7
blood 7.7
rifle 7.7
chemical 7.7
gas 7.7
war 7.7
culture 7.7
fashion 7.5
senior 7.5
religious 7.5
color 7.2
suit 7.2
game 7.1

Google
created on 2018-02-19

Microsoft
created on 2018-02-19

person 95.3
group 56.9

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 12-22
Gender Male, 98.2%
Angry 7.9%
Calm 29.3%
Confused 7.6%
Surprised 5.8%
Sad 11.7%
Disgusted 10%
Happy 27.7%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Sad 45.2%
Surprised 45.2%
Calm 45.3%
Happy 45.2%
Confused 45.1%
Angry 45.1%
Disgusted 53.8%

AWS Rekognition

Age 23-38
Gender Male, 50.3%
Confused 45.3%
Surprised 45.3%
Disgusted 45.7%
Calm 45.6%
Sad 51.8%
Happy 45.7%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Female, 54.5%
Confused 45.2%
Angry 46.4%
Sad 46.5%
Calm 45.4%
Disgusted 48.1%
Surprised 46%
Happy 47.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 45.6%
Angry 45.3%
Disgusted 45.3%
Happy 50.4%
Calm 45.6%
Confused 45.2%
Surprised 47.5%

AWS Rekognition

Age 26-44
Gender Male, 53%
Confused 45.7%
Surprised 46.3%
Disgusted 47.3%
Calm 46.1%
Sad 47%
Happy 46.2%
Angry 46.3%

AWS Rekognition

Age 20-38
Gender Female, 53.4%
Disgusted 48.2%
Sad 45.9%
Happy 45.6%
Angry 47.3%
Surprised 45.6%
Confused 45.3%
Calm 47.1%

Microsoft Cognitive Services

Age 38
Gender Male

Feature analysis

Amazon

Painting 99.9%
Person 99.7%
Dog 93%

Categories

Captions

Azure OpenAI

Created on 2024-01-27

This image depicts a lavish indoor scene set in a large room with a high ceiling. The room is adorned with two artworks hanging on the back wall, one above the other, portraying maritime scenes. The lower painting shows a boat with sails amidst rough sea waters, while the upper one is less distinct but also seems to illustrate a nautical theme. The flooring appears to be wooden, and there are several individuals dressed in 17th-century attire, with elaborate clothing and large hats. They engage in various activities such as conversing, examining objects, and, in one case, looking through a glass. In the foreground, two dogs can be seen; one is lying down, the other standing. }))