Human Generated Data

Title

Schoolroom

Date

c. 1856

People

Artist: William Tolman Carlton, American 1816 - 1888

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. William Hayes Fogg, 1895.649

Human Generated Data

Title

Schoolroom

People

Artist: William Tolman Carlton, American 1816 - 1888

Date

c. 1856

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. William Hayes Fogg, 1895.649

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Painting 99
Art 99
Person 98.8
Human 98.8
Person 98.3
Person 97.8
Person 94
Person 89.9
Person 89.8
Person 88
Person 77.2
Person 76.9
Person 73.1
Person 62.2
Person 62.1

Clarifai
created on 2020-04-23

people 99.9
painting 99.8
art 99.1
woman 98.8
group 98.5
room 97.6
furniture 97.2
adult 97.2
man 97
seat 93.5
child 93.4
print 92.7
indoors 92.6
family 92
sit 91
table 90.6
religion 89.1
recreation 88.6
two 87.5
home 83.6

Imagga
created on 2020-04-23

man 27.5
people 25.6
sitting 24.9
interior 23.9
women 23.7
groom 23.6
couple 22.6
adult 22.3
male 22
indoors 21.1
together 21
lifestyle 20.2
person 20.2
home 19.9
room 19.8
love 19.7
happy 18.8
smiling 18.1
group 17.7
table 16.6
teacher 16.2
restaurant 16.2
happiness 15.7
men 14.6
dress 14.4
family 14.2
indoor 13.7
smile 13.5
luxury 12.9
celebration 12.8
fun 12.7
hall 12.4
sofa 12.4
togetherness 12.3
friends 12.2
chair 11.8
kin 11.7
portrait 11.6
cheerful 11.4
enjoyment 11.3
party 11.2
two 11
educator 10.9
holding 10.7
father 10.6
fashion 10.6
professional 10.4
wine 10.2
wedding 10.1
drink 10
leisure 10
romantic 9.8
bride 9.6
drinking 9.6
comfortable 9.5
elegant 9.4
mother 9.4
cabaret 9.2
cup 9
husband 9
food 8.9
chairs 8.8
full length 8.7
couch 8.7
girlfriend 8.7
holiday 8.6
daughter 8.6
glass 8.6
marriage 8.5
relationship 8.4
attractive 8.4
relaxation 8.4
traditional 8.3
entertainment 8.3
dinner 8.2
girls 8.2
style 8.2
spot 8.1
romance 8
child 8
night 8
decoration 8
leisure activity 7.8
boy 7.8
having 7.7
pretty 7.7
classroom 7.6
hotel 7.6
dining 7.6
wife 7.6
house 7.5
senior 7.5
friendship 7.5
inside 7.4
joyful 7.3
life 7.3
sensuality 7.3
color 7.2
sexy 7.2
suit 7.2
looking 7.2

Google
created on 2020-04-23

Painting 92.9
Art 75.5
Room 65.7
Visual arts 64.9
Stock photography 59.4
Portrait 51.6

Microsoft
created on 2020-04-23

painting 95.3
indoor 89.6
person 87.5
art 77.7
clothing 77.3
woman 76.8
family 69.5
text 66.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 3-9
Gender Female, 51.3%
Sad 46%
Confused 45.1%
Surprised 45.1%
Angry 45.1%
Calm 53.5%
Fear 45.1%
Disgusted 45%
Happy 45.1%

AWS Rekognition

Age 6-16
Gender Female, 54.3%
Disgusted 45%
Happy 45%
Confused 45%
Surprised 45%
Calm 45%
Fear 45%
Angry 49.3%
Sad 50.7%

AWS Rekognition

Age 5-15
Gender Female, 53.8%
Disgusted 45%
Confused 45%
Fear 45.1%
Calm 49.5%
Happy 45.9%
Surprised 45.1%
Sad 49.5%
Angry 45%

AWS Rekognition

Age 7-17
Gender Female, 54.4%
Happy 45.1%
Angry 45%
Sad 50.6%
Confused 45%
Disgusted 45%
Calm 49%
Fear 45.2%
Surprised 45%

AWS Rekognition

Age 23-35
Gender Female, 50%
Happy 49.6%
Surprised 49.6%
Sad 49.6%
Calm 49.7%
Disgusted 49.5%
Fear 49.6%
Confused 49.5%
Angry 49.9%

AWS Rekognition

Age 9-19
Gender Female, 54.8%
Angry 45%
Disgusted 45%
Surprised 45%
Fear 45%
Happy 45%
Confused 45.1%
Calm 52.1%
Sad 47.7%

AWS Rekognition

Age 22-34
Gender Female, 52.8%
Calm 47.1%
Disgusted 45.3%
Fear 45.2%
Happy 45.1%
Sad 48.4%
Surprised 45.2%
Confused 45.3%
Angry 48.5%

AWS Rekognition

Age 18-30
Gender Female, 50.1%
Fear 49.5%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Happy 49.6%
Calm 50.4%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 1-7
Gender Female, 50.4%
Angry 49.5%
Disgusted 49.5%
Calm 49.6%
Fear 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%

AWS Rekognition

Age 13-23
Gender Male, 54%
Fear 45.1%
Calm 49.6%
Disgusted 46.1%
Happy 45.1%
Angry 46.3%
Sad 47.6%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 13-25
Gender Female, 50%
Happy 49.5%
Calm 50.4%
Sad 49.6%
Disgusted 49.5%
Fear 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 20-32
Gender Female, 50.3%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 50%
Fear 49.5%
Angry 49.8%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50.4%
Sad 49.6%
Confused 49.5%
Happy 49.7%
Disgusted 49.5%
Calm 49.5%
Angry 49.5%
Surprised 49.5%
Fear 50.1%

AWS Rekognition

Age 5-15
Gender Male, 50.5%
Confused 49.5%
Calm 50.2%
Fear 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.7%

AWS Rekognition

Age 21-33
Gender Female, 50.4%
Disgusted 49.5%
Sad 50.4%
Happy 49.5%
Calm 49.5%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Fear 49.5%

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99%
Person 98.8%

Categories

Imagga

events parties 99.2%

Captions

Azure OpenAI

Created on 2024-01-25

This is a painting of an indoor scene set in a room with a hexagonal-patterned ceiling and rose-decorated green wallpaper. The room features hardwood floors and includes a bookcase, a curtained window, and framed artwork on the walls. In the foreground, there is a wooden table with sewing equipment and a basket, along with several textiles scattered around. The mid-ground and background show details of the room's furnishings and decorative elements, including a mirror and another wooden table. The lighting suggests a domestic, intimate setting.

Anthropic Claude

Created on 2024-03-29

This painting depicts a lively and crowded interior scene, likely a family or household gathering. The room is ornately decorated with detailed patterns on the walls and furnishings. In the center, a woman sits on a couch with several children gathered around her, some seated and others standing. Other figures, both adults and children, are dispersed throughout the room, engaged in various activities such as reading, playing, and interacting with one another. The overall impression is one of a warm, domestic setting filled with activity and interaction.

Text analysis

Amazon

10000