Human Generated Data

Title

Here i' the Sands

Date

1860-1861

People

Artist: Arthur Boyd Houghton, British 1836 - 1875

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.194

Human Generated Data

Title

Here i' the Sands

People

Artist: Arthur Boyd Houghton, British 1836 - 1875

Date

1860-1861

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.194

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.6
Human 99.6
Person 99.6
Person 99.5
Painting 98.3
Art 98.3
Person 97.8
Clothing 82.7
Shoe 82.7
Footwear 82.7
Apparel 82.7
Person 81.6
Person 52.9

Clarifai
created on 2018-03-16

people 99.9
adult 99.6
man 99.1
woman 98.7
group 98.5
two 98.4
wear 97.9
child 97.1
painting 95.9
position 95.8
one 95.7
sit 95.5
seat 93.3
furniture 93.1
son 92.6
three 89.6
family 89.1
portrait 88.5
religion 88.3
art 87.7

Imagga
created on 2018-03-16

person 26.2
sitting 24.1
man 22.9
people 21.2
adult 20.7
male 18.4
portrait 18.1
instrument of punishment 17.1
stocks 15.6
happy 15
fashion 14.3
child 13.9
instrument 13.6
jeans 13.4
old 13.2
attractive 12.6
wall 12.4
human 12
casual 11.9
smiling 11.6
lifestyle 11.6
smile 11.4
face 11.4
sofa 11.2
two 11
device 10.9
outdoors 10.6
love 10.3
work 10
holding 9.9
handsome 9.8
pretty 9.8
fun 9.7
couch 9.7
couple 9.6
boy 9.6
happiness 9.4
youth 9.4
light 9.4
cute 9.3
looking 8.8
together 8.8
women 8.7
mother 8.6
model 8.6
expression 8.5
brick 8.5
room 8.5
wicker 8.3
teen 8.3
vintage 8.3
alone 8.2
teenager 8.2
dress 8.1
cheerful 8.1
lady 8.1
worker 8
hair 7.9
autumn 7.9
men 7.7
sad 7.7
lonely 7.7
outside 7.7
relax 7.6
relaxation 7.5
art 7.5
group 7.3
black 7.2
building 7.2
blond 7.2
religion 7.2
family 7.1
travel 7

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

person 91.9
old 41.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 93.4%
Surprised 1.3%
Disgusted 2.8%
Confused 2.3%
Sad 78.1%
Angry 6.5%
Happy 0.4%
Calm 8.7%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Disgusted 45.1%
Calm 45.1%
Confused 45.1%
Surprised 45.1%
Sad 54.4%
Happy 45.1%
Angry 45.1%

AWS Rekognition

Age 48-68
Gender Male, 54.5%
Surprised 45.1%
Sad 46.4%
Happy 45.2%
Disgusted 45.1%
Angry 45.1%
Calm 52.8%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Female, 52.1%
Disgusted 46.6%
Happy 46%
Surprised 45.8%
Sad 45.9%
Calm 49.4%
Angry 46.1%
Confused 45.3%

AWS Rekognition

Age 45-66
Gender Female, 54.9%
Confused 45.2%
Happy 46.4%
Sad 45.6%
Angry 46.6%
Disgusted 49.9%
Surprised 45.4%
Calm 46%

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 98.3%
Shoe 82.7%

Captions

Azure OpenAI

Created on 2024-12-03

This is a painting depicting a scene of a beach or coastline with several individuals engaged in various activities. In the foreground, a person is seated on a wooden beam or box marked with the initials "A.H." This person is dressed in a dark sweater and trousers, with boots, and appears in a relaxed pose, one leg crossed over the other. In the background, other figures are visible, including some who appear to be fishermen or sailors, judging by their attire—caps and breeches typical of seafaring folk. Two figures stand close together in conversation while others are busily engaged behind them. The setting is characterized by a rocky beach and waves lapping at the shore, with some seaweed and rubble scattered in the foreground. The sky exhibits warm hues, suggesting an early morning or sunset atmosphere.

Anthropic Claude

Created on 2024-11-27

The image depicts a person, likely a man, lying down on a wooden structure or box on a beach. Around him are several other figures, some of whom appear to be standing and looking at him. The setting suggests an outdoor, coastal scene with a dramatic sky in the background. The person on the box appears to be the central figure, with the other people surrounding him. The overall tone and composition of the painting suggest a contemplative or somber mood.

Meta Llama

Created on 2024-11-24

The image is a painting of a young boy sitting on a wooden block at the beach, surrounded by other people and objects. The boy is wearing a dark-colored sweater and pants, with his legs stretched out in front of him. He has short brown hair and is looking directly at the viewer. Behind him, there are several other people standing or sitting on the beach. Some of them are wearing hats and coats, while others are dressed in lighter clothing. There are also some objects scattered around the beach, including what appears to be a piece of driftwood and some rocks. In the background, there is a body of water, possibly an ocean or sea, with waves crashing against the shore. The sky above is cloudy and gray, with a few patches of blue visible through the clouds. Overall, the image appears to be a depiction of a casual day at the beach, with people enjoying the outdoors and each other's company. The atmosphere is relaxed and peaceful, with a sense of warmth and comfort emanating from the scene.