Human Generated Data

Title

The Message

Date

1893

People

Artist: Edward Lamson Henry, American 1841 - 1919

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Theodore E. Stebbins Jr., 2003.279

Human Generated Data

Title

The Message

People

Artist: Edward Lamson Henry, American 1841 - 1919

Date

1893

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Theodore E. Stebbins Jr., 2003.279

Machine Generated Data

Tags

Amazon
created on 2023-10-23

Adult 99.6
Female 99.6
Person 99.6
Woman 99.6
Art 99.4
Painting 99.4
Person 98.7
Machine 96.9
Wheel 96.9
Transportation 96.7
Vehicle 96.7
Wagon 96.7
Carriage 95.9
Person 94.3
Animal 92.5
Horse 92.5
Mammal 92.5
Face 83.3
Head 83.3
Person 70
Accessories 62.9
Jewelry 62.9
Necklace 62.9
Horse Cart 61.8
Clothing 61.4
Glove 61.4
Wheel 59.8
Wheel 58.7
Hat 57.6
Spoke 55

Clarifai
created on 2018-08-20

cart 99.8
people 99.7
transportation system 99.4
carriage 99.2
adult 98.9
two 98.5
one 98.3
wagon 98.1
vehicle 97.5
woman 97.5
cavalry 97.5
man 95.3
lid 95.1
mammal 94.9
wear 93.9
seated 92.7
farming 92.4
chariot 92.1
group 91.4
daylight 90.7

Imagga
created on 2018-08-20

wheeled vehicle 53.8
carriage 41.4
cart 40.4
vehicle 38.9
hay 36.3
tricycle 32
wagon 30.2
horse cart 28.5
field 25.9
summer 25.7
rural 24.7
farm 24.1
wheel 21.7
barrow 21.2
outdoor 20.6
old 19.5
countryside 19.2
sky 19.1
country 18.4
outdoors 17.9
harvest 17.9
agriculture 17.5
bicycle 17.4
conveyance 17.1
wheat 17.1
handcart 17.1
landscape 16.4
people 16.2
grass 15.8
farming 15.2
bike 14.6
transport 14.6
farmland 14.5
transportation 14.3
horse 14.2
outside 13.7
adult 13.6
straw 13.5
vacation 12.3
feed 12.2
antique 12.1
happy 11.9
bale 11.8
man 11.4
natural 11.4
male 11.3
crop 11.3
sun 11.3
fodder 11.2
grain 11.1
person 11
plant 10.7
portrait 10.3
food 10.1
yellow 9.9
travel 9.9
wheels 9.8
agricultural 9.7
autumn 9.7
tree 9.2
park 9.2
barn 9.2
bales 8.9
corn 8.7
scene 8.6
happiness 8.6
pretty 8.4
city 8.3
traditional 8.3
vintage 8.3
human 8.2
tourist 8.2
fall 8.1
active 8.1
meadow 8.1
lifestyle 7.9
oxcart 7.9
day 7.8
couple 7.8
golden 7.7
cereal 7.7
wheelchair 7.6
seat 7.6
joy 7.5
fun 7.5
sport 7.4
environment 7.4
street 7.4
historic 7.3
freedom 7.3
road 7.2
sunset 7.2
holiday 7.2
activity 7.2
women 7.1
face 7.1

Google
created on 2018-08-20

Microsoft
created on 2018-08-20

outdoor 98.7
horse 98.3
transport 97.4
carriage 78.8
pulling 75.4
horse-drawn vehicle 75.2
cart 59.9
drawn 44.5
pulled 31.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 97.7%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 26-36
Gender Male, 66.8%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Female 99.6%
Person 99.6%
Woman 99.6%
Wheel 96.9%
Horse 92.5%
Necklace 62.9%
Glove 61.4%

Captions

Azure OpenAI

Created on 2024-01-25

The image depicts a rustic, picturesque scene where a rural landscape serves as the backdrop. A horse with a brown coat is harnessed to a simple wooden cart with spoked wheels. The scene gives off a calm and peaceful atmosphere, possibly a warm, sunny day. A variety of soft colored trees and shrubs, in bloom, are visible, suggesting that it might be spring or summer. In the distance, there seems to be a small structure or house, partially obscured by the foliage. The brushwork on the trees and surrounding vegetation suggests a gentle breeze might be blowing. A figure is seated on the cart, holding on to what could be a sheaf of harvested crop. Another figure stands beside the cart, looking up. The clothing and overall setting suggest an earlier time period, possibly the 19th or early 20th century. The light touches of color and the way the sunlight filters through the leaves add to the tranquil mood of the scene.

Anthropic Claude

Created on 2024-03-29

The image depicts a rural countryside setting with a woman seated in a wagon being pulled by a horse. The woman appears to be wearing a long dress and a bonnet, and she is holding what looks like a basket or small container. There is a young child sitting near her in the wagon. In the background, there is a building that resembles a farmhouse or cottage. The overall scene suggests a pastoral, 19th-century setting.

Meta Llama

Created on 2024-11-23

The image depicts a serene scene of a woman and a young boy interacting with a horse-drawn carriage. The woman, dressed in a long white dress adorned with red flowers, sits comfortably on the carriage, while the boy, wearing a white shirt and green overalls, stands beside it. The horse, a brown color, is harnessed to the carriage, which is pulled by a wooden wheel. In the background, a few people are visible, and a house can be seen in the distance. The sky above is blue with white clouds, adding to the tranquil atmosphere of the scene. The overall mood of the image is one of peace and simplicity, capturing a moment of everyday life in a rural setting.