Human Generated Data

Title

Untitled (a musician and his family)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.46

Human Generated Data

Title

Untitled (a musician and his family)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.46

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 98.9
People 98.6
Person 98.4
Person 97.8
Family 97
Painting 78.7
Art 78.7
Face 77.6
Person 77.1
Apparel 69.5
Clothing 69.5
Helmet 69.5
Photography 64.2
Portrait 64.2
Photo 64.2
Smile 55.2

Clarifai
created on 2018-10-18

people 99.9
wear 98.7
adult 98.2
group 96.1
man 94.7
two 94.6
woman 93.1
child 93
veil 91.7
military 90.8
administration 90.6
portrait 90.2
retro 88.9
music 87.9
war 87.3
one 87
three 85.5
leader 83.9
group together 83.8
weapon 82.2

Imagga
created on 2018-10-18

statue 42.2
sculpture 29.2
art 26
old 23.7
religion 22.4
ancient 19
monument 18.7
architecture 17.2
person 17.1
culture 15.4
history 15.2
catholic 14.4
god 14.4
religious 14.1
antique 13.9
detail 13.7
man 13.4
historical 13.2
mask 13
dress 12.7
vintage 12.4
tourism 12.4
church 12
decoration 12
historic 11.9
building 11.9
stone 11.8
city 11.6
marble 11.6
people 11.2
traditional 10.8
saint 10.6
travel 10.6
faith 10.5
famous 10.2
head 10.1
holy 9.6
face 9.2
nurse 9.2
fan 9.1
tourist 9.1
mother 8.8
male 8.5
cross 8.5
portrait 8.4
clothing 8.3
kin 8.3
landmark 8.1
costume 8.1
closeup 8.1
golden 7.7
cathedral 7.7
spirituality 7.7
disguise 7.6
decorative 7.5
symbol 7.4
adult 7.4
follower 7.4
world 7.2
love 7.1

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

old 94.1
posing 92.9
person 90.6
white 72.6
vintage 45.7
clothes 18.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Surprised 1.6%
Happy 1%
Calm 6.7%
Sad 2.4%
Disgusted 1.5%
Confused 0.8%
Angry 86.2%

AWS Rekognition

Age 27-44
Gender Female, 93.9%
Confused 12.9%
Angry 15.1%
Disgusted 9.5%
Sad 44.6%
Calm 6.7%
Happy 5.1%
Surprised 6%

AWS Rekognition

Age 6-13
Gender Female, 89.8%
Disgusted 17.3%
Calm 0.2%
Surprised 4.3%
Angry 30.5%
Happy 20.4%
Sad 2.2%
Confused 25.1%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 78.7%
Helmet 69.5%

Captions

Azure OpenAI

Created by gpt-4 on 2024-11-18

This is an old sepia-toned photograph depicting two standing individuals. The person on the left appears to be holding a small round object, possibly earthenware, and is wearing multiple necklaces, some of which seem to be composed of large beads, and traditional attire. The individual stands beside a collection of thin, long sticks or rods laid out on the ground. The person on the right is wearing a draped garment and is holding a young child who is resting their head against their arm. Both individuals are barefoot, and there appears to be a painted backdrop behind them featuring tropical elements, such as palm trees, which suggests that this photo may have been taken in a studio setting designed to mimic an outdoor environment.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-11-18

The image appears to depict two people, a man and a woman, in what seems to be a tropical or exotic setting. The man is wearing traditional clothing and holding some sort of instrument, while the woman is wrapped in a shawl and carrying a child. They appear to be in a natural environment, with palm trees or other vegetation visible in the background. The image has an older, sepia-toned quality, suggesting it is an early photographic work.

Meta Llama

Created on 2024-12-01

The image is a vintage sepia-toned photograph of a man, woman, and child standing together. The man is on the left, wearing a turban and holding a round object in his right hand. He has a long beard and is dressed in a dhoti and a necklace. The woman is on the right, holding a baby in her left arm and covering her head with a cloth. She is also wearing a dhoti and a headscarf. The background of the image features a painted backdrop with palm trees and other foliage. The floor appears to be made of wood or stone, and there are some scattered objects on the ground, including what looks like a piece of fabric or a blanket. The overall atmosphere of the image suggests that it was taken in a studio or indoor setting, possibly during the late 19th or early 20th century.