Human Generated Data

Title

Untitled (three portrait photographs)

Date

1855-1885

People

Artist: Unidentified Artist,

Artist: Frederica Louisa Bayly, British born 1846

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.409.14.2

Human Generated Data

Title

Untitled (three portrait photographs)

People

Artist: Unidentified Artist,

Artist: Frederica Louisa Bayly, British born 1846

Date

1855-1885

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.409.14.2

Machine Generated Data

Tags

Amazon
created on 2024-04-17

Art 100
Collage 100
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Painting 98.9
Person 98.2
Adult 98.1
Person 98.1
Bride 98.1
Female 98.1
Wedding 98.1
Woman 98.1
Adult 98
Person 98
Bride 98
Female 98
Woman 98
Face 97.9
Head 97.9
Photography 97.9
Portrait 97.9
Person 97.8
Adult 97.7
Person 97.7
Bride 97.7
Female 97.7
Woman 97.7
Adult 97.1
Person 97.1
Bride 97.1
Female 97.1
Woman 97.1
Adult 96.4
Person 96.4
Bride 96.4
Female 96.4
Woman 96.4
Person 94.3
Adult 94.2
Person 94.2
Bride 94.2
Female 94.2
Woman 94.2
Animal 81.9
Horse 81.9
Mammal 81.9
Adult 75.2
Person 75.2
Bride 75.2
Female 75.2
Woman 75.2
Clothing 74.1
Hat 74.1
Dress 57.2
Photo Booth 56
Text 55.4
Book 55.1
Publication 55.1

Clarifai
created on 2024-04-17

people 99.8
adult 98
group 97.6
woman 97.5
man 97.1
two 97.1
no person 94
print 93.4
one 92.7
wear 92.1
child 91.9
painting 91.9
art 89.5
war 87.1
many 85.8
elderly 83.8
leader 82.9
several 82.5
three 81.8
furniture 81

Imagga
created on 2024-04-17

insulating material 43.7
currency 33.2
building material 32.8
money 29.8
cash 26.5
vintage 23.2
stamp 22.8
paper 22.7
bank 21.8
envelope 21.2
bill 20.9
finance 20.3
banking 20.2
letter 20.2
old 19.5
business 19.4
mail 19.1
wealth 18.9
postmark 17.7
postage 17.7
savings 16.8
symbol 16.2
dollar 15.8
retro 15.6
postal 14.7
banknote 14.6
culture 14.5
hundred 14.5
dollars 14.5
financial 14.3
note 13.8
printed 13.8
global 13.7
art 13.7
one 13.4
exchange 13.4
post 13.4
design 13.2
shows 12.8
close 12.6
communications 11.5
container 11.4
antique 11.3
ancient 11.2
office 10.9
bills 10.7
cutting 10.6
notes 10.5
unique 10.4
black 10.2
investment 10.1
painter 10
collection 9.9
masterpiece 9.9
circa 9.9
stamps 9.9
frame 9.8
paintings 9.8
states 9.7
painted 9.5
united 9.5
icon 9.5
economy 9.3
aged 9
sign 9
history 8.9
post mail 8.9
zigzag 8.9
fame 8.9
philately 8.9
known 8.9
pounds 8.8
renaissance 8.8
banknotes 8.8
delivery 8.7
museum 8.7
pound 8.7
international 8.6
fine 8.6
grunge 8.5
photograph 8.4
creation 8.3
message 8.2
market 8
queen 7.8
us 7.7
stained 7.7
pay 7.7
pattern 7.5
china 7.5
blackboard 7.5
stock 7.5
rich 7.4
object 7.3
portrait 7.1

Google
created on 2024-04-17

Rectangle 79.8
Font 77.2
Design 68.5
Art 66.4
Paper product 62.6
History 62.1
Paper 60.2
Room 59.9
Vintage clothing 59.3
Visual arts 55.5
Gadget 54
Pattern 53.4
Square 51.7
Illustration 50.9

Microsoft
created on 2024-04-17

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-32
Gender Female, 99.2%
Calm 77.4%
Happy 4.7%
Surprised 0.2%
Confused 0.1%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Female, 70.3%
Calm 82.9%
Sad 10.7%
Happy 0%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Female, 100%
Calm 100%
Sad 0%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Calm 98.4%
Confused 0.4%
Surprised 0.4%
Sad 0.2%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 25-33
Gender Male, 98.8%
Calm 100%
Happy 0%
Sad 0%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 42-50
Gender Female, 100%
Calm 100%
Surprised 0%
Angry 0%
Confused 0%
Sad 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 39-47
Gender Female, 76.3%
Calm 100%
Angry 0%
Confused 0%
Surprised 0%
Sad 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Female, 100%
Sad 99.8%
Calm 0.7%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 46-54
Gender Female, 100%
Calm 91.6%
Angry 3.5%
Sad 0.6%
Confused 0.2%
Surprised 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 19-25
Gender Male, 88.5%
Calm 99.8%
Happy 0%
Surprised 0%
Sad 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman
Horse
Hat
Adult 99.1%
Adult 98.1%
Adult 98%
Adult 97.7%
Adult 97.1%
Adult 96.4%
Adult 94.2%
Adult 75.2%
Male 99.1%
Man 99.1%
Person 99.1%
Person 98.2%
Person 98.1%
Person 98%
Person 97.8%
Person 97.7%
Person 97.1%
Person 96.4%
Person 94.3%
Person 94.2%
Person 75.2%
Bride 98.1%
Bride 98%
Bride 97.7%
Bride 97.1%
Bride 96.4%
Bride 94.2%
Bride 75.2%
Female 98.1%
Female 98%
Female 97.7%
Female 97.1%
Female 96.4%
Female 94.2%
Female 75.2%
Woman 98.1%
Woman 98%
Woman 97.7%
Woman 97.1%
Woman 96.4%
Woman 94.2%
Woman 75.2%
Horse 81.9%
Hat 74.1%

Categories

Imagga

paintings art 99.5%

Captions

Microsoft
created on 2024-04-17

a group of people in a frame 37.4%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image appears to be a page from an old photograph album. It contains several black and white photographs arranged in a collage-style format. The main image at the top shows a group portrait of several people, including an older woman seated in the center, surrounded by other women and men. One man is standing beside a horse. The individuals are dressed in formal attire typical of the late 19th or early 20th century. The two smaller images at the bottom show individual portraits of two women, also dressed in the fashion of that era. The text below the main image identifies the people as "Rudy" and "Miss Cannon", and the date is noted as "7.2.18". Overall, the page appears to be a collection of historical photographs, likely documenting the lives and relationships of the people depicted.

Created by claude-3-opus-20240229 on 2024-12-31

The image shows an old photograph album page containing three black and white photographs from the late 19th or early 20th century. The largest photo at the top depicts a group portrait of what appears to be a wealthy family posing outdoors. There are six people in Victorian-era clothing - women in long dresses and men in suits and hats. A horse and carriage can be seen in the background. Below this main image are two smaller portrait photos. The left one shows three women, likely servants based on their simple dresses and aprons. The right photo portrays two well-dressed women, potentially the lady of the house and her daughter or a relative. Handwritten captions underneath each photograph provide names and a date, but the writing is a bit hard to make out clearly. Overall, the album page provides a glimpse into the lives and fashions of an upper-class family from over a century ago.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This appears to be a collection of vintage sepia photographs from what seems to be the Victorian era. The main photograph shows a group of domestic staff members, including several people in maid uniforms with white aprons and caps, along with a horse and a small dog. The scene is set outdoors against a backdrop of shrubs or hedges. Below the main photo are two smaller portraits showing pairs of staff members in similar maid uniforms with their distinctive white aprons and caps. The images appear to be mounted in what looks like a photo album page, with handwritten notes beneath identifying different locations or names. The photograph style and clothing suggest these were taken in the late 19th century. The quality and formality of the photographs, including the presence of the horse, suggests this might be from a wealthy household's documentation of their domestic staff.

Text analysis

Amazon

Horse
"Hopes"
DIGITAL SG
"Ruby
"Scott"
cuppe
"Ruby Horse 72B. Canham
no
72B.
cook
S A no
A
"Sultan"
Canham
Pearse cook "mac"
S
Pearse
Exchen
xxxrite
"mac"
Permint
71982.409.14.2

Google

"Cultan 1987.409.14.1 Beaumont "Horse Cannam Pearse Cook mae. "Ruby" "7210. Cuppe Exeter Xx-rite colorchecker DIGITAL SG D "Scott" "Hopes"
"
Cultan
1987.409.14.1
Beaumont
Horse
Cannam
Pearse
Cook
mae
.
Ruby
7210
Cuppe
Exeter
Xx
-
rite
colorchecker
DIGITAL
SG
D
Scott
Hopes