Human Generated Data

Title

Untitled (top, unidentified couple, woman seated, man standing with right hand on woman's shoulder; bottom, view of unidentified city, possibly Valletta, Malta)

Date

1855-1885

People

Artist: Unidentified Artist,

Artist: Frederica Louisa Bayly, British born 1846

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.409.18.2

Human Generated Data

Title

Untitled (top, unidentified couple, woman seated, man standing with right hand on woman's shoulder; bottom, view of unidentified city, possibly Valletta, Malta)

People

Artist: Unidentified Artist,

Artist: Frederica Louisa Bayly, British born 1846

Date

1855-1885

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.409.18.2

Machine Generated Data

Tags

Amazon
created on 2024-04-17

Art 99.9
Collage 99.9
Painting 99.8
Adult 99
Male 99
Man 99
Person 99
Adult 98.6
Person 98.6
Bride 98.6
Female 98.6
Wedding 98.6
Woman 98.6
Accessories 85
Formal Wear 85
Tie 85
Clothing 82.4
Coat 82.4
Face 81.9
Head 81.9
Scoreboard 66.3
Archaeology 56.7
Canvas 56.1
Dress 55.8
Sculpture 55.1
Slate 55.1
Fashion 55.1
Gown 55.1

Clarifai
created on 2024-04-17

no person 98.5
people 97.8
man 96
art 95.9
painting 95.6
two 95.3
retro 95.2
one 95.1
adult 93.4
woman 92.5
antique 90.6
wear 88.4
indoors 88.2
architecture 87.4
dirty 85.7
ancient 85.6
Renaissance 85.1
museum 84.2
travel 83.7
elderly 83.3

Imagga
created on 2024-04-17

old 42.5
frame 37.7
vintage 37.2
retro 32.8
texture 31.2
grunge 30.6
paper 29.9
antique 28.8
blank 28.3
border 27.1
wall 23.3
empty 23.2
ancient 22.5
aged 20.8
art 20.3
material 18.8
dirty 18.1
design 17.4
damaged 17.2
wallpaper 16.1
sheet 16
album 15.6
rough 15.5
structure 15
textured 14.9
historic 14.7
insulating material 14.2
page 13.9
pattern 13.7
crumpled 13.6
film 13.6
grungy 13.3
decoration 13.1
device 13.1
scrapbook 12.6
brown 12.5
rusty 12.4
photograph 11.9
screen 11.7
element 11.6
edge 11.5
cardboard 11.5
old fashioned 11.4
backgrounds 11.4
display 11.2
grain 11.1
template 11
television 10.8
frames 10.7
grime 10.7
building material 10.7
card 10.6
decay 10.6
parchment 10.6
obsolete 10.5
worn 10.5
document 10.2
space 10.1
instant 9.8
surface 9.7
monitor 9.7
fracture 9.7
stains 9.7
text 9.6
artistic 9.5
letter 9.2
board 9.1
tourism 9.1
paint 9.1
machine 8.9
interior 8.8
mottled 8.8
faded 8.8
memory 8.7
spot 8.6
historical 8.5
travel 8.4
black 8.4
cover 8.3
backdrop 8.2
building 8.1
history 8
graphic 8
blackboard 8
framework 8
computer 7.8
photographic 7.8
ragged 7.8
microwave 7.8
announcement 7.8
stained 7.7
aging 7.7
weathered 7.6
photography 7.6
kitchen appliance 7.5
wood 7.5
cash machine 7.4
ornate 7.3
home appliance 7.3
equipment 7.2
panel 7
architecture 7

Google
created on 2024-04-17

Product 90.8
Rectangle 87.6
Art 74.5
Sculpture 74.4
Wood 69.1
Visual arts 60.2
Paper product 56.6
Room 56.6
Font 56.1
Vintage clothing 56
Metal 55.3
History 53.7

Microsoft
created on 2024-04-17

art 96.4
picture frame 87.8
statue 86.5
visual arts 85.8
rectangle 85.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-40
Gender Female, 96.6%
Calm 84%
Happy 3.2%
Surprised 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 32-40
Gender Male, 100%
Calm 88.7%
Fear 2.4%
Confused 1.7%
Angry 1.1%
Surprised 1%
Sad 0.5%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman
Tie
Coat
Scoreboard
Adult 99%
Adult 98.6%
Male 99%
Man 99%
Person 99%
Person 98.6%
Bride 98.6%
Female 98.6%
Woman 98.6%
Tie 85%
Coat 82.4%
Scoreboard 66.3%

Categories

Captions

Microsoft
created on 2024-04-17

a statue of a man and a woman 38.8%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

This image appears to be a photograph from an old photo album or scrapbook. The upper part of the image shows a portrait of a man and a woman posed together. They appear to be dressed in attire typical of the late 19th or early 20th century. The lower part of the image shows a cityscape, likely a panoramic view of a city from some elevated vantage point. The album or scrapbook appears to be well-worn, with the pages showing signs of age and use over time.

Created by claude-3-opus-20240229 on 2025-01-01

The sepia-toned photograph depicts a man and woman from the late 19th or early 20th century posing together. The woman is seated and wearing an elegant dress with puffed sleeves. The man is standing beside her, dressed in a three-piece suit with a vest and tie. Both have serious expressions, as was common in portraits from that era. The photograph is mounted in an open book or album, with the facing page visible but blank.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This appears to be a page from an old photo album containing two sepia-toned photographs. The top photograph is a formal Victorian-era studio portrait showing a couple - the woman is seated wearing a high-necked dress with buttons, while the man stands beside her wearing a three-piece suit with a bow tie and sporting a mustache. The bottom photograph appears to be a landscape or cityscape view, showing what looks like a harbor or port town with buildings and boats visible in the distance. The image has a somewhat faded, atmospheric quality typical of 19th century photography. Both photographs are mounted on what appears to be a cream-colored album page with worn edges and some aging visible.

Text analysis

Amazon

colorchecker
DIGITAL
colorchecker DIGITAL SG
SG
xxrite

Google

P1957.09. colorchecker DIGITAL SG Xx-rite 4 5 6
P1957.09
.
colorchecker
DIGITAL
SG
Xx
-
rite
4
5
6