Human Generated Data

Title

Untitled (three men in front of market stall)

Date

c. 1880

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.30.20

Human Generated Data

Title

Untitled (three men in front of market stall)

People

Artist: Unidentified Artist,

Date

c. 1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.30.20

Machine Generated Data

Tags

Amazon
created on 2023-10-27

Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Person 98.1
Clothing 96.5
Hat 96.5
Shop 94.6
Accessories 93.2
Jewelry 93.2
Necklace 93.2
Person 89.5
Hat 88.3
Furniture 83.8
Table 83.8
Box 78.9
Person 69.7
Butcher Shop 68.7
Indoors 64.1
Clinic 63.8
Person 62.8
Text 60.9
Hat 59
Architecture 57.2
Building 57.2
Factory 57.2
Manufacturing 57.2
Desk 57
Art 56.5
Face 56
Head 56
Photography 56
Portrait 56
Handwriting 55.5
Hospital 55.5
Dressing Room 55.4
Room 55.4
Painting 55.3
Market 55.3

Clarifai
created on 2023-10-27

people 99.7
two 98.6
woman 98.6
adult 98.6
child 98
one 97.4
painting 96.5
art 95.5
man 94.4
furniture 93.3
family 93.1
indoors 92.8
portrait 92.7
wear 92.4
room 91.8
group 91.2
baby 90.7
retro 90.4
son 90.3
nostalgia 89.9

Imagga
created on 2023-10-27

container 43.5
paper 38.8
envelope 35.8
carton 31
old 30
box 28.8
vintage 28.2
book jacket 24.9
grunge 24.7
currency 23.3
binding 23.2
retro 23
money 22.1
bill 20.9
jacket 20.4
cash 20.1
blank 19.7
texture 19.5
frame 18.5
note 18.4
empty 18
antique 17.6
ancient 17.3
bank 17
business 16.4
book 16.3
aged 16.3
finance 16.1
wrapping 15.7
banking 15.6
dollar 14.9
page 14.9
covering 14.6
wealth 13.5
exchange 13.4
home 12.8
border 12.7
savings 12.1
design 12.1
investment 11.9
brown 11.8
art 11.4
dirty 10.8
material 10.7
financial 10.7
notes 10.5
product 10.3
board 10.2
album 9.7
notebook 9.7
damaged 9.5
wall 9.5
document 9.3
card 9.1
hundred 8.7
binder 8.7
payment 8.7
change 8.7
parchment 8.6
grungy 8.5
space 8.5
history 8.1
graphic 8
indoors 7.9
grime 7.8
rate 7.8
bills 7.8
crumpled 7.8
banknote 7.8
torn 7.7
dollars 7.7
pound 7.7
decay 7.7
pay 7.7
worn 7.6
rusty 7.6
drawing 7.6
pattern 7.5
creation 7.5
symbol 7.4
shopping 7.3
historic 7.3
message 7.3
backgrounds 7.3
collection 7.2
market 7.1

Google
created on 2023-10-27

Art 82.3
Wood 82.3
Font 77.3
Rectangle 77
Tints and shades 75.1
Handwriting 72
Visual arts 67.9
Painting 66.8
Room 63.5
Paper product 62.9
Illustration 60.9
Paper 58.6
Vintage clothing 57.7
Plant 57.7
History 55.2
Pattern 52.2
Sitting 50.8

Microsoft
created on 2023-10-27

text 96.4
person 91.3
clothing 90.8
old 54.2
building material 25.1
stone 6.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 56.8%
Fear 6.5%
Angry 3.2%
Surprised 2%
Confused 0.5%
Calm 0.1%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 100%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%
Happy 0%
Sad 0%
Surprised 0%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 97.9%
Surprised 0.3%
Sad 0.2%
Happy 0.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Necklace
Box
Adult 99.4%
Adult 99.3%
Male 99.4%
Male 99.3%
Man 99.4%
Man 99.3%
Person 99.4%
Person 99.3%
Person 98.1%
Person 89.5%
Person 69.7%
Person 62.8%
Hat 96.5%
Hat 88.3%
Hat 59%
Necklace 93.2%
Box 78.9%

Categories

Captions

Microsoft
created on 2023-10-27

an old photo of a woman 54.6%
old photo of a woman 52.5%
an old photo of a woman 44.7%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows an interior view of a shop or marketplace, likely in a Middle Eastern or North African setting. Two men are seated in the foreground, one of whom appears to be a merchant or shopkeeper. The background is filled with various goods and items hanging from the ceiling or displayed on shelves, including what appear to be textiles and other wares. The overall scene suggests a bustling and active commercial space.

Created by claude-3-opus-20240229 on 2025-01-01

The sepia-toned photograph shows three men sitting in what appears to be a shop or market stall filled with various goods and wares hanging from the ceiling. The men are wearing traditional Middle Eastern attire including long robes and head coverings. They seem to be seated casually, perhaps taking a break from their work at the shop. A handwritten note is attached to the photograph that says "Come in and buy -", suggesting this may have been used to invite customers into the shop. The image provides an interesting glimpse into a Middle Eastern marketplace from an earlier era.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a historical sepia-toned photograph showing what appears to be a traditional Middle Eastern shop or market stall. Three men in traditional Middle Eastern dress (including robes and head coverings) are pictured in the scene. The shop appears to have various items hanging from above, possibly textiles or other goods, and there are boxes and containers visible throughout the space. The setting looks quite authentic and gives a glimpse into daily commercial life of what seems to be a past era. There's a handwritten note visible in the corner of the image that reads "Come in and buy."

Text analysis

Amazon

536
536 Epicerie of
P1985.30.20
Some in
Epicerie
of

Google

Hom P1485.30.20 536 Epicerie Come in and and b buy-
Hom
P1485.30.20
536
Epicerie
Come
in
and
b
buy