Human Generated Data

Title

Untitled (group of adults and children)

Date

c. 1880

People

Artist: Félix Bonfils, French 1831 - 1885

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.30.72

Human Generated Data

Title

Untitled (group of adults and children)

People

Artist: Félix Bonfils, French 1831 - 1885

Date

c. 1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.30.72

Machine Generated Data

Tags

Amazon
created on 2023-10-27

Art 99.1
Painting 99.1
Adult 98.6
Male 98.6
Man 98.6
Person 98.6
Person 98.6
Adult 98.5
Person 98.5
Bride 98.5
Female 98.5
Wedding 98.5
Woman 98.5
Adult 98.1
Person 98.1
Bride 98.1
Female 98.1
Woman 98.1
People 96.8
Person 96.2
Person 96.1
Person 94.6
Face 84.4
Head 84.4
Person 79.5
Person 77.7
Text 69
Person 67.6
Person 61.2
Photography 57.9
Portrait 57.9
Page 56.1
Drawing 55.5

Clarifai
created on 2023-10-27

people 100
group 99.5
print 99.1
adult 98.9
art 98.4
man 98.2
woman 96.6
wear 96.2
two 95.8
painting 95.5
many 95.3
illustration 94.8
war 93.4
one 93
portrait 92.4
leader 92
child 89.6
several 89.4
retro 88.8
administration 88.6

Imagga
created on 2023-10-27

envelope 100
container 53.8
vintage 42.2
old 34.2
retro 29.5
paper 28.2
stamp 25.7
grunge 23.8
ancient 22.5
mail 22
postmark 21.7
letter 21.1
book jacket 20.3
antique 19.9
aged 19.9
postage 19.7
money 19.6
postal 18.7
cash 18.3
currency 18
card 16.5
art 16.3
bill 16.2
drawing 16.1
comic book 15.9
jacket 15.8
post 15.3
printed 14.8
history 14.3
texture 13.9
circa 13.8
note 13.8
finance 13.5
design 13.5
bank 13.4
dollar 13
wrapping 13
philately 12.8
map 12.5
states 11.6
dollars 11.6
symbol 11.4
united 11.4
message 11
global 10.9
frame 10.9
shows 10.8
wealth 10.8
old fashioned 10.5
banking 10.1
financial 9.8
one 9.7
black 9.6
decorative 9.2
close 9.1
business 9.1
covering 9.1
dirty 9
us 8.7
pay 8.6
culture 8.5
savings 8.4
rich 8.4
paint 8.1
border 8.1
collection 8.1
stamps 7.9
address 7.8
banknote 7.8
travel 7.7
blank 7.7
geography 7.7
flower 7.7
exchange 7.6
decoration 7.5
page 7.4
sketch 7.3
earth 7.3
office 7.2
world 7.1
insulating material 7.1

Google
created on 2023-10-27

Handwriting 87.6
Art 83.5
Font 75.5
Painting 75.5
Rectangle 72.2
Visual arts 69.2
Illustration 68.7
Drawing 67.6
Vintage clothing 66.5
Room 64.5
Paper product 64.5
Paper 63.9
History 62.7
Wood 59
Tree 56.5
Pattern 55.4
Printmaking 52.8

Microsoft
created on 2023-10-27

text 99
person 95.8
clothing 94.8
handwriting 88.9
drawing 88.7
cartoon 83
book 63.7
poster 61.2
sketch 59.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-39
Gender Female, 68.6%
Angry 69.1%
Confused 15.6%
Sad 6.1%
Calm 2.9%
Fear 2.4%
Happy 1.2%
Surprised 0.3%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Angry 90%
Happy 3.3%
Calm 0%
Confused 0%
Fear 0%
Sad 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 51.6%
Angry 27.6%
Sad 9.3%
Confused 3.8%
Disgusted 1.4%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 41-49
Gender Female, 100%
Angry 64.5%
Confused 31.3%
Fear 4.4%
Disgusted 3.6%
Sad 2.9%
Calm 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 24-32
Gender Male, 96.6%
Sad 52%
Confused 29.1%
Angry 28.8%
Surprised 10.5%
Calm 4.3%
Disgusted 2.1%
Fear 0.4%
Happy 0.1%

AWS Rekognition

Age 27-35
Gender Male, 99.8%
Calm 88.1%
Sad 4.9%
Confused 1.2%
Angry 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.6%
Fear 98.8%
Confused 0.8%
Sad 0.3%
Surprised 0.1%
Calm 0.1%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Unlikely
Sorrow Likely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman
Adult 98.6%
Adult 98.5%
Adult 98.1%
Male 98.6%
Man 98.6%
Person 98.6%
Person 98.6%
Person 98.5%
Person 98.1%
Person 96.2%
Person 96.1%
Person 94.6%
Person 79.5%
Person 77.7%
Person 67.6%
Person 61.2%
Bride 98.5%
Bride 98.1%
Female 98.5%
Female 98.1%
Woman 98.5%
Woman 98.1%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2023-10-27

a person posing for a photo 55.9%
a vintage photo of a person 50.4%
a photo of a person 50.3%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image depicts a group of people standing together in what appears to be a desert or tropical environment. The individuals are dressed in traditional robes or shawls, and some are carrying what seem to be baskets or bags. There are palm trees or other foliage visible in the background, suggesting a warm, outdoor setting. The image has a sepia tone, indicating it is likely an older photograph.

Created by claude-3-opus-20240229 on 2025-01-01

The black and white photograph depicts a group of women, likely from Africa or the Middle East based on their clothing, standing together outdoors in front of palm trees and small structures. The women are wearing long, flowing garments and some have wraps or scarves on their heads. Several are holding infants or young children. They appear to be in a rural village setting. Below the photograph is a handwritten note that reads "Poor black sheep-skin-yelp ladies and lords own themselves".

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This appears to be a historical photograph, likely from the colonial era, showing a group of people in traditional Middle Eastern or North African dress. The setting appears to be near palm trees in what looks like an arid region. The individuals are wearing loose-fitting robes and head coverings typical of the region. Both adults and children are present in the image, and they are standing together as a group. The photograph has a sepia tone characteristic of early photography, and there is a handwritten caption at the bottom. The background shows some stone or mud-brick structures among the palm trees, suggesting this may be in a village or settlement.

Text analysis

Amazon

ladies
and
they
and lords
lords
seem
Poro hash they seem -yel ladies
hash
71985.30.72
-yel
Poro

Google

1985.30.72 foor track then and lords into themsetres Reem - yeh ladies
1985.30.72
foor
track
then
and
lords
into
themsetres
Reem
-
yeh
ladies