Human Generated Data

Title

Mary E. Cox M.D.

Date

19th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2019.158

Human Generated Data

Title

Mary E. Cox M.D.

People

Artist: Unidentified Artist,

Date

19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2019.158

Machine Generated Data

Tags

Amazon
created on 2019-10-08

Clothing 99.3
Apparel 99.3
Person 97
Human 97
Coat 74.2
Overcoat 74.2
Photo 67.3
Portrait 67.3
Face 67.3
Photography 67.3
Female 65.9
People 60

Clarifai
created on 2019-10-08

people 100
one 99
adult 98.7
portrait 98.3
wear 97.6
administration 93.3
man 93
leader 92.8
two 92.1
outfit 88.2
woman 83.8
uniform 82.2
child 81
military 80.6
group 77.4
lid 77.4
three 77.3
retro 77
actor 76.7
music 74.7

Imagga
created on 2019-10-08

trench coat 100
raincoat 100
coat 93.2
garment 31.4
people 24.5
statue 23
person 22.7
portrait 22
adult 22
clothing 21.8
sculpture 20.1
old 18.8
military uniform 18.5
man 18.1
uniform 17.1
face 16.3
fashion 15.8
model 14.8
religion 14.3
smile 14.3
ancient 13.8
dress 13.5
male 13.5
hair 13.5
happy 13.2
casual 12.7
pretty 12.6
attractive 12.6
history 12.5
art 12.4
lady 12.2
smiling 11.6
lifestyle 11.6
holding 11.6
antique 11.3
monument 11.2
culture 11.1
cute 10.8
one 10.4
religious 10.3
women 10.3
jacket 10.2
figure 10
outdoor 9.9
human 9.7
sexy 9.6
looking 9.6
happiness 9.4
youth 9.4
stone 9.3
marble 8.7
hands 8.7
love 8.7
helmet 8.6
god 8.6
architecture 8.6
child 8.5
city 8.3
single 8.2
outdoors 8.2
style 8.2
detail 8
business 7.9
catholic 7.8
expression 7.7
head 7.6
shirt 7.5
vintage 7.4
tourism 7.4
retro 7.4
20s 7.3
black 7.3
body 7.2
home 7.2
handsome 7.1
family 7.1
posing 7.1
day 7.1
autumn 7

Google
created on 2019-10-08

Microsoft
created on 2019-10-08

person 99.8
clothing 99.1
standing 92.5
human face 89.6
old 86.5
coat 84.9
vintage clothing 83
posing 78.7
boy 75.8
white 68.8
photograph 68.3
retro style 60.3
portrait 57.8
child 52.2
vintage 29.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 73%
Happy 0%
Angry 0%
Sad 0%
Calm 99.9%
Disgusted 0%
Confused 0%
Fear 0%
Surprised 0%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%

Categories

Imagga

paintings art 95.3%
food drinks 2.5%

Captions

Azure OpenAI

Created on 2024-11-13

The image is a sepia-toned vintage photograph. It depicts a figure standing with one hand resting on the balustrade of what appears to be a stone staircase. The individual is dressed in period attire that includes a long-sleeved shirt and a full skirt, worn over trousers. The clothing suggests a working or utilitarian style from an earlier era. The person is wearing sturdy shoes and the outfit is belted at the waist. The backdrop of the set gives the impression of a simple interior or studio setting. The texture and tone of the image indicate that it is quite old and may have been taken in the late 19th or early 20th century.

Anthropic Claude

Created on 2024-11-13

The image shows a woman standing in front of a plain background. She is wearing a long dress with puffed sleeves and a high collar. The dress appears to be a light color, possibly white or cream. The woman has her hair neatly parted and tied back. She is standing with a serious expression on her face, looking directly at the camera. The image has the quality of an early photograph, with a grainy, sepia-toned appearance.