Human Generated Data

Title

Millie Murray, Doughboy Donut

Date

1988

People

Artist: Melissa Shook, American 1939 - 2020

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.407

Human Generated Data

Title

Millie Murray, Doughboy Donut

People

Artist: Melissa Shook, American 1939 - 2020

Date

1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.407

Machine Generated Data

Tags

Amazon
created on 2023-09-27

Body Part 100
Finger 100
Hand 100
Photography 99.8
Face 99.6
Head 99.6
Portrait 99.6
Person 99.3
Adult 99.3
Female 99.3
Woman 99.3
Chair 79.4
Furniture 79.4
Indoors 69.3
Text 65.6
Restaurant 57.1
Handwriting 55.4

Clarifai
created on 2023-10-13

people 99.7
portrait 99.2
adult 98.9
monochrome 98.6
woman 97.9
elderly 97.3
one 96.9
sit 96.2
chair 92.9
man 90.2
elder 88.6
indoors 86.3
street 85.5
facial expression 84.7
old 84.6
room 82.1
documentary 82
desk 81.4
family 81.3
writer 79.5

Imagga
created on 2023-09-27

senior 61.9
elderly 48.9
person 43.7
man 43
old 40.4
mature 37.2
retired 35.9
portrait 34.3
male 33.4
adult 31.8
people 29
retirement 27.9
home 24.7
happy 24.5
bartender 22.8
glasses 21.3
businessman 20.3
indoors 20.2
office 20.1
grandma 19.8
gray 19.8
sitting 19.8
looking 19.2
face 19.2
hair 19
lifestyle 18.8
laptop 18.4
aged 18.1
smiling 18.1
computer 17.8
professional 17.6
older 17.5
pensioner 16.9
couple 16.6
scholar 16.4
handsome 16.1
working 15.9
business 15.2
executive 15.2
grandmother 14.7
age 14.3
smile 14.3
intellectual 14.1
manager 14
hairdresser 14
60s 13.7
serious 13.4
grandfather 13.2
70s 12.8
alone 12.8
aging 12.5
expression 11.9
work 11.8
lady 11.4
desk 11.3
one 11.2
corporate 11.2
technology 11.1
casual 11
worker 11
elder 10.8
suit 10.8
holding 10.7
job 10.6
look 10.5
wife 10.4
men 10.3
indoor 10
confident 10
hand 9.9
gray hair 9.9
cheerful 9.8
human 9.8
health 9.7
concentration 9.7
black 9.6
husband 9.5
camera 9.2
horizontal 9.2
active 9.1
seniors 8.8
together 8.8
using 8.7
table 8.7
enjoying 8.5
modern 8.4
leisure 8.3
occupation 8.3
wrinkles 7.9
worried 7.8
expertise 7.8
eyes 7.8
1 7.7
barbershop 7.7
boss 7.7
lab coat 7.6
reading 7.6
businesspeople 7.6
tie 7.6
shop 7.3
to 7.1
happiness 7.1

Google
created on 2023-09-27

Microsoft
created on 2023-09-27

text 99
human face 96.7
person 95.2
smile 83.8
black and white 81
clothing 79.3
man 53.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 59-69
Gender Female, 98.1%
Calm 95.6%
Surprised 6.8%
Fear 5.9%
Sad 2.3%
Disgusted 1.8%
Confused 0.8%
Angry 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 71
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Female
Woman
Chair
Person 99.3%
Adult 99.3%
Female 99.3%
Woman 99.3%
Chair 79.4%

Categories

Captions

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows a close-up black and white portrait of an elderly person. The person's face appears weathered and lined, with a wrinkled brow and penetrating gaze. They have long, wispy white hair and are wearing a coat or jacket. The person seems to be gesturing or pointing with one hand. The background is slightly blurred, suggesting the focus is on the person's face and expression. The image has a pensive, thoughtful quality to it.

Created by claude-3-opus-20240229 on 2025-01-01

The black and white photograph depicts an elderly woman with long, white hair sitting at a table or desk. She appears to be speaking or gesturing with one hand raised. In front of her on the table, there seems to be an open book or document. The background shows shelves or cabinets, suggesting she may be in an office or study. The caption at the bottom of the image reads "Hella Haasse, Draafshay Donat".

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a black and white photograph showing an elderly person sitting at what appears to be a diner or restaurant table. They are wearing a light-colored jacket or coat and appear to be making a gesturing motion with one hand raised. The image has a documentary-style quality to it, with natural lighting and composition typical of candid photography. The background is somewhat blurred but shows the interior setting of what seems to be a dining establishment. The photo has a border and appears to have a handwritten caption at the bottom. The photograph captures an authentic, unposed moment that gives insight into everyday American life, possibly from several decades ago.

Text analysis

Amazon

ay
Donut
millie
millie Mus ay Daughbuy Donut
Daughbuy
Mus

Google

Millie Muuray, Daughtery Donut 32
Millie
Muuray
,
Daughtery
Donut
32