Human Generated Data

Title

Tammy White, Long Island Shelter

Date

1988

People

Artist: Melissa Shook, American 1939 - 2020

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.418

Human Generated Data

Title

Tammy White, Long Island Shelter

People

Artist: Melissa Shook, American 1939 - 2020

Date

1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.418

Machine Generated Data

Tags

Amazon
created on 2023-09-28

Body Part 100
Finger 100
Hand 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.4
Electronics 95.7
Screen 95.7
Computer Hardware 92.1
Hardware 92.1
Monitor 92.1
Clothing 67.4
Knitwear 67.4
Sweater 67.4
Text 61.9
Happy 57.6
Smile 57.6
Phone 57.4
TV 56.6
Mobile Phone 55.9
Neck 55.5

Clarifai
created on 2023-10-13

portrait 99.4
people 99.3
one 97.9
adult 96.6
monochrome 95.9
woman 94.9
window 93.3
man 92.5
indoors 87.8
sit 87.4
business 87
girl 86.4
family 85.2
computer 79.3
facial expression 78.7
room 77.6
technology 76.3
child 75.4
smile 74.8
person 74

Imagga
created on 2023-09-28

grand piano 49.7
piano 42.8
person 35
adult 30.6
keyboard instrument 30.1
percussion instrument 30.1
stringed instrument 30
business 29.2
people 28.5
office 27.8
work 22
musical instrument 21.2
computer 20.9
attractive 20.3
call 19.5
happy 19.4
portrait 19.4
professional 19
sitting 18.9
businessman 17.7
laptop 17.6
pretty 17.5
man 16.8
businesswoman 16.4
black 16.3
smile 15.7
suit 15.5
corporate 15.5
looking 15.2
executive 15.2
desk 15.1
working 15
scholar 14.9
face 14.9
lady 14.6
smiling 14.5
lifestyle 14.5
male 14.3
job 14.2
one 13.4
worker 13.4
success 12.9
confident 12.7
telephone 12.7
communication 12.6
hand 12.2
phone 12
intellectual 11.9
women 11.9
indoors 11.4
hair 11.1
model 10.9
cheerful 10.6
human 10.5
tie 10.4
manager 10.2
car 10.2
fashion 9.8
sexy 9.6
automobile 9.6
businesspeople 9.5
career 9.5
expression 9.4
cute 9.3
casual 9.3
friendly 9.2
modern 9.1
holding 9.1
world 8.8
standing 8.7
talking 8.6
groom 8.4
student 8.3
20s 8.2
successful 8.2
outdoors 8.2
technology 8.2
style 8.2
home 8
education 7.8
elegant 7.7
workplace 7.6
child 7.6
keyboard 7.5
blond 7.4
indoor 7.3
body 7.2
handsome 7.1
clothing 7

Google
created on 2023-09-28

Microsoft
created on 2023-09-28

text 99.3
human face 97.9
person 94.9
smile 93.4
black and white 92.7
clothing 89.6
man 72.9
monochrome 56.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 99.7%
Happy 96.2%
Surprised 6.5%
Fear 6.2%
Sad 2.4%
Angry 0.7%
Disgusted 0.5%
Confused 0.3%
Calm 0.2%

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.4%

Categories

Captions

Microsoft
created on 2023-09-28

graphical user interface 32.1%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image shows a black and white photograph of a person, likely a woman, sitting in front of a window. The person has curly hair and is smiling while holding a phone or receiver to their ear. The background includes furniture and what appears to be a wintry outdoor scene visible through the window. The image is titled "Fannie White, 1988" at the bottom.

Created by claude-3-opus-20240229 on 2024-12-31

The black and white image shows a smiling young woman sitting by a window, with her hand touching the side of her face. She appears to be looking out the window thoughtfully. The woman has short curly hair and is wearing a collared shirt or sweater. The photo seems to have been taken in 1988 based on the handwritten note at the bottom.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This is a black and white photograph from 1988 showing someone sitting near a window. They are wearing a knit sweater over a white collared shirt and have natural, curly hair styled in a distinctive 1980s fashion. The subject appears to be in a contemplative or casual mood, with one hand raised to their head, and displaying a gentle smile. The composition has a documentary-style feel to it, with natural lighting coming in from the window. The image has a grainy, film quality typical of photographs from that era, with a dark border around the edges. There appears to be handwriting at the bottom of the photograph indicating a location of "Long Island Shelter."

Text analysis

Amazon

1988
Island
Jammy
Jammy White, Long Island Shelter
Long
White,
Shelter

Google

Tammy White, Forg land Shelter 1988
Tammy
White
,
Forg
land
Shelter
1988