Human Generated Data

Title

Awilda Cruz, Substance Abuse Program, Long Island Shelter

Date

1988

People

Artist: Melissa Shook, American 1939 - 2020

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.397

Human Generated Data

Title

Awilda Cruz, Substance Abuse Program, Long Island Shelter

People

Artist: Melissa Shook, American 1939 - 2020

Date

1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.397

Machine Generated Data

Tags

Amazon
created on 2023-09-27

Photography 100
Face 100
Head 100
Portrait 100
Body Part 99.5
Finger 99.5
Hand 99.5
Couch 98.8
Furniture 98.8
Person 98.4
Person 90.4
Person 88.7
Adult 88.7
Male 88.7
Man 88.7
Clothing 86.7
T-Shirt 86.7
People 83.9
Text 80.2
Person 76.2
Footwear 73.3
Shoe 73.3
Hat 68.7
Accessories 61.4
Bag 61.4
Handbag 61.4
Art 57.8
Collage 57.8
Indoors 57.4
Reading 55.7
Photographer 55.2
Neck 55.2
Handwriting 55.2

Clarifai
created on 2023-10-13

people 99.2
portrait 98.9
woman 98.2
monochrome 97
one 96.9
adult 95.8
child 92.2
art 91.7
collage 91.5
man 90.5
wear 89.7
television 89.2
girl 87.9
indoors 85.6
nostalgia 85.3
music 85
retro 83.6
painting 83.4
vintage 82.9
adolescent 80.9

Imagga
created on 2023-09-27

black 31.9
adult 31.7
person 29.4
portrait 25.9
attractive 22.4
face 22
people 20.6
hair 19.8
man 19.5
happy 18.2
male 17.4
smiling 16.6
pretty 15.4
sexy 15.3
smile 15
eyes 14.6
brunette 13.9
one 13.4
fashion 12.8
looking 12.8
dark 12.5
model 12.4
sitting 12
child 11.7
human 11.2
lips 11.1
car 11.1
clothing 11
hand 10.7
world 10.6
cheerful 10.6
women 10.3
dress 9.9
holding 9.9
studio 9.9
sunglasses 9.8
working 9.7
bride 9.6
bow tie 9.5
thinking 9.5
expression 9.4
youth 9.4
cute 9.3
hands 8.7
business 8.5
skin 8.5
alone 8.2
sensuality 8.2
make 8.2
posing 8
close 8
lifestyle 8
spectacles 7.9
look 7.9
happiness 7.8
driver 7.8
casual 7.6
mirror 7.6
elegance 7.6
head 7.6
style 7.4
makeup 7.4
lady 7.3
teenager 7.3
girls 7.3
sensual 7.3
worker 7.2
body 7.2
transportation 7.2
hat 7

Google
created on 2023-09-27

Microsoft
created on 2023-09-27

text 99.6
person 95.7
human face 93.8
clothing 86.7
poster 82.5
drawing 67.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Sad 95.9%
Fear 31.8%
Angry 11.6%
Surprised 6.9%
Confused 2.9%
Calm 2.7%
Disgusted 2.2%
Happy 0.7%

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Shoe
Hat
Handbag
Person 98.4%
Person 90.4%
Person 88.7%
Person 76.2%
Adult 88.7%
Male 88.7%
Man 88.7%
Shoe 73.3%
Hat 68.7%
Handbag 61.4%

Categories

Captions

Microsoft
created on 2023-09-27

a close up of a mans face 73.2%
a picture of a person 73.1%
a screenshot of a cell phone 67.6%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image shows a black and white photograph of a person, whose face is visible in the frame. The person appears to be a woman, wearing a patterned shirt or jacket with floral designs. She has a serious expression on her face, and the image seems to have been captured in an interior setting with various objects and clutter visible in the background. The image has a vintage or documentary-style aesthetic.

Created by claude-3-opus-20240229 on 2024-12-31

The black and white photograph shows a portrait of a young African American woman wearing a floral patterned shirt or jacket. She has short curly hair and earrings and appears to be looking off to the side with a serious or pensive expression. In the background, some out-of-focus shapes and textures are visible, likely from her surroundings. Below the portrait, there is a handwritten caption that reads "Another Query Ballistrar Allem, Mayan, Aug, Silent Smith 1988".

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This is a black and white photograph from 1988 showing someone wearing a dark garment decorated with what appears to be medals or decorative pins. The person is wearing earrings and has a short hairstyle. In the left portion of the image, there are some clothes or fabric items draped over what might be furniture, creating interesting shadows and textures. The photo has a documentary-style quality typical of late 20th century social photography, with strong contrast between light and shadow. The caption at the bottom suggests this was taken at what appears to be a substance abuse program on Staten Island.

Text analysis

Amazon

1988
Island
Long
program,
amildo Cuey sulidance alway program, Long Island Shelter
Shelter
amildo
Cuey
sulidance
alway

Google

مسلتا updo Cuy Aulusranu Program, Jong Island Shelter /۶ ۶۶
مسلتا
updo
Cuy
Aulusranu
Program
,
Jong
Island
Shelter
/
۶
۶۶