Human Generated Data

Title

Pat Gomes with her son

Date

1990

People

Artist: Melissa Shook, American 1939 - 2020

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Lisa Rich, 2023.392

Human Generated Data

Title

Pat Gomes with her son

People

Artist: Melissa Shook, American 1939 - 2020

Date

1990

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Lisa Rich, 2023.392

Machine Generated Data

Tags

Amazon
created on 2023-11-20

Baseball Cap 100
Cap 100
Clothing 100
Footwear 99.7
Furniture 99.4
Boy 99.2
Male 99.2
Person 99.2
Teen 99.2
People 99
Body Part 99
Finger 99
Hand 99
Sandal 94.4
Hat 91.9
Shoe 88
Face 84.9
Head 84.9
Pants 84
Sitting 83.5
Shoe 77.9
Photography 67.1
Portrait 67.1
Bench 66.9
Baseball 65.7
Baseball Glove 65.7
Glove 65.7
Sport 65.7
Sneaker 63.3
Shorts 57.8
T-Shirt 55.1

Clarifai
created on 2023-11-20

people 99.9
child 99.3
two 98.9
monochrome 98.3
adult 98.1
man 96.4
portrait 95.3
woman 93.1
wear 92.6
three 92.4
offspring 92.3
sit 91.4
son 89.6
family 89.4
group 88.8
baseball 87.7
group together 86.8
facial expression 86.6
one 86.4
vehicle 86.3

Imagga
created on 2023-11-20

man 40.3
male 31.2
person 24.9
people 24.5
athlete 22.7
dad 22
adult 21.4
ballplayer 20.9
father 19.6
portrait 19.4
player 19
parent 18
child 16.8
fun 15.7
outdoors 15.7
happy 15.7
sport 15.5
lifestyle 15.2
equipment 15
baseball glove 14.7
expression 14.5
guy 14.1
boy 13.9
smiling 13.7
leisure 13.3
couple 13.1
sexy 12.8
looking 12.8
contestant 12.7
park 12.7
kid 12.4
attractive 11.9
active 11.8
model 11.7
clothing 11.7
handsome 11.6
fashion 11.3
sitting 11.2
youth 11.1
playing 10.9
cute 10.8
smile 10.7
face 10.7
vehicle 10.5
helmet 10.3
professional 10.2
casual 10.2
two 10.2
hat 10.1
holding 9.9
family 9.8
human 9.7
black 9.6
men 9.4
teen 9.2
occupation 9.2
one 9
job 8.8
healthy 8.8
weight 8.7
adults 8.5
outdoor 8.4
health 8.3
training 8.3
teenager 8.2
exercise 8.2
body 8
working 8
building 7.9
ball 7.9
sports equipment 7.9
love 7.9
day 7.8
play 7.8
summer 7.7
sky 7.7
joy 7.5
mature 7.4
chair 7.4
car 7.4
emotion 7.4
safety 7.4
street 7.4
cheerful 7.3
photographer 7.3
uniform 7.2
fitness 7.2
device 7.2
electric chair 7.1
grass 7.1
instrument 7.1
cool 7.1
wheelchair 7.1
work 7.1
little 7.1
happiness 7.1
together 7

Google
created on 2023-11-20

Footwear 98
Jeans 97.5
Shoe 94.6
Shorts 93.3
Smile 90.6
Cap 88.1
Flash photography 87
Black-and-white 85.7
Style 84.2
Baseball cap 83
Hat 82.9
Happy 79.4
Sneakers 77.4
T-shirt 76.2
Monochrome 74.9
Monochrome photography 74.7
Sky 71.3
Knee 70.5
Vintage clothing 67.8
Sitting 67.4

Microsoft
created on 2023-11-20

person 99.9
text 99.4
clothing 97.1
man 94.4
footwear 91
outdoor 89.7
human face 85.1
black and white 81.6
smile 75.7
player 61.4
posing 44.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-34
Gender Female, 99%
Confused 40.9%
Sad 28.3%
Calm 19.5%
Angry 16%
Surprised 0.7%
Disgusted 0.4%
Fear 0%
Happy 0%

Feature analysis

Amazon

Boy
Male
Person
Teen
Sandal
Hat
Shoe
Bench
Boy 99.2%

Categories

Imagga

people portraits 96.9%
paintings art 2.2%

Captions

Microsoft
created on 2023-11-20

a man posing for a photo 88.1%
an old photo of a man 88%
old photo of a man 87%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows two children sitting together on a bench. The older child, who appears to be a young boy, is wearing a white t-shirt with the text "Holiday". The younger child, who appears to be an infant, is sitting on the lap of the older child and is wearing a onesie with a cartoon character printed on it. Both children have a serious expression on their faces. The image has a black and white, documentary-style aesthetic.

Created by claude-3-opus-20240229 on 2025-01-01

The black and white photograph shows an older child or teenager holding a baby or toddler on their lap. They are seated outdoors on a wooden bench or platform. The older child is wearing a light colored sweatshirt that says "Holiday VI" on it. The baby is wearing a sweatshirt that says "Jazzfest '96" and has a pacifier in their mouth. The older child has their arms around the baby in a caring, protective manner as they both look directly at the camera.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a black and white photograph appearing to be from the late 1980s or early 1990s, showing a mother and young child sitting together on what looks like a bench or ledge. The mother is wearing a white sweatshirt with "HOLLOW" text visible, and has her hair styled with a decorative clip. She's wearing rings on her fingers and has a casual, relaxed pose. The baby is wearing a baseball cap, a sweatshirt with what appears to be a cartoon character design, and has a pacifier. The child is wearing sandals while the mother has on white sneakers and socks. The image has a documentary-style quality and appears to be shot on Kodak film, as indicated by the film markings visible on the borders of the photograph.

Text analysis

Amazon

TX
6043
KODAK TX 6043
KODAK
JAZZ
URUS
TXD12
JAZZ OS URUS
TXD11
OS
HOLIDAY
HOLIDAY V
V

Google

KODAK TX 6043 HOLID VI TXD11 JAZZOS URUS TXD12 KODAK APOS NU PETERAN
KODAK
TX
6043
HOLID
VI
TXD11
JAZZOS
URUS
TXD12
APOS
NU
PETERAN