Human Generated Data

Title

Diana Paliotto and a friend, Brookline Lunch, Cambridge

Date

1990

People

Artist: Melissa Shook, American 1939 - 2020

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.415

Human Generated Data

Title

Diana Paliotto and a friend, Brookline Lunch, Cambridge

People

Artist: Melissa Shook, American 1939 - 2020

Date

1990

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Kristina Shook and The Estate of M. Melissa Shook, 2023.415

Machine Generated Data

Tags

Amazon
created on 2023-12-05

Photography 99.9
Face 99.7
Head 99.7
Portrait 99.7
Body Part 99.6
Finger 99.6
Hand 99.6
Person 99.5
Adult 99.5
Male 99.5
Man 99.5
Indoors 99.5
Restaurant 99.5
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Cup 94.8
Beverage 76.6
Coffee 76.6
Coffee Cup 76.6
Coffee Cup 61.9
Cafe 57.6
Text 56.7
Cafeteria 56.7
Sitting 55.2

Clarifai
created on 2023-12-05

people 99.8
portrait 99.4
adult 98.7
two 97.9
man 96.2
one 95.5
woman 94.2
monochrome 94.1
sit 93.1
music 90.1
furniture 89.9
actor 88.4
family 85.4
room 84.9
facial expression 84
wear 79.6
indoors 78.5
retro 78.1
three 77.8
musician 77.4

Imagga
created on 2023-12-05

man 42.3
male 37.7
person 33.1
adult 31.7
computer 28.7
people 28.4
call 28.3
office 26.3
looking 25.6
sitting 24.9
business 24.9
handsome 24.1
businessman 23.8
work 22
portrait 21.4
working 21.2
laptop 21
desk 20.9
face 20.6
happy 19.4
serious 18.1
attractive 17.5
one 17.2
smiling 16.6
smile 15.7
senior 15
look 14.9
technology 14.8
professional 14.3
black 13.8
men 13.7
casual 13.6
phone 12.9
corporate 12.9
student 12.8
suit 12.8
guy 12.8
communication 12.6
lifestyle 12.3
mature 12.1
inside 12
expression 11.9
head 11.8
indoors 11.4
talking 11.4
executive 11.3
old 11.1
glasses 11.1
confident 10.9
worker 10.8
keyboard 10.3
alone 10
hand 9.9
cheerful 9.8
job 9.7
table 9.6
elderly 9.6
home 9.6
newspaper 9.6
tie 9.5
shirt 9.3
modern 9.1
holding 9.1
device 9
harmonica 8.9
sexy 8.8
education 8.7
stress 8.6
age 8.6
close 8.6
thinking 8.5
pretty 8.4
telephone 8.3
lady 8.1
hair 7.9
women 7.9
couple 7.8
model 7.8
monitor 7.8
driver 7.8
businesspeople 7.6
career 7.6
vehicle 7.5
microphone 7.5
car 7.4
product 7.3
indoor 7.3
businesswoman 7.3
free-reed instrument 7.1
happiness 7.1

Google
created on 2023-12-05

Microsoft
created on 2023-12-05

text 99.1
human face 99.1
person 98.6
indoor 98.2
black and white 88.6
clothing 85.4
smile 64.5
woman 54.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 99%
Sad 0.5%
Happy 0%
Confused 0%
Angry 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 47-55
Gender Female, 99.7%
Calm 89.1%
Sad 3.3%
Happy 0.7%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Coffee Cup
Person 99.5%
Person 99.2%
Adult 99.5%
Adult 99.2%
Male 99.5%
Male 99.2%
Man 99.5%
Man 99.2%
Coffee Cup 76.6%
Coffee Cup 61.9%

Categories

Imagga

people portraits 97.6%
paintings art 1.6%

Captions

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image appears to be a black and white photograph of two people, a man and a woman, sitting at a table together. The man has a serious expression on his face and is wearing a striped shirt. The woman is looking at the camera and has a pensive expression. They both have cups or mugs in front of them, suggesting they may be in a cafe or restaurant setting. The photograph is dated 1990 and is captioned "Diane Middleton and friend Brendan Hardy, Cambridge".

Created by claude-3-opus-20240229 on 2025-01-01

The black and white image shows a man and a woman sitting at a table together. The man is wearing a striped sweater and has his hand on his chin, appearing deep in thought. The woman, who has short, curly hair, is leaning on the table and resting her chin on her hand while looking off to the side. There are two mugs on the table in front of them. The photograph is dated 1990 and captioned "Diane Palotta and a Jewish Psychic, Cambridge".

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a black and white photograph taken in 1990 at Peet's Breakfast Shop in Cambridge. The image shows two people sitting at what appears to be a café table with coffee mugs in front of them. One person is wearing a striped dark sweater or shirt, while the other is wearing a light-colored knit sweater. The composition has a casual, candid feel to it, capturing what seems to be a relaxed moment during a coffee break or meeting. The table has some papers on it, suggesting they might have been in discussion or working together. The photograph has a distinctive documentary style common to the period, with strong contrast and intimate framing.

Text analysis

Amazon

and
1990
fund,
Diana
Cambridge
Diana Poliotts and c fried, Brookline fund, Cambridge
c
Brookline
fried,
Poliotts

Google

Diana Paliotts and a fucis, Brookline fund, Cambridge 1990
Diana
Paliotts
and
a
fucis
,
Brookline
fund
Cambridge
1990