Human Generated Data

Title

John Sabatine and Molly at Pat Sabatine’s Eleventh Birthday Party

Date

April 1980, printed 1983

People

Artist: Larry Fink, American 1941 - 2023

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2012.239

Copyright

© Larry Fink

Human Generated Data

Title

John Sabatine and Molly at Pat Sabatine’s Eleventh Birthday Party

People

Artist: Larry Fink, American 1941 - 2023

Date

April 1980, printed 1983

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2012.239

Copyright

© Larry Fink

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 100
Clothing 100
Human 97.3
Person 97.3
Person 95.2
Person 94.7
Party Hat 91.9
Hat 91.9
Costume 59.6
Cake 55.7
Food 55.7
Cream 55.7
Icing 55.7
Creme 55.7
Dessert 55.7
Face 55.3
Cap 55.2
Elf 55.1

Clarifai
created on 2018-02-09

people 99.9
two 99.4
portrait 98.8
man 98.1
adult 97.9
three 97.2
group 96.7
child 96.1
monochrome 95.7
facial expression 94.2
administration 93.6
offspring 92.5
four 92.2
group together 92.1
family 92
leader 90.1
son 89.8
woman 89.7
street 89.6
wear 89.4

Imagga
created on 2018-02-09

grandfather 48.1
man 39.6
male 32.3
family 32
people 31.8
father 30.5
happy 29.4
portrait 29.1
dad 28.2
couple 27
parent 26.6
grandma 25.8
love 25.2
adult 24.6
smile 23.5
person 22.9
together 22.8
senior 22.5
mother 22
face 21.3
boy 20.9
smiling 19.5
elderly 18.2
old 18.1
lifestyle 17.3
child 17.2
home 16.7
husband 16.2
attractive 15.4
wife 15.2
mature 14.9
men 14.6
grandmother 13.7
fun 13.5
women 13.4
married 13.4
happiness 13.3
youth 12.8
two 12.7
brother 12.4
son 12.4
hair 11.9
casual 11.9
aged 11.8
handsome 11.6
holding 11.6
retirement 11.5
kid 11.5
black 11.4
cheerful 11.4
looking 11.2
sitting 11.2
suit 11.1
expression 11.1
pretty 10.5
hand 9.9
romantic 9.8
lady 9.7
retired 9.7
life 9.6
marriage 9.5
girls 9.1
romance 8.9
tie 8.5
kin 8.5
wine 8.3
indoors 7.9
affection 7.7
togetherness 7.6
fashion 7.5
human 7.5
glasses 7.4
business 7.3
sexy 7.2
gray 7.2
businessman 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 99.9
man 95.1
old 47.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-5
Gender Male, 50.2%
Happy 72.2%
Confused 2.6%
Angry 5.9%
Surprised 9.8%
Disgusted 2.8%
Calm 5.8%
Sad 0.9%

Feature analysis

Amazon

Person
Person 97.3%

Categories

Captions

Microsoft
created on 2018-02-09

a black and white photo of a man 92.8%
an old photo of a man 92.7%
a man posing for a photo 92.6%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image depicts an adult and a child inside a home. The adult wears a dark buttoned shirt and a cap. The child is dressed in a shirt with a bib and is sporting a small festive cone hat. In the background, there are kitchen cabinets, a refrigerator, and some items on top of the cabinets that appear to be decorative or storage objects. The setting suggests a domestic environment.

Created by gpt-4 on 2024-11-28

The image depicts an indoor scene, likely a home interior, judging by the furniture and decor visible in the background. The photograph is black and white, adding a timeless quality to it. On the right, there is a cabinet with various items displayed on top, including what appears to be a box and some decorative objects. The wall behind the subjects shows a portion of a window with light curtains, contributing to the residential ambiance. The person on the left is wearing a dark jacket over a shirt, which features a noticeable pen-pocket protector filled with pens—suggesting an organized individual or someone with a profession or hobby involving writing or technical work. This person's attire gives a utilitarian impression, possibly hinting at a pragmatic character. The smaller individual, whose face is not described, is adorned with an item on their head that suggests playful or celebratory circumstances, perhaps indicating a family event or a child's playtime. The photograph captures a moment of apparent interaction or closeness between the two individuals, potentially signifying a familial or caregiver relationship. Despite the absence of visible facial expressions, the physical proximity and body language hint at a bond or shared experience between them.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-26

This is a heartwarming black and white photograph showing what appears to be a grandfather and baby together. The older man is wearing a baseball cap and work shirt, with a warm, genuine smile on his face. The baby, wearing a party hat and overalls, is also smiling and appears delighted. The setting looks like it might be in a home kitchen or dining area, with curtains and some items visible on shelves in the background. The image captures a tender moment between two generations and appears to be from several decades ago, given the photographic style and setting.

Created by claude-3-haiku-20240307 on 2024-11-27

The image shows an older man with a serious expression holding a young child, who appears to be a baby or toddler. The child is wearing a birthday party hat and seems to be smiling. The background suggests they are in a home setting, with curtains and decorative items visible. The overall image conveys a sense of warmth and connection between the older man and the young child.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image is a black-and-white photograph of a man holding a baby. The man, positioned on the left side of the image, wears a dark-colored shirt and a baseball cap. He has short white hair and is smiling as he looks at the baby in his arms. The baby, dressed in dark overalls and a shirt with a pattern, is also smiling. A party hat sits atop the baby's head, suggesting that the scene may be from a birthday celebration. In the background, there appears to be a kitchen setting, complete with cabinets and a refrigerator. The overall atmosphere of the image conveys a sense of joy and warmth, capturing a tender moment between the man and the baby.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-26

The image is a black-and-white photograph of an older man holding a baby in his arms. The man is wearing a dark-colored cap and a dark button-up shirt with a pen in the chest pocket. He has short white hair and is looking at the camera with a slight smile. The baby is wearing a dark-colored overall and a white shirt with a design on it. The baby is also wearing a paper party hat that says "Happy Birthday" on it. The baby is looking at the camera with a neutral expression. The background of the image shows a kitchen with cabinets and a refrigerator. There are also some curtains and a window visible in the background. The overall atmosphere of the image suggests that it was taken on a special occasion, possibly the baby's birthday, given the party hat and the man's smile.