Human Generated Data

Title

Jonathan and Kevin + Toby Scott-Hynes. October 9, 1994

Date

1994

People

Artist: Elsa Dorfman, American 1937 - 2020

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jonathan Scott and Toby "Scott-Hynes" in loving memory of Kevin Hynes, P1998.59

Copyright

© Elsa Dorfman

Human Generated Data

Title

Jonathan and Kevin + Toby Scott-Hynes. October 9, 1994

People

Artist: Elsa Dorfman, American 1937 - 2020

Date

1994

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jonathan Scott and Toby "Scott-Hynes" in loving memory of Kevin Hynes, P1998.59

Copyright

© Elsa Dorfman

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Apparel 100
Clothing 100
Human 99.5
Person 99.5
Person 98.3
Footwear 98
Pants 97
Sitting 95.9
Boot 81.2
Jeans 76.1
Denim 76.1
Wood 70.5
Shoe 67.9
Shoe 61.9
Plywood 55.8
Riding Boot 55.6
Shoe 50.9

Clarifai
created on 2018-02-19

man 97.3
people 96.3
indoors 94.9
adult 94
sit 93.6
two 92.9
furniture 91.4
woman 91.3
room 91.2
family 87.7
wear 87.5
seat 86.6
portrait 86.2
business 82.7
togetherness 82.5
sitting 80.9
looking 80.7
technology 79
one 78.9
chair 78.5

Imagga
created on 2018-02-19

man 43
male 38.1
person 34.4
happy 30.7
people 30.7
smiling 26
adult 25
couple 24.4
home 23.9
portrait 21.3
casual 21.2
lifestyle 21
sitting 20.6
grandfather 19.9
family 19.6
smile 18.5
together 18.4
attractive 17.5
boy 17.4
handsome 16.9
senior 16.9
looking 16.8
father 16.1
mature 15.8
love 15.8
child 15.7
couch 15.5
holding 14.9
dad 14.1
indoors 14.1
20s 13.7
life 12.9
fun 12.7
two 12.7
elderly 12.4
room 12.4
cute 12.2
lady 12.2
clothing 12
guy 11.1
happiness 11
house 10.9
jeans 10.5
mother 10.3
business 10.3
professional 10.1
indoor 10
confident 10
face 9.9
pretty 9.8
parent 9.8
cheerful 9.8
husband 9.7
retired 9.7
living 9.5
hairdresser 9.5
student 9.4
camera 9.2
occupation 9.2
health 9
human 9
kid 8.9
job 8.8
businessman 8.8
son 8.8
retirement 8.6
day 8.6
sofa 8.6
men 8.6
wife 8.5
old 8.4
joy 8.3
group 8.1
office 8
kin 7.8
patient 7.8
30s 7.7
loving 7.6
enjoying 7.6
sit 7.6
laughing 7.6
fashion 7.5
relaxed 7.5
one 7.5
glasses 7.4
care 7.4
friendly 7.3
alone 7.3
domestic 7.2

Google
created on 2018-02-19

photograph 95.2
poster 73
fun 59.3

Microsoft
created on 2018-02-19

person 99.9
wall 99.1
man 95.9
indoor 92.3
posing 38.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Angry 1.4%
Happy 92.9%
Calm 0.2%
Sad 0.4%
Confused 0.9%
Surprised 2.6%
Disgusted 1.6%

AWS Rekognition

Age 26-43
Gender Male, 99.8%
Surprised 5.5%
Angry 5.6%
Disgusted 2.9%
Confused 1.5%
Happy 83.4%
Calm 0.5%
Sad 0.7%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Shoe
Person 99.5%
Person 98.3%
Shoe 67.9%
Shoe 61.9%
Shoe 50.9%

Categories

Captions

Microsoft
created by unknown on 2018-02-19

a man and a woman sitting on a couch 66%
a man holding a sign 65.9%
a man and woman sitting on a couch 61.5%

Clarifai
created by general-english-image-caption-blip on 2025-05-13

a photograph of a man and a dog sitting on a chair -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

The image shows two people seated closely together, holding a small dog. One person is wearing a white shirt and black jeans while the other person is wearing a beige "Saint Martin" t-shirt and light blue jeans. The dog is tan and white, resting contentedly on their laps. The photograph has a handwritten note at the bottom that reads: “Jonathan and Kevin + Toby Scott Hynes. October, 1994”.

Created by gpt-4 on 2024-11-19

The image features two individuals seated on a wooden chair, one wearing a white long-sleeved shirt and dark pants, and the other clad in a Saint Martin t-shirt and light blue jeans. They both wear dark shoes. In the center, resting calmly on one's lap, is a small, tan and white dog with pointed ears and an attentive expression. Below the image is a handwritten inscription that reads "Jonathan and Kevin + Toby Scott-Haynes. October, 1994," suggesting that the photo captures a moment in time for these individuals and their pet. The photo is framed with a distinctive black border that gives it the appearance of a classic, developed picture.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-27

This appears to be a portrait photograph from 1994, showing two people sitting together on a wooden bench or chair. One is wearing a white long-sleeved shirt and dark pants, while the other is wearing a yellow "Saint Martin" t-shirt and light blue jeans. They are both wearing what appear to be cowboy boots. Between them sits a Basenji-type dog with distinctive reddish-brown and white coloring. The photo has a studio-like setting with a plain light background. The image has a signature or handwritten note at the bottom, and appears to be a polaroid or similar instant photo format with dark borders visible around the edges.

Created by claude-3-haiku-20240307 on 2024-11-19

The image shows two men sitting together on a chair, smiling at the camera. They are both wearing casual clothing - one is wearing a white shirt and the other is wearing a t-shirt with the text "Saint Martin". Between them is a small dog, which they are both petting. The background is plain and white.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image is a photograph of two men and a dog, taken by photographer Annie Leibovitz in 1994. The men are sitting on a wooden chair, with the dog positioned between them. The man on the left is wearing a white shirt and black pants, while the man on the right is wearing a yellow t-shirt with "SAINT MARTIN" written on it and blue jeans. The dog is tan with white markings.

The background of the image is a plain white wall, and the overall atmosphere suggests a casual and intimate moment captured by the photographer. The image is signed by the photographer at the bottom, indicating that it is an original work of art.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-01

The image is a photograph of two men sitting on a wooden chair, with one of them holding a dog. The man on the left has short dark hair and is wearing a white shirt, black pants, and black boots. He is leaning forward slightly, with his right arm around the other man's shoulder. The man on the right has short dark hair and is wearing a yellow t-shirt with "SAINT MARTIN" written across it in white letters, blue jeans, and black boots. He is sitting up straight, with his left arm around the dog.

The dog is small, with a brown and white coat, and is sitting on the man's lap. It has a white stripe running down its nose and a white patch on its chest. The background of the image is a plain beige color, with a black border around the edges. There is also a handwritten note at the bottom of the image that reads "Jonathan and Kevin + Toby Scott Hynes October 1994". The overall atmosphere of the image is one of warmth and companionship, with the two men and the dog appearing to be happy and content.

Text analysis

Amazon

MARTIN
SAIN MARTIN
SAIN
ant
/9gh
/9gh oupuis
Jott.
Sokfr
e
oupuis
Jott. ant A Hy Sokfr Ip e
Hy
Ip
A

Google

ANT MAR /994
ANT
MAR
/994