Human Generated Data

Title

Vernon MacNeil

Date

1977, printed 1984

People

Artist: Wendy Snyder MacNeil, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1599

Human Generated Data

Title

Vernon MacNeil

People

Artist: Wendy Snyder MacNeil, American 20th century

Date

1977, printed 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1599

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 98.2
Person 97.9
Person 97.8
Person 94.8
Person 93.1
Collage 92
Poster 92
Advertisement 92
Person 91.1
Person 89.5
Person 89.3
Person 85.1
Clothing 83.1
Apparel 83.1
Wheel 78
Machine 78
Person 77.6
Person 73.1
Outdoors 71.2
Text 70.7
Nature 69.9
Photography 63.1
Photo 63.1
People 62.4
Person 61.3
Person 61.2
Paper 60.4
Flyer 60.1
Brochure 60.1
Art 59.8
Face 59.1
Suit 58.2
Overcoat 58.2
Coat 58.2
Housing 57.7
Building 57.7
Person 56.3
Drawing 56.1
Person 42.5

Clarifai
created on 2023-10-25

people 99.6
no person 98.9
adult 98.8
group 98.1
woman 97.5
room 96.5
furniture 96
man 95.9
portrait 95.4
one 95
print 94.5
many 94.4
girl 94.3
wear 94.3
art 94.1
architecture 91.8
child 89.4
indoors 89.3
two 88.8
interior design 88.4

Imagga
created on 2022-01-08

sketch 25.2
vintage 23.7
drawing 22
design 20.9
retro 20.5
grunge 20.4
paper 19.6
old 19.5
frame 18.6
business 18.2
film 16.8
border 14.5
office 14.2
graphic 13.8
negative 13.8
antique 13.7
dirty 13.5
sign 13.5
building 12.9
letter 12.8
art 12.7
house 12.5
texture 12.5
stall 12.4
representation 12.4
symbol 12.1
blank 11.1
style 11.1
card 11
cash 11
architecture 10.9
device 10.7
damaged 10.5
text 10.5
black 10.2
digital clock 10.2
city 10
structure 9.9
pattern 9.6
money 9.4
finance 9.3
note 9.2
template 9.2
aged 9
currency 9
locker 8.9
case 8.8
empty 8.6
space 8.5
bank 8.5
clock 8.5
block 8.4
collection 8.1
brown 8.1
set 8
home 8
stamp 7.9
urban 7.9
ancient 7.8
strip 7.8
modern 7.7
grungy 7.6
sheet 7.5
dark 7.5
wood 7.5
decoration 7.5
silhouette 7.4
element 7.4
dollar 7.4
fastener 7.4
historic 7.3
metal 7.2
icon 7.1
wooden 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 93.1
white 64.4
person 57.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 91.8%
Calm 3.7%
Disgusted 0.9%
Surprised 0.9%
Angry 0.8%
Fear 0.7%
Confused 0.7%
Sad 0.5%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 68.4%
Happy 25.4%
Angry 2.1%
Confused 1.6%
Surprised 1.1%
Sad 0.6%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 23-31
Gender Female, 53.9%
Calm 96.2%
Happy 1.4%
Confused 1%
Sad 0.7%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 82.9%
Happy 75.4%
Calm 12.2%
Disgusted 4.6%
Sad 2.7%
Angry 2.6%
Surprised 1%
Fear 0.8%
Confused 0.8%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Happy 96.1%
Calm 2.4%
Angry 0.4%
Surprised 0.4%
Disgusted 0.3%
Sad 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 98.1%
Calm 84%
Happy 13.8%
Sad 0.7%
Angry 0.5%
Confused 0.4%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.3%
Happy 99.6%
Calm 0.1%
Sad 0.1%
Angry 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 57-65
Gender Male, 79.5%
Happy 98%
Calm 1.3%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 18-24
Gender Female, 54.2%
Sad 44.6%
Calm 16.6%
Angry 12.3%
Confused 12.2%
Fear 4.4%
Happy 4%
Disgusted 3.8%
Surprised 2.2%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 85.3%
Angry 5.7%
Sad 2.7%
Happy 1.8%
Disgusted 1.7%
Fear 1.1%
Surprised 0.9%
Confused 0.8%

AWS Rekognition

Age 9-17
Gender Male, 99.5%
Disgusted 38.2%
Happy 37.7%
Confused 7.6%
Calm 7.2%
Surprised 5.5%
Angry 1.7%
Sad 1.7%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 100%
Happy 90%
Disgusted 2.5%
Sad 2.1%
Angry 1.5%
Calm 1.4%
Confused 0.9%
Fear 0.9%
Surprised 0.8%

AWS Rekognition

Age 20-28
Gender Female, 57%
Calm 29.9%
Disgusted 20.6%
Happy 15.4%
Surprised 9.9%
Angry 9.5%
Confused 5.5%
Fear 5.1%
Sad 4.1%

AWS Rekognition

Age 23-33
Gender Male, 61.7%
Calm 97.5%
Sad 1.2%
Angry 0.5%
Confused 0.4%
Disgusted 0.2%
Surprised 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Male, 99.9%
Calm 42.9%
Surprised 27.9%
Confused 10.7%
Angry 5.6%
Disgusted 5%
Fear 3.7%
Happy 3.1%
Sad 1.1%

AWS Rekognition

Age 23-31
Gender Female, 85.2%
Happy 92.6%
Disgusted 2%
Angry 1.1%
Surprised 1.1%
Sad 1%
Calm 1%
Fear 0.8%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Female, 55.3%
Calm 91%
Disgusted 5.5%
Sad 1.2%
Happy 0.7%
Confused 0.5%
Surprised 0.5%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Male, 86.8%
Calm 63.5%
Fear 15.7%
Disgusted 8.8%
Sad 6.7%
Happy 2.2%
Angry 1.6%
Confused 1%
Surprised 0.4%

AWS Rekognition

Age 13-21
Gender Female, 58.4%
Happy 88.6%
Surprised 3.4%
Fear 1.9%
Angry 1.6%
Calm 1.3%
Sad 1.3%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Surprised 61.6%
Happy 15%
Fear 13.2%
Sad 3%
Calm 2.7%
Angry 2.4%
Disgusted 1.2%
Confused 0.9%

AWS Rekognition

Age 16-24
Gender Male, 87%
Fear 98%
Confused 1.5%
Calm 0.2%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 94.8%
Happy 1.7%
Sad 1.7%
Angry 0.7%
Fear 0.5%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Wheel
Person 99.3%
Person 98.2%
Person 97.9%
Person 97.8%
Person 94.8%
Person 93.1%
Person 91.1%
Person 89.5%
Person 89.3%
Person 85.1%
Person 77.6%
Person 73.1%
Person 61.3%
Person 61.2%
Person 56.3%
Person 42.5%
Wheel 78%

Categories

Imagga

text visuals 93.5%
paintings art 5.5%

Captions

Microsoft
created by unknown on 2022-01-08

a close up of a refrigerator 29.3%
close up of a refrigerator 25.3%
a picture of a refrigerator 25.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people standing around a group of pictures -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image features a collage of photographs and handwritten notes arranged in rows on a white background.

  • The top row consists of individual portrait-style images, some depicting men in formal attire or casual settings.
  • The second row displays three distinct photographs: one with two men standing next to a vintage car near an oil rig, a family group posing in front of a house, and a quartet of men in suits standing outdoors beside a wall.
  • The third row includes handwritten notes, listing names, dates, and details related to the people or events depicted in the photographs.
  • The far right features text identifying individuals marked as "Wendon, Clyde, Patrick, Harold" with the year "c.1940."

The overall tone evokes a sense of historical or genealogical documentary focused on family or personal heritage.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a collage consisting of several photographs and handwritten notes. There are three rows of photos and notes.

In the second row, there are three black and white photographs:

  1. The left photo features two men standing in front of a vintage car with a tall metal structure in the background, likely an oil rig or tower.
  2. The middle photo captures a group of people gathered outside a building, possibly a family portrait.
  3. The right photo shows four men standing side by side in suits, against the wall of a white and red brick building.

In the third row, there are handwritten notes:

  1. The left note references "1928 Last year on the farm" with names listed: Harold, Clarence, Herman, Walter, Harold, and Elmer.
  2. The middle note includes several dates and names like Elden G (Sept 7), and others spanning years from 1914 to 1935. It mentions family details regarding birth and marriage.
  3. The right note lists names: Myron, Clyde, Patrick, Harold, with a mention of "around 1940".

The overall composition appears to archive family history with photographs and brief annotations.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a collage or collection of various black and white photographs. The top portion contains a row of headshot portraits of different individuals, likely mugshots or identification photos. The bottom portion contains three larger photographs depicting groups of people, likely families or groups of men, in different settings such as a farm, a home, and an outdoor setting. The images seem to be from an earlier time period, perhaps the early to mid-20th century based on the style and content. The overall impression is of a collection of historical photographs, potentially related to a specific family or group.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a collection of vintage black and white photographs arranged on a page, likely from a photo album or archive. The top row consists of nine individual portrait-style headshots. Below that are three larger group photographs:

  1. A photo showing people with what appears to be a 1920s-era automobile
  2. A group photo of several people standing in front of a house
  3. A formal photo of four people in suits

Below each of these larger photos are handwritten notes or captions, though they're difficult to read clearly in this image. One appears to be dated 1924 with "on the farm" written. The overall layout and style of the photographs suggests these are from the 1920s-1930s era, given the clothing styles, car, and photographic quality. The entire collection appears to be documenting a family or group's history during this time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image appears to be a page from an old photo album or scrapbook, featuring a collection of black-and-white photographs and handwritten notes. The page is divided into two rows, with the top row containing 10 small photos arranged in a horizontal line, and the bottom row featuring three larger photos accompanied by handwritten notes.

The top row of photos includes portraits of men and women, some of whom are wearing hats or ties, while others appear to be dressed in casual attire. The bottom row of photos shows a group of people standing together, possibly at a formal event or gathering, as well as a car and a house. The handwritten notes provide additional context and information about the individuals depicted in the photos, although they are not legible due to the age and quality of the paper.

Overall, the image suggests that the page is part of a personal archive or family album, documenting important events and relationships in the lives of the individuals featured. The use of black-and-white photography and handwritten notes adds a sense of nostalgia and intimacy to the page, highlighting the significance of these memories for the creator of the album.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

This image is a sepia-toned photograph of a page from an old photo album or scrapbook, featuring a collection of photographs and handwritten notes. The page is divided into two sections: the top section contains nine small portraits of men, while the bottom section features four larger photographs and three handwritten notes.

The top section showcases a diverse group of men, each with their own unique style and expression. Some wear hats, while others are clean-shaven or sport facial hair. The photographs appear to be taken in different settings, with some featuring outdoor backgrounds and others taken in studios.

The bottom section of the page presents four larger photographs that provide more context about the individuals depicted. One photograph shows a group of people standing in front of a house, while another features a man posing with a car. The remaining two photographs depict groups of men standing together, possibly at social gatherings or events.

The handwritten notes on the page offer additional information about the photographs and the individuals featured. One note reads "1928 Last year on the farm," suggesting that the photograph above it may have been taken during a significant event or milestone. Another note lists names and dates, possibly corresponding to the individuals in the photographs.

Overall, this image provides a glimpse into the lives of the individuals featured, offering a sense of their personalities, relationships, and experiences. The use of sepia tones and handwritten notes adds a nostalgic and personal touch to the image, making it feel like a treasured family heirloom.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a collage of photographs and handwritten notes. It features a black-and-white photograph of a group of people, possibly a family, standing in front of a house. The collage includes several other photographs of individuals, some of whom are wearing hats and sunglasses. There are also handwritten notes in the collage, which appear to be dates and names. The image has a slightly faded and worn appearance, suggesting that it may be an old photograph or a reproduction of one.

Created by amazon.nova-pro-v1:0 on 2025-05-31

The image shows a collage of photographs, including some handwritten notes, which are arranged in a specific order. The photographs are in black and white, and some of them are blurry. There are seven photographs of men, two photographs of groups of people, and two handwritten notes. The handwritten notes are placed in the lower part of the collage, while the photographs are placed above them.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

The image is a mounted collection of black and white photographs, likely a family photo album page. The arrangement includes:

  • Nine small portrait photos: Across the top of the page are a series of portraits of men, each in a small, square format.
  • Three larger photos:
    • A photo of people standing in front of a car
    • A group of people standing in front of a house
    • A group of men standing near a building
  • Three pieces of handwritten text below each photograph. The text appears to contain information related to the photos, potentially names, dates, and locations.

Overall, the image has a nostalgic, archival quality, likely chronicling events and people from the past. The page is bordered with a torn edge.

Created by gemini-2.0-flash on 2025-05-16

The image is a black and white collage of old photos and notes, displayed on a worn, light-colored paper backing.

In the top row, there are eight headshot photographs of people. The first photograph shows a young boy. The second photograph shows a person wearing sunglasses. The fourth shows a man wearing a cowboy hat. There is one image that is a business card that says "LOSS OF THIS CARD MUST BE REPORTED AT ONCE DEP".

Below the top row, there are three larger photographs:

  1. The first shows a group of people standing next to a car in a rural setting with a well in the background.
  2. The second photo shows a group of people standing in front of a house.
  3. The third photograph shows four men in suits standing in front of a building.

Below the photographs, there are three handwritten notes:

  1. The first reads "1928 Last year on the Farm" and lists names like "Harold," "Lawanna," "Vernow," "Myrabel," and "Elbie."
  2. The second contains a series of names and dates.
  3. The third reads "Vernon, Elbie, Father, Harold" and notes "(Standing)".

The handwritten text and faded black and white images give the collage a vintage, personal scrapbook feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

This image appears to be a collage of vintage photographs and handwritten notes, likely from a family album. Here is a detailed description:

  1. Top Row (Portraits):

    • The top row consists of individual portraits of men, possibly family members. The photographs showcase different styles of clothing and hats, indicative of various time periods, likely from the early to mid-20th century.
  2. Middle Row (Group Photographs):

    • The first photograph on the left shows a group of people standing around a vintage car. The car appears to be from the early 20th century, and the people are dressed in period attire.
    • The second photograph in the middle depicts a group of people, including men, women, and a child, standing in front of a house. The clothing suggests it might be from the 1920s or 1930s.
    • The third photograph on the right shows four men standing side by side in front of a building. They are dressed in suits, suggesting a formal occasion or setting.
  3. Bottom Row (Handwritten Notes):

    • The first note on the left reads: "1928 East year on the farm. Elmer, Vernon, Samson, Elmer, Elmer."
    • The second note in the middle contains various dates and names, such as "Donald born July 14, 1917," "Vernon born Sept 17, 1919," and other significant dates and events.
    • The third note on the right reads: "Vernon, Elmer, Father, Harold, 1940."

The collage seems to document family history, capturing significant moments and individuals over several decades. The handwritten notes provide context and dates for the photographs, helping to preserve the family's memories and lineage.

Text analysis

Amazon

1928
1917
Sept
on
HAROLD
Oct
27
Farm
Harold
John
447
4-
form
ELBIE
1928 Lagi years on The Farm
The
1913
John Sept Sept181886 7
-1982
DEP.
4
Horold
Horold form : apr 4- 1916
apr
years
Euish mary Oct 4 1913
be 27 -1982
7
MACNES
mary
Ellie
1916
VORNON ELBIE FATHER,
aug14
:
Sept181886
FATHER,
VORNON
Lanauna
dernan
Have
Virnov
Louising
myrale
be
Euish
Lagi
Nov24,1888
(1940)

Google

INI DEP Lasl yran en 1he Farm Horeld vePNON, CLBIE, PATHCR, HAROLD 1917 1919 hei Turス4188。 4 4 7 ulak mang let 9/2
INI
DEP
Lasl
yran
en
1he
Farm
Horeld
vePNON,
CLBIE,
PATHCR,
HAROLD
1917
1919
hei
Tur
4188
4
7
ulak
mang
let
9/2