Human Generated Data

Title

"Eleven" Colophon

Date

2002

People

Artist: Marshall Weber, American born 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan, 45.2003

Copyright

© Marshall Weber

Human Generated Data

Title

"Eleven" Colophon

People

Artist: Marshall Weber, American born 1960

Date

2002

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan, 45.2003

Copyright

© Marshall Weber

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Human 99.9
Person 99.9
Person 99.6
Person 98.7
Person 98.7
Footwear 95.9
Apparel 95.9
Clothing 95.9
Shoe 95.9
Shoe 95.2
Shorts 79.6
Festival 78.2
Crowd 78.2
Person 66.5
Plant 60.6
Tree 60.6
People 57.9
Sports 55.4
Sport 55.4
Person 44.2

Clarifai
created on 2019-11-11

people 99.3
festival 99.1
many 97.2
crowd 96.4
competition 95.7
music 95.7
group 95.6
wear 94.8
city 94.5
celebration 94.3
ceremony 93.5
performance 92.2
street 91.4
parade 90.9
religion 88.3
party 87.6
man 85.9
costume 85.8
flag 84.6
action 84.4

Imagga
created on 2019-11-11

city 23.3
architecture 18
park 17.5
design 16.3
modern 15.4
building 14.7
pattern 14.4
light 14.2
people 13.9
colorful 13.6
night 13.3
art 13.2
urban 13.1
tree 12.9
person 12.5
holiday 12.2
business 11.5
new 11.3
flowers 11.3
sky 10.8
forest 10.4
cityscape 10.4
color 10
travel 9.9
tower 9.8
structure 9.8
mosaic 9.4
wallpaper 9.2
retro 9
autumn 8.8
happy 8.8
graphic 8.7
vibrant 8.7
plant 8.7
season 8.6
skyline 8.5
outdoors 8.5
floral 8.5
flower 8.5
plants 8.3
tourism 8.2
landscape 8.2
decoration 8.1
lifestyle 7.9
ancient 7.8
spectator 7.7
old 7.7
winter 7.7
texture 7.6
fashion 7.5
contemporary 7.5
clothing 7.5
man 7.4
tourist 7.4
street 7.4
snow 7.3
palace 7.3
rough 7.3
yellow 7.3
jigsaw puzzle 7.3
fall 7.2
landmark 7.2
portrait 7.1
summer 7.1
surface 7.1
colors 7

Google
created on 2019-11-11

Microsoft
created on 2019-11-11

tree 99.5
person 90.4
clothing 77.6
text 70
flower 66.2
parade 59.4
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 52.5%
Sad 45.8%
Disgusted 45%
Surprised 45.2%
Angry 45.4%
Happy 45.3%
Fear 45.1%
Calm 52.9%
Confused 45.3%

AWS Rekognition

Age 28-44
Gender Male, 50.6%
Angry 45%
Sad 45.3%
Disgusted 45%
Surprised 45%
Happy 45%
Fear 54.6%
Calm 45%
Confused 45%

AWS Rekognition

Age 36-54
Gender Male, 50.2%
Fear 49.6%
Angry 49.6%
Sad 49.7%
Confused 49.5%
Happy 49.9%
Calm 49.7%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Disgusted 49.5%
Calm 49.6%
Confused 49.6%
Happy 49.6%
Fear 49.7%
Angry 49.5%
Sad 50%
Surprised 49.5%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.9%
Person 99.6%
Person 98.7%
Person 98.7%
Person 66.5%
Person 44.2%
Shoe 95.9%
Shoe 95.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-27

a photograph of a book opened to show a photo of a woman in a green shirt -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts a memorial site filled with flowers, candles, flags, and various personal tributes placed on the ground and along a fence. The left side shows a paved area with people observing the items arranged there, while the right side displays a gathering of individuals around a statue adorned with flags and tributes. Tall trees surround the area, and in the background, the spire of a recognizable skyscraper is visible, indicating an urban setting. The atmosphere suggests reflection and remembrance.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts a memorial or tribute site, likely following a significant event. The left side of the image shows a pavement area covered with numerous candles, flowers, photographs, and other keepsakes or offerings. A person is standing nearby observing the area. The right side of the image features a statue surrounded by many American flags and more flower arrangements, candles, and tributes. The background includes trees and a recognizable building that resembles the MetLife Building in New York, suggesting that the setting is a public park or a similar open space. The presence of many people indicates that this is a well-visited site.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a memorial site with a large collection of flowers, candles, and other tributes. In the foreground, there is a woman standing in the middle of the memorial, surrounded by the many items left by visitors. In the background, there is a statue or monument with an American flag, suggesting this is a public memorial site. The scene appears to be one of somber remembrance and reflection.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a memorial site, likely in New York City given the glimpse of what seems to be the Empire State Building in the background. There's a long stretch of tributes along what appears to be a fence or wall, with numerous American flags, candles, flowers, and personal mementos laid out. People can be seen walking by and observing the memorial. The items are spread out on the ground in a continuous line, creating a powerful visual display of remembrance and mourning. The scene has the solemn atmosphere typical of spontaneous memorial sites where people come to pay their respects and leave tokens of remembrance. The mix of patriotic symbols and personal items suggests this may be related to a significant national event that affected many people.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-06

The image depicts a two-page spread from a book or magazine, featuring a photograph of a memorial to victims of the 9/11 attacks in Washington, D.C. The left page shows a woman in a blue and white shirt and black skirt standing on the left side of the image, looking at a memorial wall covered in flowers, candles, and other tributes. The right page shows a crowd of people gathered around a large memorial, with a statue of a soldier in the background and an American flag draped over it. The sky is blue with white clouds.

The overall atmosphere of the image is one of somber reflection and remembrance, as people come together to pay their respects to those who lost their lives in the tragic event. The use of flowers, candles, and other tributes creates a sense of intimacy and personal connection to the victims, while the crowd of people gathered around the memorial wall conveys a sense of community and shared grief.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-06

The image depicts an open book with a photograph of a memorial on each page. The left page shows a woman in a blue and white shirt, black shorts, and sneakers standing on the left side of the image, looking at a memorial covered in candles, flowers, and other items. In the background, there is a man in a suit walking away from the memorial.

The right page shows a woman in a green shirt and black pants standing in front of a memorial covered in candles, flowers, and other items. In the background, there are trees, a statue, and a blue sky with white clouds. The overall atmosphere of the image suggests that it is a memorial or tribute to someone or something, possibly related to a tragic event or loss.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

A book is open to a page with two photographs. On the left, a woman in a blue shirt and black shorts is walking on a sidewalk. There is a memorial on the ground with many candles, flowers, and other items. On the right, a woman in a green shirt and black pants is standing in front of a memorial with many candles, flowers, and other items. There is a statue in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The open book contains two images. The first image shows a woman standing on the road, looking to her left. Behind her, another person is walking. On the right side, there is a fence with flags hanging on it. Behind the fence, there are several objects on the road. The second image shows a woman standing in front of a statue, holding a handbag. Behind her, many people are standing, and some are walking.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-11

The image depicts two facing pages from a book or magazine, showcasing a memorial scene. The left page displays a roadside covered in candles, flowers, and other items. A chain-link fence is laden with flowers and flags, while people are standing nearby. On the right page, a statue draped in flags is surrounded by more memorials, including flowers and candles. The overall setting suggests a site of remembrance, perhaps a memorial after a tragic event. The presence of the American flags and the solemn atmosphere hints at a location related to a national tragedy.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image shows a two-page spread from a book or photo album. Both pages depict a memorial site that appears to be a public space where people have gathered to pay their respects.

Left Page:

  • The left page shows a tree trunk that is adorned with numerous items, including flowers, candles, stuffed animals, and various personal mementos.
  • Two individuals are visible: a woman in a blue and white shirt and black shorts facing away from the camera, and a man in a blue shirt and jeans walking towards the tree.
  • The ground around the tree is covered with more candles, flowers, and other items, suggesting a significant amount of tribute and remembrance.

Right Page:

  • The right page shows a similar scene with a large number of candles, flowers, and personal items spread across the ground.
  • A statue or monument is visible in the background, with an American flag and other decorations.
  • Several people are present, including a woman in a green sweater and black pants standing and looking at the camera, and another person in a pink shirt facing away.
  • The background includes trees and a clear sky, indicating an outdoor setting.

Overall, the image captures a somber and reflective atmosphere, likely commemorating a significant event or loss. The presence of American flags suggests that this memorial might be related to a national event or tragedy.