Human Generated Data

Title

Untitled (Greek orphans lined up in front of ship waiting to board)

Date

1948

People

Artist: David Seymour, Polish 1911 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Stephen Nicholas, P2004.29

Human Generated Data

Title

Untitled (Greek orphans lined up in front of ship waiting to board)

People

Artist: David Seymour, Polish 1911 - 1956

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Stephen Nicholas, P2004.29

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.7
Clothing 97.8
Apparel 97.8
Military 94.1
People 90.8
Footwear 87.9
Military Uniform 87.3
Transportation 82.2
Vehicle 81.8
Overcoat 80.7
Coat 80.7
Army 73
Armored 73
Soldier 61.8
Watercraft 59.6
Vessel 59.6
Cruiser 58.7
Ship 58.7
Navy 58.7
Troop 58.7

Clarifai
created on 2023-10-26

people 99.9
group together 99.6
group 99.3
adult 98.7
many 96.8
man 96.6
vehicle 94.3
military 94
woman 93.3
several 93
transportation system 92.4
street 87.9
wear 85.9
war 84.9
child 84
soldier 82.3
three 82.3
four 81.4
administration 80.7
crowd 80.4

Imagga
created on 2022-01-23

hut 39.7
shelter 32.4
structure 27.6
world 25.2
man 20.8
building 17.9
city 17.5
person 17.2
people 16.2
nuclear 14.5
outdoor 14.5
dark 14.2
tourist 13.9
dirty 13.5
travel 13.4
street 12.9
destruction 12.7
urban 12.2
mask 11.9
protection 11.8
industrial 11.8
silhouette 11.6
walking 11.4
architecture 11
danger 10.9
chemical 10.6
traveler 10.4
pedestrian 10.3
male 9.9
sunset 9.9
radioactive 9.8
radiation 9.8
toxic 9.8
protective 9.7
military 9.7
explosion 9.6
gas 9.6
seller 9.6
tourism 9.1
old 9
vacation 9
outdoors 9
sky 8.9
stalker 8.9
accident 8.8
symbol 8.7
prison 8.4
power 8.4
summer 8.4
snow 8.1
soldier 7.8
disaster 7.8
factory 7.7
winter 7.7
sign 7.5
park 7.5
uniform 7.2
house 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.8
outdoor 99.7
sky 98.3
clothing 93.9
standing 92.8
group 91.9
man 91.1
people 78.8
text 60.1
old 59.9
black and white 59.1
posing 37.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 89.3%
Calm 90.6%
Happy 3.6%
Fear 1.6%
Sad 1.5%
Confused 1.3%
Angry 0.6%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 27-37
Gender Female, 54.1%
Calm 63.4%
Happy 27%
Sad 3.8%
Angry 1.7%
Disgusted 1.3%
Confused 1%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 19-27
Gender Male, 97.4%
Calm 56.9%
Sad 18.7%
Happy 9.5%
Fear 4.5%
Angry 3.6%
Confused 3%
Disgusted 2.4%
Surprised 1.6%

AWS Rekognition

Age 19-27
Gender Male, 93.4%
Calm 80.5%
Sad 8.7%
Confused 6%
Happy 1.3%
Disgusted 1%
Fear 0.9%
Angry 0.8%
Surprised 0.7%

AWS Rekognition

Age 9-17
Gender Male, 97.3%
Calm 60.4%
Sad 29.2%
Angry 4.8%
Confused 4.2%
Happy 0.5%
Disgusted 0.4%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 16-24
Gender Male, 70.9%
Calm 86.3%
Sad 6.5%
Happy 2.8%
Fear 1.7%
Confused 1.2%
Angry 0.8%
Disgusted 0.4%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.4%
Calm 91.2%
Sad 6.8%
Happy 0.7%
Confused 0.5%
Fear 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 80.6%
Sad 11.9%
Confused 3.4%
Fear 1.2%
Angry 1%
Happy 0.9%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 6-16
Gender Female, 55.7%
Calm 91.8%
Sad 2.8%
Happy 2.3%
Fear 0.9%
Angry 0.8%
Confused 0.5%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 13-21
Gender Male, 69%
Calm 90.8%
Angry 4.5%
Sad 1.9%
Fear 1%
Happy 0.7%
Disgusted 0.5%
Surprised 0.3%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Male, 88.9%
Calm 83%
Sad 9.9%
Angry 2.5%
Confused 2%
Fear 1%
Disgusted 0.6%
Happy 0.6%
Surprised 0.4%

AWS Rekognition

Age 13-21
Gender Male, 78.5%
Calm 98.6%
Happy 0.9%
Sad 0.2%
Confused 0.2%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Male, 91.8%
Calm 71.9%
Sad 23.3%
Angry 2.2%
Happy 1.2%
Surprised 0.5%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe

Clarifai

Man
Footwear
Clothing
Vehicle
Human leg
Human hair

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 89.8%

AWS Rekognition

Person 87.2%

AWS Rekognition

Person 86.9%

AWS Rekognition

Person 85.4%

AWS Rekognition

Person 84.4%

AWS Rekognition

Person 81.3%

AWS Rekognition

Person 77.2%

AWS Rekognition

Person 75.9%

AWS Rekognition

Person 74%

AWS Rekognition

Person 73.6%

AWS Rekognition

Person 73%

AWS Rekognition

Shoe 87.9%

AWS Rekognition

Shoe 87.5%

AWS Rekognition

Shoe 76.7%

AWS Rekognition

Shoe 62.3%

AWS Rekognition

Shoe 61.5%

AWS Rekognition

Shoe 56.9%

AWS Rekognition

Shoe 54.7%

Clarifai

Man 91.5%

Clarifai

Man 75.5%

Clarifai

Man 65.6%

Clarifai

Man 65.3%

Clarifai

Man 64.2%

Clarifai

Man 63.9%

Clarifai

Man 62.9%

Clarifai

Man 56.8%

Clarifai

Man 54.9%

Clarifai

Man 53.4%

Clarifai

Man 52.5%

Clarifai

Man 51%

Clarifai

Man 48.9%

Clarifai

Man 45.8%

Clarifai

Man 41%

Clarifai

Man 34.1%

Clarifai

Footwear 86.1%

Clarifai

Footwear 83.1%

Clarifai

Footwear 80.7%

Clarifai

Footwear 78.2%

Clarifai

Footwear 76.2%

Clarifai

Footwear 75.4%

Clarifai

Footwear 73%

Clarifai

Footwear 72.2%

Clarifai

Footwear 67.4%

Clarifai

Footwear 48.1%

Clarifai

Footwear 39.9%

Clarifai

Footwear 39.5%

Clarifai

Footwear 35.4%

Clarifai

Clothing 66.1%

Clarifai

Clothing 33.7%

Clarifai

Vehicle 45.4%

Clarifai

Human leg 36.4%

Clarifai

Human hair 34.5%

Clarifai

Human hair 33.8%

Clarifai

Human hair 33.1%

Categories

Imagga
created on 2022-01-23

streetview architecture 98.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a group of people on a boat.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people standing around a large ship

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This black-and-white image depicts four children standing on the ground wearing simple, rugged clothing. They are facing away from the camera and observing a large ship in the background. The ship, which is docked, has the lettering "MO" visible on its hull, suggesting part of its name. Several men are standing and sitting on top of the ship, seemingly engaged or observing the surroundings. The image portrays a scene of curiosity and contrasts between the children on the ground and the imposing structure of the ship, evoking themes of exploration, class disparity, or maritime activity.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a group of young boys standing on a dock, observing a large ship that is docked nearby. The ship is a cargo vessel, and several figures are visible on top of the ship, looking over the side. The boys are dressed in clothing that suggests a historical or rural setting, with loose pants, jackets, and sturdy boots. The vessel's name is partially visible, with the letters "MO" discernible. The boys appear to be closely observing the scene, with one placing his arm around another's shoulders, suggesting camaraderie or curiosity. The setting is likely a harbor or port, with the ground covered in dirt or loose gravel.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a group of people, mostly children, gathered around a large boat or ship. The boat appears to be a cargo or transport vessel, with the word "MOD" visible on its side. The people in the image are bundled up in coats and jackets, suggesting a cold or harsh environment. The image has a somber, documentary-like quality, capturing a scene of people gathered around this vessel, perhaps waiting to board or disembark. The black and white tones give the image a historical feel, though the exact time period is not clear.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph showing several people viewed from behind as they look at what appears to be a large boat or ship. In the foreground, there are five figures standing in a line, wearing what looks like period clothing from the early-to-mid 20th century - including knee-length pants, jackets, and heavy boots. On the ship itself, visible in the background, several other figures can be seen standing along the upper deck or railing. The vessel appears to have "MO" visible on its hull. The composition creates an interesting perspective, with the backs of the observers in the foreground framing the view of the larger vessel behind them. The image has a documentary quality typical of historical photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a group of children standing in front of a large ship, with the children facing away from the camera and towards the ship. The children are dressed in dark clothing and appear to be standing on a dirt or sandy surface. The ship is large and has a flat top, with a sign that reads "MO" in white letters. There are several people standing on the deck of the ship, some of whom are looking out at the children.

The overall atmosphere of the image suggests that the children are waiting to board the ship, possibly for a journey or a new beginning. The image conveys a sense of anticipation and excitement, as the children eagerly await their departure.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of children standing in front of a large boat. The children are dressed in casual clothing, with some wearing jackets and others wearing shirts and pants. They appear to be looking at something on the boat, possibly people or objects being loaded or unloaded.

In the background, there are several people standing on the deck of the boat, some of whom are looking down at the children. The sky above is overcast, giving the scene a somber tone. Overall, the image suggests that the children are watching a boat arrive or depart from a dock or harbor, and that they are interested in what is happening on the vessel.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The black-and-white photograph depicts a group of children standing in front of a ship, possibly a cargo ship, with a man standing behind them. The children are wearing jackets and boots, and some of them are wearing hats. The ship has the word "MO" written on the side, and there are people on the deck, including a man holding a rope. The sky is clear, and the ship is docked at a port.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows five boys standing in front of a ship, probably in a port. They are wearing long-sleeved shirts, pants, and boots. The boy on the left is wearing a long skirt. The boy in the middle is wearing a jacket, while the boy on the right is wearing a coat. The ship has a large, open hatch in the middle. There are people standing on the ship's deck.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

This black and white photograph shows five boys standing on a ground, looking up at a large vessel, possibly a ship or a landing craft. The boys are seen from the back, and they appear to be of different ages. They are dressed in jackets and shorts, with one boy wearing striped pants. Their clothing suggests a time period in the mid-20th century.

The vessel in front of them has the letters "MO" visible on its hull, and it is crowded with people on the deck and at the bow. The sky is clear and bright, suggesting a sunny day. The image has a documentary feel, possibly capturing a moment of departure or arrival, and the expressions on the boys' faces are left to the viewer's interpretation. The overall tone of the image is somber and evokes a sense of history and the human experience of movement or migration.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression: The photograph is a black and white, medium shot that captures a poignant scene of a group of children watching a large ship. The mood is a mix of curiosity, anticipation, and possibly a sense of longing.

Composition:

  • Foreground: Five children, seen from the back, are the main focus. Their backs are turned to the viewer as they stare at the ship. Their clothing suggests a past era.
  • Midground: A large ship dominates the center of the image. The ship appears to be a cargo or transport vessel, and some figures are visible on its deck. The ship is labeled "MO" with the remaining letters being cropped off.
  • Background: The sky is light and slightly overcast. The scene is set on what appears to be a pier or a waterfront area.

Details:

  • The Children: They are wearing older-style clothing, including jackets, shorts, long socks, and boots. They appear to be in close proximity to one another, and some may be comforting each other.
  • The Ship: The ship is massive and imposing, with people standing on its deck.
  • Mood: The image evokes a sense of history, perhaps an emigration, a war or an experience of change.

Overall, this image appears to be a historical photograph documenting a moment of departure, observation, or possibly the experience of refugees.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph depicting a group of people standing in front of a large ship. The ship has the word "MOR" partially visible on its side. The people in the foreground are standing with their backs to the camera, facing the ship. They are dressed in heavy, worn clothing, including coats, boots, and socks, suggesting a cold climate or a setting where such attire is necessary.

On the ship, there are several individuals standing on the deck, looking down at the people below. The ship appears to be docked or anchored near the shore, as the people on the ground are standing on what looks like a sandy or gravelly surface. The overall mood of the image is somber, and the attire and setting suggest a historical context, possibly related to a significant event or period. The image evokes a sense of anticipation or waiting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-15

This is a black-and-white photograph showing a group of children standing on a dock, facing a large ship. The ship appears to be a military transport vessel, as indicated by its robust design and the presence of people on the deck. The children, wearing coats and some with boots, seem to be watching the ship with curiosity or contemplation. In the background, there are other people on the ship, including what appears to be a group of men in uniform, suggesting a military or naval operation. The scene conveys a historical or wartime atmosphere.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-15

This is a black-and-white photograph showing a group of young boys standing on a beach, facing a large boat. The boys are dressed in winter clothing, including jackets and boots, and some of their clothing appears worn. The boat has a flat deck with several people standing on it, and the word "MO" is visible on the side of the boat. The scene suggests a historical or wartime context, given the clothing and the overall atmosphere of the image. The boys seem to be observing the boat and its occupants.

Text analysis

Amazon

MO

Google

MO
MO