Human Generated Data

Title

Untitled (twelve young family members posed sitting in living room)

Date

1949

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9230

Human Generated Data

Title

Untitled (twelve young family members posed sitting in living room)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9230

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.3
Clothing 94.6
Apparel 94.6
People 92.1
Dress 80.1
Female 77.6
Baby 73.6
Face 73.4
Chair 73.2
Furniture 73.2
Kid 66.8
Child 66.8
Photography 65.6
Photo 65.6
Portrait 65.2
Suit 64.3
Coat 64.3
Overcoat 64.3
Girl 64.3
Indoors 62.1
Home Decor 61.2
Family 60.9
Room 60.5
Flooring 59.7
Urban 56.8
Building 56.6
Housing 56.4
Text 55

Clarifai
created on 2023-10-26

people 99.8
group 99.7
child 98.2
group together 97.8
education 96.9
adult 95.2
woman 94.3
many 94.2
man 94.1
school 91.6
teacher 90.3
boy 88.7
wear 86.5
adolescent 86.1
retro 84.3
several 83.5
leader 82.2
portrait 81.4
uniform 79.5
son 77.3

Imagga
created on 2022-01-23

kin 31.7
man 31.6
person 27.2
classroom 26.7
people 25.6
male 24.1
room 21.8
adult 18.1
team 17.9
smiling 17.3
group 16.9
happy 16.9
businessman 16.8
player 16.7
couple 16.5
portrait 16.2
business 15.8
men 15.4
family 14.2
senior 14
home 13.5
gymnasium 13.5
nurse 13.4
indoors 13.2
black 12.6
lifestyle 12.3
together 12.3
contestant 12.2
sport 12.1
child 11.8
teacher 11.7
world 11.4
athletic facility 10.9
golfer 10.6
sibling 10.6
professional 10.2
two 10.2
boy 9.6
standing 9.6
women 9.5
enjoying 9.5
mature 9.3
student 9.3
inside 9.2
active 9.2
silhouette 9.1
businesswoman 9.1
facility 8.8
office 8.8
mother 8.8
athlete 8.6
happiness 8.6
statue 8.6
teamwork 8.3
camera 8.3
success 8
job 8
sitting 7.7
mid adult 7.7
30s 7.7
old 7.7
joy 7.5
friends 7.5
fun 7.5
school 7.5
cheerful 7.3
indoor 7.3
smile 7.1
to 7.1
interior 7.1
ball 7
grandfather 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.4
text 93.5
clothing 87.2
window 85.8
outdoor 85.7
posing 85.3
man 71.7
footwear 70.8
female 26.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 88.9%
Calm 97.5%
Happy 0.7%
Sad 0.6%
Surprised 0.5%
Disgusted 0.3%
Confused 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Male, 99.6%
Calm 97.3%
Sad 1.6%
Happy 0.3%
Confused 0.2%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 98.8%
Happy 95.7%
Sad 2.1%
Calm 0.9%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Happy 64.6%
Calm 16.4%
Sad 11.2%
Confused 4.3%
Disgusted 1.5%
Surprised 0.9%
Angry 0.7%
Fear 0.5%

AWS Rekognition

Age 10-18
Gender Female, 98.8%
Calm 62.7%
Angry 17.9%
Sad 6.6%
Surprised 4.1%
Disgusted 3.7%
Happy 3.2%
Fear 1%
Confused 0.9%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Surprised 96%
Calm 2.4%
Angry 1%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 10-18
Gender Female, 99.4%
Surprised 50.3%
Calm 32.2%
Angry 7.8%
Happy 5.9%
Disgusted 1.9%
Sad 0.9%
Confused 0.6%
Fear 0.5%

AWS Rekognition

Age 26-36
Gender Male, 100%
Sad 45.3%
Calm 18.9%
Confused 10.6%
Happy 10%
Angry 5.2%
Surprised 4.7%
Disgusted 4.5%
Fear 0.8%

AWS Rekognition

Age 24-34
Gender Female, 97.7%
Calm 96.5%
Surprised 2.6%
Fear 0.3%
Disgusted 0.2%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.8%
Happy 70.1%
Surprised 18.6%
Calm 7.2%
Angry 1.4%
Fear 1%
Sad 0.7%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 25-35
Gender Male, 100%
Surprised 50.6%
Calm 48.2%
Confused 0.4%
Disgusted 0.2%
Sad 0.2%
Angry 0.2%
Happy 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Clothing
Man
Footwear
Human face
Woman
Picture frame
Human hair

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 92%

AWS Rekognition

Person 90.6%

AWS Rekognition

Person 90.2%

AWS Rekognition

Person 80.3%

AWS Rekognition

Person 72.1%

AWS Rekognition

Person 64%

AWS Rekognition

Person 63.4%

AWS Rekognition

Person 62.7%

Clarifai

Clothing 83.2%

Clarifai

Clothing 69.8%

Clarifai

Clothing 66.9%

Clarifai

Clothing 66%

Clarifai

Clothing 58.3%

Clarifai

Clothing 53%

Clarifai

Clothing 47.6%

Clarifai

Clothing 40.7%

Clarifai

Clothing 37.2%

Clarifai

Clothing 37.2%

Clarifai

Man 82.9%

Clarifai

Footwear 79.2%

Clarifai

Footwear 73.1%

Clarifai

Footwear 72.6%

Clarifai

Footwear 66%

Clarifai

Footwear 61.4%

Clarifai

Footwear 57.4%

Clarifai

Footwear 56.5%

Clarifai

Footwear 56.1%

Clarifai

Footwear 54.8%

Clarifai

Footwear 54.4%

Clarifai

Footwear 53.8%

Clarifai

Footwear 53.1%

Clarifai

Footwear 50.3%

Clarifai

Footwear 46.3%

Clarifai

Footwear 40.6%

Clarifai

Footwear 37.1%

Clarifai

Footwear 37.1%

Clarifai

Footwear 37%

Clarifai

Footwear 36.7%

Clarifai

Footwear 35%

Clarifai

Footwear 34.6%

Clarifai

Footwear 34.2%

Clarifai

Human face 78.6%

Clarifai

Human face 76.4%

Clarifai

Human face 75.2%

Clarifai

Human face 73.9%

Clarifai

Human face 73.8%

Clarifai

Human face 73.1%

Clarifai

Human face 72.5%

Clarifai

Human face 67.9%

Clarifai

Human face 65.6%

Clarifai

Human face 64%

Clarifai

Human face 55.6%

Clarifai

Human face 54.1%

Clarifai

Woman 71.9%

Clarifai

Woman 71.1%

Clarifai

Woman 36.3%

Clarifai

Picture frame 59.7%

Clarifai

Human hair 33.1%

Categories

Imagga
created on 2022-01-23

people portraits 48.1%
paintings art 39.9%
text visuals 8.1%
streetview architecture 1.5%
events parties 1.1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

the team in the studio.

Salesforce

Created by general-english-image-caption-blip on 2025-05-23

a photograph of a group of people posing for a photo

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This is a black-and-white negative of a group photo featuring a mix of adults and children. The group is indoors, seated and posed in front of a window with blinds, and there is a decorative flower or plant visible near the top center. The adults are sitting in chairs while the children sit cross-legged on the floor in front of them. The clothing style suggests formal or semi-formal attire. The setting includes a radiator on the right and various pieces of furniture or decorative items on the left. The edges of the image show perforations, indicating it is from film or photographic negatives.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a classic family portrait captured in a vintage style. There are two rows of people, with some seated and some standing. The standing individuals are placed at the back, with the seated group in front, forming a traditional arrangement often seen in family photographs. The clothing and surroundings suggest a formal setting, with the seated adults dressed in suits. The image has a black-and-white negative appearance, indicating it might be an old photograph. Behind them, there is a window with horizontal blinds, and a radiator is visible suggesting it might be winter or fall. The edges of the photograph have a characteristic film negative border, including the Kodak Safety Film markings, which further accentuate its vintage nature and authenticity.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image appears to be a black and white photograph of a group of people, including both adults and children. The group is seated in a room with a chandelier overhead and curtains in the background. The individuals are dressed in a variety of clothing styles, some formal and some more casual. The overall composition and setting suggest this may be a family or group portrait of some kind, though I cannot identify any specific individuals in the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This appears to be a vintage black and white photograph, likely from the 1950s, showing a group of children arranged in two rows for a formal picture. The back row shows children standing or sitting in chairs, while the front row of children is seated on the floor. They are all dressed in formal attire - the girls wearing dresses and the boys in white jackets or suits. The photo appears to be taken indoors, with window blinds visible in the background and what looks like a radiator on the right side of the frame. The lighting creates a bright, studio-like quality to the photograph. There's also what appears to be a decorative element hanging from above, possibly a holiday decoration.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a family of eleven, consisting of two adults and nine children, posing for a photo in a living room. The family is dressed in formal attire, with the adults wearing suits and dresses, and the children wearing dresses and suits.

The family is arranged in three rows, with the adults sitting on a couch in the back row, and the children sitting or kneeling in front of them. The children are all dressed in matching outfits, with the girls wearing dresses and the boys wearing suits.

In the background, there is a window with blinds that are partially open, allowing natural light to enter the room. There is also a radiator on the right side of the room and a Christmas tree in the corner.

The overall atmosphere of the photo is one of happiness and togetherness, as the family appears to be enjoying each other's company. The formal attire and the festive decorations suggest that this may be a special occasion, such as a holiday or a family gathering.

The image is a heartwarming representation of a loving family, and it captures a moment in time that will be cherished by the family for years to come.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a large family, with 13 individuals posing together. The family is arranged in three rows, with the back row standing and the middle and front rows seated or kneeling on the floor.

In the back row, from left to right, are a woman wearing a dress, a man in a white suit, a woman in a checkered jacket, another man in a white suit, and a man in a white suit with a dark tie and pocket square. In the middle row, there are two girls sitting on the lap of the man in the white suit, and a boy sitting on the lap of the man in the white suit with a dark tie and pocket square. In the front row, from left to right, are a girl kneeling, a boy sitting, a girl sitting, a girl sitting, and a boy kneeling.

The background of the image features a window with blinds, a radiator, and a curtain. The overall atmosphere of the image suggests a formal family gathering or portrait, possibly taken in the mid-20th century based on the clothing and hairstyles of the individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image shows a family portrait taken in black and white. The family is sitting and standing in a living room, with a window behind them. The family consists of three adults and five children, all of whom are wearing formal attire. The adults are standing in the back, while the children are sitting in front. The image has a vintage feel, and the family appears to be posing for a photograph.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white photograph of a group of people, possibly a family, posing for a picture. The group consists of adults and children. The adults are standing, while the children are sitting on the floor. The adults are dressed in formal attire, while the children are wearing casual clothes. The group is positioned in front of a window with blinds, and there is a radiator on the right side of the image.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white negative, likely a photograph of a family portrait. There are 12 people in the shot, mostly children, along with some adults.

In the back row, from left to right, there is a woman sitting to the side, two men sitting on chairs, a woman standing, another man sitting on a chair, and a man standing. The men are wearing suits or blazers. Behind them, there are blinds covering a window, and a festive decoration hanging in front of it.

In the front row, there are six children seated on the floor. They are all facing forward, looking at the camera. They are dressed in various outfits, some with dresses and others with shirts and pants.

To the side of the group, there is a radiator visible. A stack of items, possibly gifts or boxes, can be seen behind the woman on the far left. The overall atmosphere of the picture suggests a special occasion, possibly a holiday gathering.

Created by gemini-2.0-flash-lite on 2025-05-18

This is a family portrait in an unusual style, as it appears to be an inverted image, where the lights and darks have been swapped. The family is posed in a living room setting, with a window and blinds visible in the background. They are arranged in a group, with several adults and children. The children are sitting on the floor, while the adults are seated or standing behind them. The expressions on their faces are hard to read due to the inversion, but it looks like they are all looking at the camera, possibly taking a picture. Some gifts are visible behind the lady in the dress. The overall impression is a formal family portrait.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image appears to be a group photograph featuring a mix of adults and children, taken indoors. The photograph has a negative or inverted color effect, giving it a ghostly appearance. Here are the details:

  1. Setting: The photograph is taken indoors in front of a window with blinds. There are curtains on either side of the window, and a radiator is visible on the right side.

  2. People: There are 11 individuals in the photograph, including both adults and children.

  3. Adults:

    • On the far left, a woman is standing wearing a dress and a necklace.
    • In the center, a woman with a checkered shirt and a white scarf is standing.
    • On the far right, a man in a white suit and bow tie is standing.
    • Behind the children, two older men in white lab coats are standing.
  4. Children:

    • There are seven children in the photograph.
    • Four children are seated on the floor in the front row.
    • Three children are seated on chairs in the second row.
    • The children are dressed in various outfits, some formal and some casual.
  5. Expression and Pose:

    • Most of the individuals are looking directly at the camera.
    • The adults and children have neutral to slightly smiling expressions.
  6. Additional Details:

    • There is a trophy or award on the left side of the image.
    • The inverted color effect makes the photograph look like a negative, with light areas appearing dark and vice versa.

Overall, the photograph captures a formal or semi-formal gathering of a group of people, possibly a family or a team, posing for a portrait.

Qwen

No captions written

Text analysis

Amazon

st

Google

3 8 a { VTコヨA2-A0
3
8
a
{
VT
コヨ
A2
-
A0