Human Generated Data

Title

Untitled (portrait of grandparents and grandchildren in front of window)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17421

Human Generated Data

Title

Untitled (portrait of grandparents and grandchildren in front of window)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17421

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Person 99.7
Person 99.2
Person 99
Person 98.8
Clothing 98.4
Apparel 98.4
Person 97.4
Person 96.4
Shorts 95.7
Person 86.1
Person 82.9
People 82
Female 76.6
Suit 71
Overcoat 71
Coat 71
Girl 65.5
Person 65.1
Helmet 61.7
Crowd 61.5
Kid 60.9
Child 60.9
Photography 59.2
Photo 59.2
Furniture 58.9

Clarifai
created on 2023-10-29

people 100
group 99.8
child 99.6
group together 99.4
many 98.9
man 98.7
education 98.1
several 98
adult 96.3
boy 95.8
woman 95.6
interaction 93.4
adolescent 92.4
recreation 92.1
sibling 92
wear 92
school 91.8
son 90.3
administration 89
elementary school 88.7

Imagga
created on 2022-02-26

kin 45.1
people 37.4
person 30.5
group 28.2
man 26.2
men 24
adult 23.7
male 23.4
women 20.5
portrait 20
happy 19.4
couple 17.4
team 16.1
happiness 15.7
sport 15.4
lifestyle 15.2
fashion 15.1
silhouette 14.9
together 14.9
smiling 14.5
smile 14.2
fun 14.2
human 13.5
world 13.2
friends 13.1
friendship 13.1
dress 12.6
dancer 12.6
attractive 12.6
crowd 12.5
active 12.1
sitting 12
casual 11.9
child 11.8
professional 11.8
business 11.5
businessman 11.5
boy 11.3
sexy 11.2
outdoors 11.2
pretty 11.2
teacher 11.2
teamwork 11.1
girls 10.9
exercise 10.9
run 10.6
body 10.4
room 10.3
motion 10.3
athlete 10.1
leisure 10
dance 10
runner 9.9
recreation 9.9
family 9.8
running 9.6
sibling 9.6
classroom 9.4
elegance 9.2
joy 9.2
educator 9.2
summer 9
performer 8.8
silhouettes 8.7
art 8.7
party 8.6
legs 8.5
brass 8.4
black 8.4
city 8.3
street 8.3
teen 8.3
teenager 8.2
posing 8
love 7.9
color 7.8
outdoor 7.6
togetherness 7.5
passion 7.5
life 7.4
action 7.4
style 7.4
wind instrument 7.3
competition 7.3
lady 7.3
children 7.3
fitness 7.2
day 7.1
mother 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 97.1
clothing 94.9
person 94.7
drawing 70.2
people 63.6
footwear 57.3
sketch 52.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Calm 94.3%
Happy 1.6%
Sad 1%
Surprised 0.9%
Disgusted 0.9%
Confused 0.7%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Male, 99.6%
Happy 89.5%
Calm 3.2%
Surprised 2.2%
Disgusted 1.5%
Sad 1.3%
Angry 1%
Confused 0.8%
Fear 0.4%

AWS Rekognition

Age 29-39
Gender Male, 52.2%
Happy 97.8%
Calm 1.3%
Surprised 0.5%
Fear 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.3%
Happy 93.7%
Sad 2.7%
Calm 1.1%
Confused 0.9%
Angry 0.5%
Disgusted 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 50-58
Gender Female, 97.2%
Sad 75.7%
Happy 14.4%
Calm 5.5%
Confused 3.1%
Disgusted 0.4%
Angry 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 31-41
Gender Male, 79.3%
Calm 97.5%
Happy 1%
Sad 0.8%
Confused 0.2%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 85.3%
Happy 60.9%
Sad 37.3%
Angry 0.4%
Calm 0.4%
Fear 0.4%
Surprised 0.4%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Female, 52.7%
Happy 46.2%
Calm 27.7%
Sad 18.9%
Confused 2.6%
Surprised 2%
Disgusted 0.9%
Fear 0.9%
Angry 0.8%

AWS Rekognition

Age 37-45
Gender Male, 99.3%
Happy 82.2%
Calm 15%
Sad 1.2%
Confused 0.6%
Fear 0.5%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet
Person 99.7%
Person 99.7%
Person 99.2%
Person 99%
Person 98.8%
Person 97.4%
Person 96.4%
Person 86.1%
Person 82.9%
Person 65.1%
Helmet 61.7%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of children sitting on a bench in a room -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of a family of 11 people, including 8 children, posing for a picture in a room with large windows.

The family is seated in two rows, with the adults in the back and the children in the front. The adults are dressed in formal attire, while the children wear casual clothing. The children are all smiling and appear to be happy.

The background of the image shows a room with large windows that offer a view of trees outside. The walls of the room are painted white, and there is a curtain hanging from the window on the right side of the image.

The overall atmosphere of the image is one of joy and happiness, as the family appears to be enjoying each other's company. The image suggests a sense of warmth and closeness among the family members, and the formal attire of the adults adds a touch of elegance to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

This image depicts a family of eleven posing for a photograph in front of a large window. The family consists of two adults and nine children, with the adults positioned in the center and the children arranged around them.

The adults are dressed in formal attire, with the man wearing a suit and tie, and the woman wearing a dress. The children are also dressed in formal clothing, with the girls wearing dresses and the boys wearing suits and ties.

In the background, a large window dominates the scene, offering a view of a wooded area with bare trees. The overall atmosphere of the image suggests a formal family portrait, possibly taken in the 1950s or 1960s based on the clothing and hairstyles.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The black-and-white image shows a family of eight people posing for a photo. They are all smiling and appear to be happy. The family consists of two adults and six children. The adults are standing, while the children are sitting on a bench. The adults are holding the children in their arms. The children are wearing dresses and shoes. The image has a watermark on the top right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white image features a family with eight members, including a man and a woman, who are likely the parents, and their six children. The family is gathered in front of a glass window with curtains. The man is holding a baby, while the woman is sitting on a chair with a child on her lap. The other children are standing on the stairs. Behind them are trees and a building.

Google Gemini

Created by gemini-2.0-flash on 2025-05-25

Here is a description of the image:

The image appears to be a black and white photographic negative of a group portrait. In the foreground, there are several children seated, with one adult woman and one adult man seated among them. The woman is seated to the left, while the man is seated slightly to the right of center. The man is holding a young child in his lap. There are also other children standing or sitting behind the main group, indicating a multi-generational family portrait.

Behind the figures, there is a large window with multiple panes. The window offers a view of trees, possibly bare due to the season, outside. To the right of the window is a patterned curtain. The background suggests an interior setting, possibly a home or studio.

The word "KODAK - SAFETY" is mirrored and readable on the right side of the image, indicating that it is a negative from Kodak film. A number "5-" is visible near the bottom, potentially a marking or reference number related to the negative.

Created by gemini-2.0-flash-lite on 2025-05-25

This is a black and white negative of a family portrait. It appears to be a group of nine individuals, likely a family, posed inside a building near a large window that looks out onto a forest.

Here's a more detailed breakdown:

  • People: There are eight children and two adults (a man and a woman). The children range in age, with some being babies/toddlers. They are all dressed in semi-formal clothing typical of the time period. The adults seem to be dressed formally as well.
  • Setting: The group is positioned near a large window. The backdrop visible through the window is a forest with bare trees, suggesting it is either late fall or winter. The interior space is simple, possibly a living room or sunroom, with a curtain visible.
  • Composition: The family is sitting on what appears to be a wide windowsill, a ledge, or a bench near the window.
  • Overall Impression: The image likely captures a special moment in the family's life, possibly a holiday or family reunion. It gives a glimpse into the attire, aesthetics, and social norms of the time. The style of the photograph suggests it's likely from the mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a black-and-white photograph featuring a group of children and adults, likely a family portrait. The setting appears to be indoors, with a large window in the background that shows a view of trees outside. The window is framed by curtains.

Here is a detailed description of the people in the image:

  1. Front Row (left to right):

    • A young girl wearing a dark dress with a lace collar and a bow in her hair.
    • A young boy in a white shirt and dark pants.
    • A young girl in a dark dress with a lace collar.
    • A man holding a young child in his lap. The child is wearing a light-colored outfit.
    • A young girl in a white dress with a dark sash and white shoes.
  2. Back Row (left to right):

    • A woman wearing a dark dress.
    • A young boy in a striped shirt.
    • A young girl in a striped shirt.
    • A young boy standing on a chair, wearing a dark sweater and light-colored pants.

The individuals in the photograph are posed formally, suggesting that this might be a special occasion or a formal family portrait. The expressions on their faces are generally pleasant, indicating a happy and relaxed atmosphere. The clothing styles and the overall composition of the photograph suggest it might be from the mid-20th century.

Text analysis

Amazon

s
KODVK-EVELA

Google

YT37A2-XAGON
YT37A2-XAGON