Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.7
Person 99.7
Person 99.1
Person 99.1
Person 96.5
People 93.8
Family 73.4
Text 64.7
Art 59.6

Clarifai
created on 2019-06-07

people 100
group 99.6
adult 99.2
child 97.5
two 97.5
man 96.2
three 95.6
woman 94.5
administration 94.3
portrait 94.3
wear 92.9
four 92.5
leader 91.6
offspring 91.3
music 88.9
several 87.3
actor 83.7
medical practitioner 83.6
group together 83.6
family 83.5

Imagga
created on 2019-06-07

kin 72.8
sibling 43
family 42.7
happy 36.4
child 34.9
male 33.2
people 31.2
man 30.9
love 30
mother 29.6
happiness 29
couple 27.9
portrait 27.8
father 27.1
smile 23.5
parent 22.9
daughter 21.8
smiling 21
kid 20.4
adult 20.1
together 19.3
dad 18.1
brother 18.1
person 17.9
senior 17.8
two 17.8
home 17.6
lifestyle 17.3
boy 16.5
husband 16.4
old 16
married 15.3
cute 15.1
attractive 14.7
grandfather 14.7
children 14.6
elderly 14.4
grandmother 13.7
relationship 13.1
cheerful 13
face 12.8
blond 12.7
casual 12.7
black 12.7
joy 12.5
wife 12.3
fun 12
grandma 11.9
women 11.9
girls 11.9
affection 11.6
little 11.5
togetherness 11.3
playing 10.9
son 10.8
childhood 10.8
pretty 10.5
mature 10.2
holding 9.9
care 9.9
human 9.7
sepia 9.7
retired 9.7
indoors 9.7
baby 9.6
marriage 9.5
men 9.4
aged 9.1
romantic 8.9
generations 8.9
bonding 8.8
loving 8.6
adorable 8.3
lovely 8
looking 8
granddaughter 7.9
day 7.8
hug 7.7
30s 7.7
retirement 7.7
head 7.6
kids 7.5
lady 7.3
dress 7.2
sexy 7.2
holiday 7.2
romance 7.1
hair 7.1
handsome 7.1

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

person 99.6
human face 99.2
clothing 99.1
smile 92.7
woman 85.2
old 79.3
vintage clothing 75.5
photograph 70.9
posing 70.2
black 68.9
portrait 64.5
retro style 62.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 84.2%
Calm 19.7%
Surprised 1.6%
Happy 12.9%
Angry 9.8%
Sad 14.5%
Confused 5.5%
Disgusted 36.1%

AWS Rekognition

Age 12-22
Gender Female, 99.4%
Disgusted 0.1%
Angry 0.3%
Sad 5.3%
Surprised 0.2%
Confused 0.3%
Calm 92.8%
Happy 0.8%

AWS Rekognition

Age 20-38
Gender Male, 51.4%
Sad 3.8%
Confused 1.1%
Disgusted 0.5%
Surprised 1.2%
Calm 90.8%
Angry 1.3%
Happy 1.4%

AWS Rekognition

Age 19-36
Gender Female, 56.1%
Angry 4.3%
Calm 42.1%
Confused 1.7%
Disgusted 4%
Sad 41.9%
Surprised 2.3%
Happy 3.6%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.1%
Person 99.1%
Person 96.5%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-06-13

a photograph of a man and two women standing in front of a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image shows a group of individuals standing indoors in what appears to be a modest, rustic setting. The people are dressed in early 20th-century attire. One individual is wearing a plaid-patterned dress, another is in darker clothing with buttons, and a child is wearing a light-colored outfit, possibly a blouse or dress. In the background, wooden paneling and a window with light shining through are visible, adding to the vintage and home-like atmosphere. The overall tone of the image is sepia or aged, giving it a historical feel.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a group of four people standing closely together. The setting appears to be indoors with wooden paneled walls in the background. The person on the left is wearing a plaid dress with a belt. They are next to a taller person who has their arm draped over a child wearing a light-colored dress with a ribbon in their hair. There is another child to the left who is wearing a dark dress. Visible details include the clothing style, which suggests the image is historical, and the handwritten number '987' at the top of the photograph.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph from an earlier time period. It shows a group of people, including a man with a mustache and two women, one of whom is wearing a plaid dress. The man is standing with one of the women, while the other woman is standing slightly apart from them. The image has a vintage, historical feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph, likely from the late 1800s or early 1900s, showing a family group of four people. The image shows what appears to be an indoor setting with wooden walls visible in the background. From left to right, there is a person in dark clothing, another in a plaid or checked dress, an adult man wearing what looks like a suit jacket with a mustache, and a young child in lighter colored clothing. The photograph has "687" written at the top, suggesting it may be part of a collection or series. The style of dress and hair, particularly the women's upswept hairstyles, is typical of the Victorian or Edwardian era. The image quality and sepia tones are characteristic of early photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a family of four, with the father standing in the center and the mother to his left, and two children, a boy and a girl, to his right.

The father has a mustache and is wearing a dark suit jacket and pants. The mother is wearing a dark dress with a plaid blouse underneath. The boy is wearing a light-colored shirt, and the girl is wearing a dark dress.

The background of the image appears to be a room with wood paneling on the walls. There is a window on the left side of the image, and a chair is visible behind the children.

The overall atmosphere of the image suggests that it was taken in a domestic setting, possibly in the early 20th century. The clothing and hairstyles of the family members are consistent with this time period.

The image also appears to be a formal portrait, as the family members are posed in a way that suggests they are being photographed for a special occasion. The presence of the number "687" written in the top center of the image suggests that it may have been taken for identification purposes, such as for a passport or immigration document.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a family of four, with the father standing in the center and his arm around one of the daughters. The mother stands to his left, while the other daughter sits on a chair to the left of the mother.

The father has short hair and wears a dark suit jacket over a striped shirt and tie. The mother has her hair styled up and wears a plaid blouse with a dark skirt. The daughter on the right has her hair pulled back and wears a white dress, while the daughter on the left has her hair styled up and wears a dark dress.

In the background, there is a wall made of horizontal wooden slats, with a window on the left side of the image. The overall atmosphere of the photograph suggests a formal or posed setting, possibly taken in a studio or at home.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

An old black-and-white photo of a family of four, with a man and two women standing in front of a wooden wall. The man is wearing a suit and tie and has his hand on the shoulder of a young girl. The young girl is wearing a white dress and has her hand on the shoulder of the man. The woman standing behind them is wearing a plaid dress and has a flower in her hair.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black-and-white photograph of four people standing close together. Three of them are women, and one is a man. The man is wearing a suit and tie, while the women are wearing dresses. The man is standing on the right, and the three women are standing on the left. The man is holding the shoulder of the woman standing in front of him. The woman standing next to him is looking at him.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

In a sepia, indoor studio shot, a moustached man stands with his hand on his young daughter's arm, while two other girls stand and sit near them.

The man is on the right side of the photo. He has light hair receding away from his forehead, a large moustache, and is wearing a dark coat and collared shirt. To his left, his young daughter looks slightly up and to the left. Her hair is pulled back and has a white flower in it. Her right arm is up and touching her father's coat.

To the man's left and slightly in front of him, a young woman stands with her head tilted to the left. Her hair is pulled up in a large bouffant. She is wearing a plaid shirt and long dark skirt with a belt. To her left, a third girl is sitting at the edge of a dark wooden box. She has dark hair, and a flower is visible in it. She looks to the left, out of the frame.

The background is made up of wooden boards with vertical lines. A small window is visible behind the girl on the left. A number "987" is written at the top of the photograph.

Created by gemini-2.0-flash-lite on 2025-06-13

Certainly! Here's a description of the image:

Overall Impression:

The image appears to be a vintage black-and-white photograph of a family. It's likely from the early 20th century, judging by the clothing and the overall style of the photo.

People:

  • The Man: A mature man with a prominent mustache. He wears a dark suit jacket and seems to be the patriarch. He has his arm around a young girl.
  • Woman 1: A young woman wearing a plaid blouse and a dark skirt.
  • Woman 2: Appears to be a young girl.
  • Woman 3: Appears to be a young girl.

Setting:

The photograph was taken indoors. The background consists of wood paneling, which suggests a wall. There appears to be a window or opening to the left.

Composition:

The people are posed. The photographer probably arranged them this way for a portrait. The overall lighting seems soft, typical of the photographic techniques of the time.

Additional details:

  • The image seems to have some wear and tear, as it is likely an old photograph. There are a few marks on the picture.
  • The numbers "987" is written near the top of the picture.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-13

This image appears to be a vintage black-and-white photograph, likely taken in the late 19th or early 20th century. It features four individuals, possibly a family, posing together in what seems to be an indoor setting with wooden walls.

  1. People in the Photo:

    • Man: Standing in the center, he is wearing a dark suit with a vest and a necktie. He has a mustache and is looking slightly to the side.
    • Woman: Standing next to the man, she is wearing a long dress with a plaid pattern and a dark hat. Her hair is styled in an updo.
    • Young Girl: Standing to the right of the man, she is wearing a light-colored dress with a dark sash or belt. Her hair is styled in a bow.
    • Another Young Girl: Seated on the left, she is wearing a dark dress and has a similar hairstyle to the standing girl.
  2. Setting:

    • The background consists of wooden walls, suggesting the photo might have been taken inside a house or a rustic building.
    • There is a small window or opening on the left side of the image, letting in some light.
  3. Details:

    • The photograph has some markings and numbers written on it, possibly for identification or cataloging purposes.
    • The overall tone and style of the clothing suggest a historical period, possibly around the turn of the 20th century.

The image captures a moment in time, providing a glimpse into the fashion and lifestyle of the era. The formal attire and posed nature of the photograph indicate it might have been a special occasion or a formal family portrait.

Text analysis

Amazon

7
47 7
47

Google

G97
G97