Human Generated Data

Title

Untitled (children of miners working in Sunbeam Mines, Scotts Run, West Virginia)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3354

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (children of miners working in Sunbeam Mines, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3354

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Shorts 100
Person 99.5
Boy 99.5
Child 99.5
Male 99.5
Pants 99.4
Person 99.4
Boy 99.4
Child 99.4
Male 99.4
Grass 87.5
Plant 87.5
Backyard 87.3
Nature 87.3
Outdoors 87.3
Yard 87.3
Vest 74.5
Body Part 62
Hand 62
Coat 61.2
Jacket 57.9
Wood 57.9
Finger 57.4
Knitwear 56.3
Sweater 56.3
Garden 56
Furniture 55.8
Happy 55.2
Smile 55.2

Clarifai
created on 2018-05-10

people 100
child 99.9
boy 98.9
group 98
son 97.5
sibling 97.4
offspring 97.2
war 96.5
two 95.7
portrait 95.6
family 95.4
wear 95.3
group together 94.7
adult 94.2
facial expression 94.1
man 92.5
military 90.9
outfit 90.1
administration 90
three 88.6

Imagga
created on 2023-10-05

child 44.5
kin 43.5
outdoors 33.6
people 31.8
family 29.4
happiness 27.4
male 26
parent 25.7
mother 24.6
man 23.5
adult 22.6
person 22
love 21.3
kid 20.4
portrait 20.1
park 19.8
happy 19.4
boy 19.1
together 18.4
outdoor 18.3
sibling 18.3
walking 18
autumn 17.6
lifestyle 17.3
children 17.3
outside 17.1
world 17.1
smiling 16.6
couple 16.6
day 16.5
girls 16.4
fun 15.7
daughter 15.5
summer 15.4
two 14.4
son 14.3
human 14.2
life 13.6
grass 13.4
childhood 13.4
joy 13.4
walk 13.3
togetherness 13.2
father 13.1
women 12.7
leisure 12.5
cheerful 12.2
men 12
dad 11.8
beach 11.8
vacation 11.5
smile 11.4
relationship 11.2
holding 10.7
full length 10.7
active 9.9
sunset 9.9
clothing 9.7
hair 9.5
enjoying 9.5
kids 9.4
cute 9.3
casual 9.3
offspring 9.2
countryside 9.1
fall 9
recreation 9
sky 8.9
healthy 8.8
face 8.5
youth 8.5
females 8.5
senior 8.4
field 8.4
exercise 8.2
forest 7.8
season 7.8
affectionate 7.7
attractive 7.7
running 7.7
toddler 7.6
husband 7.6
tool 7.6
relaxation 7.5
rest 7.4
sport 7.4
juvenile 7.4
sun 7.2
romantic 7.1
grandfather 7.1
little 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.7
grass 98.4
outdoor 96
standing 95.9
posing 82
white 74.4
black 71.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-16
Gender Female, 92%
Calm 83.6%
Happy 7.5%
Surprised 6.6%
Fear 6.2%
Sad 2.9%
Angry 2.7%
Confused 1.4%
Disgusted 1.2%

AWS Rekognition

Age 16-22
Gender Female, 99.9%
Sad 93.6%
Happy 36.5%
Fear 8.5%
Surprised 6.6%
Calm 4.3%
Angry 2.7%
Confused 2.3%
Disgusted 2.1%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Boy
Child
Male
Coat
Person 99.5%
Person 99.4%
Boy 99.5%
Boy 99.4%
Child 99.5%
Child 99.4%
Male 99.5%
Male 99.4%
Coat 61.2%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of two boys standing next to each other in front of a wooden fence -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts two children standing outside in front of a wooden structure, possibly a house or shed. Both are wearing overalls and simple shirts, typical of rural or working-class attire. One child is standing with arms down, while the other has their arms raised above their head. The ground around them appears grassy, with plants visible near the base of the wooden wall. Shadows are cast along the wall, suggesting sunlight coming from the side.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image features two young boys standing in front of the wooden wall of a building. Both boys are wearing overalls. The boy on the left is standing with his arms at his sides, while the boy on the right has his hands on top of his head. They are both barefoot, and the area around them has grass and some foliage. There is sunlight casting shadows on the wall behind them.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two young boys standing in front of a wooden wall.

  • The boy on the left has short hair and is wearing a long-sleeved shirt with overalls that are stained and dirty. His right arm is at his side, and his left arm is bent at the elbow, with his hand resting on his head.
  • The boy on the right also has short hair and is wearing a long-sleeved shirt with overalls that are stained and dirty. His right arm is raised, with his hand resting on his head, and his left arm is at his side.
  • The boys are standing in a grassy area in front of a wooden wall made of horizontal planks. The wall appears to be weathered and worn, with some of the planks showing signs of rot or damage.
  • The overall atmosphere of the image suggests that it was taken in a rural or agricultural setting, possibly during the early 20th century. The boys' clothing and the condition of the wall support this interpretation.

The image appears to be a candid shot of two young boys, possibly siblings or friends, posing for the camera in a rustic outdoor setting. The photograph captures a moment in time, offering a glimpse into the lives of these two young individuals and the environment in which they lived.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black and white photograph of two young boys standing in front of a wooden building. The boy on the left has short hair and is wearing overalls with a long-sleeved shirt underneath, while the boy on the right has short hair and is wearing overalls with a short-sleeved shirt underneath. Both boys are barefoot and appear to be dirty, suggesting they may have been playing outside. The background of the image features a wooden building with horizontal slats, and there are plants growing in front of it. The overall atmosphere of the image suggests a rural or countryside setting, possibly during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of two young boys standing in a grassy area. The boy on the left is wearing a shirt and overalls, while the boy on the right is wearing a shirt and shorts. The boy on the right is holding his head with both hands, and his shadow is cast on the wooden wall behind him. The wooden wall has a rectangular shape and is made of wood. The grass is tall and has some small plants growing in it.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black and white photograph of two young boys standing next to each other. The boys are wearing overalls and shirts. The boy on the left is looking directly at the camera, while the boy on the right is looking to the side and has his hands on his head. They are standing on a grassy area in front of a wooden structure, probably a shed.

Google Gemini

Created by gemini-2.0-flash on 2025-05-24

The black and white image shows two young boys standing in front of a wooden-paneled wall. Both boys are dressed in overalls, appearing worn and perhaps slightly dirty. The boy on the left has long-sleeved overalls and is barefoot. He has a serious or neutral expression. The boy on the right has short-sleeved overalls, with his hands raised and placed on top of his head, giving the impression of a relaxed pose. He is smiling slightly. There is vegetation around the base of the wall where the boys are standing. The image has a grainy quality, typical of older photographs.

Created by gemini-2.0-flash-lite on 2025-05-24

The black and white image shows two young boys standing outdoors. They are positioned in front of a weathered wooden wall. The boy on the left stands straight, looking towards the camera. He is wearing overalls and a button-down shirt. The boy on the right also wears overalls and is raising his arms above his head. His shadow is cast on the wall behind him. They are both standing in a patch of grass and dirt. The overall atmosphere of the image is one of simplicity and likely poverty, given their appearance and setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts two young boys standing in front of a wooden structure, likely a barn or shed. They are dressed in overalls and appear to be in a rural setting. The boys are holding up a large bundle of plants, possibly tobacco leaves, which are tied together and hung over their shoulders. The boys are barefoot, and their clothing is worn and dirty, suggesting they have been working or playing outdoors. The background includes a wooden wall and some overgrown grass, reinforcing the rural environment. The image is in black and white, giving it a vintage or historical feel.