Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5124

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5124

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
People 99.7
Clothing 99.5
Person 98.6
Adult 98.6
Adult 98.6
Bride 98.6
Female 98.6
Female 98.6
Wedding 98.6
Woman 98.6
Person 98.3
Adult 98.3
Female 98.3
Woman 98.3
Person 97.4
Female 97.4
Child 97.4
Girl 97.4
Person 97.3
Child 97.3
Boy 97.3
Male 97.3
Person 96.6
Adult 96.6
Female 96.6
Woman 96.6
Person 96.6
Person 96.1
Person 94.6
Person 94
Female 94
Child 94
Girl 94
Dress 93.6
Person 93.5
Baby 93.5
Coat 92.2
Person 90.2
Person 89.3
Person 88.1
Person 87.1
Person 86.5
Child 86.5
Boy 86.5
Male 86.5
Person 82.2
Slum 80.2
Person 79.1
Outdoors 63.4
Person 58.6
Happy 57.6
Smile 57.6
Shorts 56.1
Fashion 55.5
Barefoot 55.4
Body Part 55.4
Finger 55.4
Hand 55.4
Hat 55.2

Clarifai
created on 2018-05-10

people 99.9
group 99.6
child 98.8
group together 98.6
man 96.7
many 96.4
adult 95.9
war 94.4
woman 94.3
five 91.8
military 91.5
several 90.8
wear 90
four 89
family 88.9
son 88.6
boy 87.7
administration 87.5
portrait 87.2
facial expression 86.2

Imagga
created on 2023-10-06

kin 82.6
statue 22.9
people 22.9
uniform 22.7
sculpture 22
clothing 21
military uniform 20.9
child 20.2
man 19.5
outdoors 18.7
male 18.6
person 16.9
travel 15.5
old 15.3
park 14.8
ancient 14.7
soldier 14.7
military 14.5
stone 14.3
outdoor 13.8
history 13.4
tourism 13.2
monument 13.1
couple 13.1
army 12.7
day 12.5
religion 12.5
happy 12.5
architecture 12.5
adult 12.4
mother 11.9
happiness 11.7
portrait 11.6
lifestyle 11.6
war 11.5
group 11.3
art 11.2
family 10.7
autumn 10.5
fun 10.5
boy 10.4
smiling 10.1
peace 10
marble 9.7
sibling 9.5
love 9.5
outside 9.4
culture 9.4
religious 9.4
city 9.1
landmark 9
gray 9
sky 8.9
consumer goods 8.8
together 8.8
women 8.7
covering 8.6
holiday 8.6
parent 8.5
casual 8.5
world 8.4
vintage 8.3
juvenile 8.2
girls 8.2
building 8.2
protection 8.2
danger 8.2
camouflage 7.8
gun 7.8
antique 7.8
weapon 7.7
men 7.7
god 7.6
friends 7.5
decoration 7.2
life 7.2
black 7.2
smile 7.1
face 7.1
to 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.7
posing 93.8
group 90.4
outdoor 87.9
standing 83.1
white 66.5
old 66.2
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 43-51
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 14-22
Gender Female, 100%
Confused 73.3%
Happy 20.7%
Fear 6.8%
Surprised 6.7%
Sad 2.5%
Disgusted 1.1%
Calm 0.5%
Angry 0.3%

AWS Rekognition

Age 6-12
Gender Male, 92.3%
Sad 100%
Calm 7.9%
Surprised 6.4%
Fear 6%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 0.9%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 98.9%
Calm 97.4%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Confused 0.5%
Angry 0.4%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 0-4
Gender Male, 99.1%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 0-3
Gender Male, 99.8%
Sad 99.9%
Calm 17.8%
Surprised 6.5%
Fear 5.9%
Confused 4.2%
Angry 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 0-4
Gender Female, 81.3%
Sad 100%
Confused 6.4%
Surprised 6.3%
Fear 5.9%
Calm 0.5%
Happy 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 4-10
Gender Male, 98.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.9%
Angry 1.2%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-12
Gender Male, 91.5%
Calm 85.2%
Surprised 6.8%
Angry 6.1%
Fear 6%
Sad 4.9%
Confused 1%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 98.5%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Calm 0.5%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 56-64
Gender Female, 63.8%
Happy 62.9%
Sad 23.6%
Calm 9.1%
Fear 7%
Surprised 6.8%
Angry 2.5%
Confused 2.2%
Disgusted 1%

AWS Rekognition

Age 2-8
Gender Female, 98.9%
Calm 97.5%
Surprised 6.8%
Fear 5.9%
Sad 2.2%
Happy 0.7%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 96.8%
Calm 83.2%
Surprised 7%
Sad 6.8%
Fear 6.3%
Angry 4.3%
Disgusted 0.7%
Happy 0.5%
Confused 0.5%

AWS Rekognition

Age 18-24
Gender Female, 53.6%
Sad 98.9%
Calm 24.8%
Happy 8.6%
Surprised 6.8%
Fear 6.5%
Confused 2.5%
Angry 2.3%
Disgusted 1.1%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Bride
Female
Woman
Child
Girl
Boy
Male
Baby
Shorts
Person 98.6%
Person 98.3%
Person 97.4%
Person 97.3%
Person 96.6%
Person 96.6%
Person 96.1%
Person 94.6%
Person 94%
Person 93.5%
Person 90.2%
Person 89.3%
Person 88.1%
Person 87.1%
Person 86.5%
Person 82.2%
Person 79.1%
Person 58.6%
Adult 98.6%
Adult 98.6%
Adult 98.3%
Adult 96.6%
Bride 98.6%
Female 98.6%
Female 98.6%
Female 98.3%
Female 97.4%
Female 96.6%
Female 94%
Woman 98.6%
Woman 98.3%
Woman 96.6%
Child 97.4%
Child 97.3%
Child 94%
Child 86.5%
Girl 97.4%
Girl 94%
Boy 97.3%
Boy 86.5%
Male 97.3%
Male 86.5%
Baby 93.5%
Shorts 56.1%

Categories

Imagga

paintings art 90.4%
people portraits 9.3%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing around a baby in a group -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts a group of people, including women and children, standing outdoors. The women are dressed in traditional attire with scarves or cloths draped across their shoulders. The children appear to be wearing simple clothing, and some are barefoot. The setting suggests a rural or community environment. Trees and natural elements are visible in the background.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a group of individuals standing closely together. The group includes both adults and children. The adults are wearing long skirts and have cloth wrapped around their bodies, while the children are wearing shorts and appear barefoot. The overall attire suggests a setting in a rural or traditional environment. The background features some foliage, indicating they might be outdoors. The image is in black and white, lending a historical or archival quality to it.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to show a group of people, primarily women and children, in what looks like a rural or remote setting. The individuals are wearing traditional clothing and appear to be from an indigenous or ethnic minority community. Several of the women are carrying young children, and the overall scene conveys a sense of community and togetherness among the group. The image has a black and white, documentary-style aesthetic, suggesting it may be from an earlier historical period.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white photograph shows a group of women and children standing together outdoors. The women are wearing traditional clothing including long skirts or sarongs and some are carrying babies or young children. The children are of various ages, with some older children standing on their own and younger ones being held. They appear to be gathered for some kind of event or occasion. The background shows trees and foliage, suggesting a rural or village setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph showing what appears to be a group of Southeast Asian villagers, including women and children. Several women are wearing traditional clothing including sarongs and wraps. One woman is carrying an infant in a sling or carrier. Some of the children in the image are barefoot and wearing simple clothing. The photo has a documentary style quality and seems to be from several decades ago, possibly mid-20th century. The setting appears rural or village-based, with people standing together in what looks like an informal gathering or queue.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a group of people, likely refugees, standing in a line. The group consists of women and children, with some holding infants or toddlers. They are all barefoot and dressed in simple clothing, suggesting a state of poverty or displacement.

The women are wearing sarongs or long dresses, while the children are wearing tattered shorts or no clothing at all. Some of the women have headscarves or bandanas wrapped around their heads, possibly to protect themselves from the sun or cold.

The group appears to be standing in a dirt or sandy area, with some trees or bushes visible in the background. The overall atmosphere of the image suggests a sense of uncertainty, fear, and displacement, as the group may be waiting for food, shelter, or other aid.

The image is likely from a refugee camp or a similar setting, where people have been forced to flee their homes due to war, persecution, or natural disasters. The photograph serves as a powerful reminder of the human cost of conflict and displacement, and the need for compassion and support for those affected.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a group of people, primarily women and children, standing in a line. The women are dressed in traditional clothing, with some carrying babies or young children on their backs or in their arms. The children are barefoot and wear simple attire.

The background of the image appears to be a natural setting, possibly outdoors, with trees or foliage visible behind the group. The overall atmosphere of the image suggests that it may have been taken during a time of hardship or displacement, as the individuals in the photo appear to be waiting for something or someone.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people, possibly refugees, standing in a line. The people are of different ages, including women and children. The woman in the front is carrying a baby on her back, while the woman next to her is carrying a child on her shoulder. The children are standing barefoot, and some of them are wearing hats. The image has a blurry effect, which adds to the sense of urgency and distress.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people, including women and children, standing in a field. The people are wearing traditional clothing, and some of them are carrying babies on their backs. The woman on the left is holding a baby, and the woman next to her is carrying a baby on her back. The woman in the middle is carrying a baby on her chest. The children are standing barefoot on the ground.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

The image shows a black and white photograph of a group of people, likely women and children, standing closely together in an outdoor setting. They appear to be lined up. The women are wearing traditional clothing, including long skirts and scarves draped over their shoulders. Some of the women are holding or carrying small children. The children are either in their mothers' arms or standing beside them. The background is blurred, but it seems to be a natural environment with trees. The overall impression is one of a solemn and perhaps difficult time, given the serious expressions on the faces of the people in the photo.

Created by gemini-2.0-flash on 2025-05-31

Here is a description of the image:

The black and white photograph shows a group of people, mostly women and children, standing in a line. The subjects appear to be of Asian descent. The women are wearing traditional clothing, and some of them are carrying babies or young children in slings. The children are dressed in simple clothes, some with shirts and shorts. The setting seems to be outdoors, potentially in a refugee camp. The expressions on their faces suggest hardship or uncertainty. The photograph is a historical document, likely capturing a moment of displacement or crisis.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a group of people, predominantly women and children, standing closely together. The setting appears to be outdoors, possibly in a rural or impoverished area. The individuals in the image are dressed in simple, traditional clothing. Some women are carrying young children, and many of the children are barefoot or wearing minimal clothing. The expressions on their faces suggest a range of emotions, including concern, weariness, and curiosity. The overall mood of the image conveys a sense of hardship and possibly displacement or poverty. The photograph is in black and white, which may indicate it is from an earlier time period.