Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1135

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Mulhall family, sharecroppers, Ozarks, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1135

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
People 100
Clothing 99.9
Pants 99.9
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 98.6
Male 98.6
Boy 98.6
Child 98.6
Person 97.9
Child 97.9
Female 97.9
Girl 97.9
Coat 94.8
Jacket 94.8
Wood 93.9
Person 92.4
Baby 92.4
Hat 82.9
Architecture 78
Building 78
Housing 78
Shorts 73
Outdoors 72.4
Nature 66.5
House 65
Vest 61
Cabin 57.7
Jeans 57.1
Slum 56.4
Log Cabin 56
Firearm 55.6
Gun 55.6
Rifle 55.6
Weapon 55.6
Slate 55.5
Shirt 55.3
Archaeology 55.3
Shelter 55.3

Clarifai
created on 2018-05-11

people 100
group 99.8
child 99.6
adult 97.4
portrait 96.9
group together 96.9
wear 95.8
three 95.3
man 94.9
offspring 94.6
four 94.4
sibling 94.3
son 93.9
boy 93.8
five 93.7
several 93.6
administration 91.5
military 90.7
two 90.6
family 90.5

Imagga
created on 2023-10-06

kin 59.2
statue 21.7
man 20.8
world 19.2
people 19
sculpture 18.1
person 17.2
travel 16.9
male 15
sky 14.7
old 14.6
outdoor 13.7
beach 13.5
monument 13.1
adult 13
tourism 12.4
summer 12.2
architecture 11.7
history 11.6
marble 11.6
mother 11.3
outdoors 11.2
portrait 11
lifestyle 10.8
sibling 10.8
water 10.7
art 10.5
sport 10.5
clothing 10.3
stone 10.1
parent 10.1
active 10
city 10
grandfather 9.9
park 9.9
vacation 9.8
family 9.8
lady 9.7
couple 9.6
ancient 9.5
love 9.5
child 9.4
landmark 9
body 8.8
happy 8.8
women 8.7
boy 8.7
military 8.7
happiness 8.6
holiday 8.6
culture 8.5
historical 8.5
famous 8.4
dress 8.1
sunset 8.1
smiling 8
building 7.9
grass 7.9
sand 7.8
sea 7.8
casual 7.6
ocean 7.5
vintage 7.4
aged 7.2
sexy 7.2
religion 7.2
to 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99
person 99
posing 98.8
old 83.1
standing 77.4
group 61.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 97.3%
Surprised 6.4%
Fear 6%
Sad 2.3%
Confused 0.6%
Happy 0.5%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Female, 99.5%
Confused 48.9%
Sad 47.4%
Calm 14.6%
Surprised 6.6%
Fear 6.4%
Disgusted 5.9%
Happy 1.4%
Angry 1.1%

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Sad 100%
Calm 11.6%
Fear 6.5%
Surprised 6.4%
Angry 1.1%
Confused 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Male, 78.4%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 5.3%
Angry 2.6%
Confused 1.1%
Disgusted 0.6%
Happy 0.1%

AWS Rekognition

Age 0-3
Gender Male, 98.4%
Calm 96.6%
Fear 6.4%
Surprised 6.3%
Sad 2.4%
Angry 0.4%
Confused 0.4%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Boy
Child
Female
Girl
Jacket
Baby
Person 99.3%
Person 99.2%
Person 98.6%
Person 97.9%
Person 92.4%
Adult 99.3%
Adult 99.2%
Male 99.3%
Male 99.2%
Male 98.6%
Man 99.3%
Man 99.2%
Boy 98.6%
Child 98.6%
Child 97.9%
Female 97.9%
Girl 97.9%
Jacket 94.8%
Baby 92.4%

Categories

Imagga

paintings art 99.1%

Captions

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-28

The image is a black and white photograph depicting a family posing in front of a log cabin. The family appears to be of modest means, possibly from the era of the Great Depression.

Here's a breakdown of the elements:

  • Family: The photograph features a family of five. The father stands at the right, dressed in overalls and a cap. The mother stands on the left, holding a young child. Two other children, a young boy and a girl, stand in the middle, holding hands.
  • Clothing: The family's clothing suggests they are poor. The adults and children are wearing simple, worn clothes.
  • Setting: The family is standing outside a rough log cabin. The cabin's construction, the worn logs, indicates a rural setting and potentially limited economic resources.
  • Atmosphere: The overall tone is somber. The faces of the family members show a mixture of determination and hardship. This evokes the feeling of a family struggling to survive in difficult circumstances.

Created by gemini-2.0-flash on 2025-04-28

Here's a description of the image:

The image is a black and white photograph featuring a family of five standing in front of a rustic log cabin.

From left to right:

  • A woman stands holding a baby. She is wearing a simple dress and has a concerned expression.
  • The baby in her arms looks slightly to the side.
  • A young girl stands in front of the woman, also wearing a simple dress and looking down.
  • A young boy stands next to the woman, holding hands with a man. He's wearing overalls and looks solemnly at the camera.
  • A man stands tall in overalls, looking directly at the camera with a serious expression. He's wearing a cap.

The cabin behind them is made of rough-hewn logs. There is a small window. The overall tone of the image is somber and evokes a sense of hardship or poverty.

Text analysis

Amazon

9