Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

Date

2016

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2016.214

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2016

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2016.214

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 99.6
Human 99.6
Person 99.6
Person 99.6
Person 99.2
Face 97.6
Head 94.4
Finger 91.7
Portrait 73.3
Photo 73.3
Photography 73.3
Skin 59.9
Hair 58.2

Clarifai
created on 2018-02-19

people 99.8
portrait 99.1
group 98.9
man 98.5
three 97.8
adult 97.4
group together 96.7
four 95.9
facial expression 95.3
two 93.1
woman 88.9
monochrome 88.1
five 86.6
music 86.2
musician 82.4
actress 77.4
several 77.2
administration 76.2
actor 75.4
movie 75

Imagga
created on 2018-02-19

couple 54.9
man 49.7
male 43.4
together 42.1
happy 40.1
love 39.5
senior 37.5
people 34.6
smiling 33.3
family 32
husband 28.9
grandfather 28.7
portrait 28.5
wife 27.5
mother 27
adult 24
married 24
smile 23.5
elderly 22
mature 21.4
happiness 21.2
sibling 20.1
kin 19.9
romance 19.6
grandmother 19.6
buddy 18.7
retirement 18.2
lifestyle 17.3
person 17.1
double 17
two 16.9
handsome 16.9
father 16.9
affection 16.4
loving 16.2
attractive 16.1
affectionate 15.5
men 15.5
old 15.3
marriage 15.2
romantic 15.1
brother 15
parent 15
retired 14.5
home 14.4
women 14.2
daughter 14.1
pretty 14
lady 13.8
grandma 13.7
hair 13.5
group 12.9
60s 12.7
cheerful 12.2
looking 12
fun 12
child 12
hug 11.6
togetherness 11.3
relationship 11.2
casual 11
grandparents 10.9
sixties 10.8
face 10.7
boy 10.4
expression 10.2
dad 10.2
indoors 9.7
enjoying 9.5
sitting 9.5
camera 9.2
teenager 9.1
holding 9.1
gray 9
two people 8.7
boyfriend 8.7
girlfriend 8.7
eyes 8.6
friends 8.5
blond 8.2
success 8
look 7.9
70s 7.9
seniors 7.9
pensioner 7.8
their 7.8
black 7.8
hugging 7.8
dating 7.8
30s 7.7
age 7.6
life 7.6
teen 7.4
sexy 7.2

Google
created on 2018-02-19

Microsoft
created on 2018-02-19

person 94
people 70.9
posing 41.4
crowd 1.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Female, 59.7%
Calm 49.1%
Surprised 1.3%
Disgusted 2.4%
Angry 31.9%
Sad 9.8%
Confused 2.9%
Happy 2.7%

AWS Rekognition

Age 38-59
Gender Female, 83.8%
Surprised 0.9%
Sad 39.6%
Disgusted 2.1%
Calm 41.7%
Happy 1.1%
Angry 4.2%
Confused 10.5%

AWS Rekognition

Age 35-55
Gender Female, 98.2%
Happy 47.9%
Angry 1.6%
Disgusted 1.4%
Sad 11.1%
Surprised 0.7%
Confused 2.3%
Calm 35%

AWS Rekognition

Age 57-77
Gender Female, 88.4%
Surprised 7.8%
Disgusted 5.5%
Confused 11.4%
Happy 37.8%
Calm 27%
Sad 5.3%
Angry 5.2%

Microsoft Cognitive Services

Age 56
Gender Female

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 76
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Captions

Azure OpenAI

Created by gpt-4 on 2024-11-17

The image displays four individuals sitting closely together in a black and white photograph. They are all wearing casual clothing, like t-shirts. Their actions and postures vary—one individual is looking down, another has their hands clasped together, while the other two have their hands near their faces, either touching their face or shoulder. There is a sense of intimacy or shared experience suggested by their close proximity and the emotive quality of the image. The photo has a dramatic and artistic feel, with a focus on the expression of body language rather than facial features. Overall, the image may represent a concept, emotion, or narrative open to interpretation.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-11-17

The image shows four elderly women with weathered faces. They appear to be in their 70s or 80s. The women have varying expressions, ranging from pensive to serene. Their hairstyles and clothing suggest they may be of a similar generation. The image has a black and white aesthetic, which adds to the timeless, contemplative mood. Overall, the photograph seems to capture a sense of strength, resilience, and the wisdom that can come with age.

Meta Llama

Created on 2024-12-01

The image is a black-and-white photograph of four women standing together, posing for the camera. The woman on the left has short dark hair and is wearing a light-colored shirt. The woman next to her has short dark hair and is wearing a light-colored shirt with a necklace. The woman in the middle has curly hair and is wearing a dark shirt. The woman on the right has long dark hair and is wearing a light-colored shirt. All four women are looking at the camera and have serious expressions on their faces. The background of the image is a plain wall. The overall atmosphere of the image is somber and introspective, suggesting that the women may be sharing a moment of reflection or contemplation.