Human Generated Data

Title

The Brown Sisters, Wellfleet, Massachusetts

Date

2015

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2015.119

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Human Generated Data

Title

The Brown Sisters, Wellfleet, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2015

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2015.119

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 99.6
Human 99.6
Person 99.6
Person 99.4
Face 96.9
Head 81.7
People 78
Person 73
Photography 70.4
Portrait 70.4
Photo 70.4
Man 66.6
Hair 65.8
Female 63.7
Clothing 62
Apparel 62
Finger 60.1
Accessories 56.8
Jewelry 56.8
Accessory 56.8
Necklace 56.8
Woman 55.2

Clarifai
created on 2018-02-16

group 99.4
people 99.2
man 98.4
group together 97.8
four 97.3
portrait 97.3
adult 96.3
three 96
woman 92.2
facial expression 89.9
child 88.6
five 84.8
two 83.1
family 82.3
monochrome 81.8
affection 79.5
offspring 79
music 78.9
several 77.8
interaction 77

Imagga
created on 2018-02-16

couple 58.4
senior 50.6
man 46.4
happy 45.8
love 43.4
male 40.1
together 39.4
sibling 38.6
elderly 35.4
people 34.6
mature 34.4
smiling 34
husband 31.8
family 30.3
grandma 29.4
retired 29.1
married 28.8
grandfather 28.4
wife 27.5
portrait 27.2
smile 27.1
old 25.1
person 24.7
adult 24
grandmother 22.5
retirement 22.1
mother 21.9
romance 21.4
kin 21
relationship 20.6
affection 20.3
lifestyle 20.2
marriage 19.9
romantic 19.6
happiness 18.8
women 18.2
men 18
two 17.8
attractive 16.8
father 16.7
parent 16.5
handsome 16.1
home 16
hair 15.9
older 15.5
affectionate 15.5
loving 15.3
60s 14.7
daughter 14.5
gray 14.4
looking 14.4
cheerful 13
face 12.8
aged 12.7
pretty 12.6
friends 12.2
fun 12
casual 11.9
lady 11.4
togetherness 11.3
dad 11.2
eyes 11.2
grandparents 10.9
sixties 10.8
pensioner 10.8
couples 10.8
hug 10.7
child 10.6
age 10.5
enjoying 10.4
laughing 10.4
friendship 10.3
glasses 10.2
healthy 10.1
joy 10
seniors 9.8
indoors 9.7
aging 9.6
pair 9.4
camera 9.2
leisure 9.1
group 8.9
70s 8.9
faces 8.8
dating 8.7
horizontal 8.4
granddaughter 7.9
look 7.9
day 7.8
bonding 7.8
flirting 7.8
middle aged 7.8
generation 7.7
laugh 7.7
health 7.6
adults 7.6
outdoors 7.5
holding 7.4
park 7.4
relaxing 7.3

Google
created on 2018-02-16

Microsoft
created on 2018-02-16

person 98.3
outdoor 95.5
posing 89.9
standing 77.8
people 69.9
group 68.8
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Female, 82.5%
Happy 46.5%
Disgusted 5.2%
Confused 7.8%
Calm 20.5%
Angry 4.1%
Sad 13.5%
Surprised 2.5%

AWS Rekognition

Age 57-77
Gender Male, 57.2%
Confused 13.5%
Sad 23.3%
Disgusted 9.7%
Happy 9%
Surprised 5.5%
Angry 7.6%
Calm 31.4%

AWS Rekognition

Age 45-66
Gender Male, 96.9%
Sad 20.9%
Calm 41.2%
Disgusted 4%
Surprised 2.9%
Angry 5.9%
Happy 10.6%
Confused 14.6%

AWS Rekognition

Age 45-66
Gender Female, 54.3%
Disgusted 6.5%
Confused 9.7%
Surprised 2.5%
Calm 39.9%
Angry 7.7%
Happy 6.2%
Sad 27.5%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 56
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Necklace 56.8%

Categories

Imagga

people portraits 99.9%
paintings art 0.1%

Captions

Azure OpenAI

Created by gpt-4 on 2024-11-17

This is a black and white photo showing four individuals standing close together, shoulder to shoulder, as if posing for a group portrait. They all appear to be wearing casual clothing, and the photo captures them from about mid-torso up. The person on the left is wearing a short-sleeved shirt with a pocket and a button detail, while the next individual has a black top. The person second from the right has grey hair and is wearing a black top, and the person on the extreme right is wearing a light-colored, striped top with a heart-shaped pendant around the neck. The background is blurred but suggests a natural outdoor setting with foliage.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-11-17

The image appears to be a black and white portrait of four older women. They are positioned close together, suggesting a close relationship or familial connection. The women have different hairstyles and facial expressions, but they seem to share a sense of wisdom and experience. The background appears to be a natural setting, with some foliage visible. The overall impression is one of a warm, intimate moment captured in time.

Meta Llama

Created on 2024-11-30

The image is a black-and-white photograph of four women standing together, posing for the camera. The woman on the left has short dark hair and wears a white shirt. The woman next to her has short dark hair and wears a light-colored shirt with a pocket on the front. The woman in the middle has long, curly gray hair and wears a dark shirt. The woman on the right has long dark hair and wears a light-colored shirt with a necklace featuring a pendant. The women are positioned close together, with their arms around each other. They appear to be friends or family members who are showing affection and support for one another. The background of the image is blurry, but it appears to be an outdoor setting with trees and branches visible behind the women. The overall atmosphere of the image is one of warmth and closeness, suggesting that the women are sharing a special moment together.