Human Generated Data

Title

The Brown Sisters, Eastham, Massachusetts

Date

2000

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P2001.2

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Eastham, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2000

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.2
Person 99.2
Person 99.2
Person 99
Face 97
People 92.8
Clothing 92.6
Apparel 92.6
Smile 71.9
Photography 71.3
Photo 71.3
Portrait 70.1
Indoors 68.9
Man 65
Dating 62.6
Family 61.1
Head 56.4

Imagga
created on 2022-01-22

kin 65.8
father 46.8
smiling 43.5
happy 41.4
male 37.8
mother 36
man 35.7
people 35.2
family 34.7
dad 34.6
group 33.1
parent 33
couple 31.4
together 28.1
home 28
happiness 27.5
child 27.1
men 26.7
smile 25
sitting 24.1
daughter 23.5
team 23.3
brother 22.7
portrait 22.7
love 22.1
son 21.6
30s 21.2
women 20.6
buddy 20.5
adult 20.1
husband 19.4
indoors 19.4
boy 18.3
teamwork 17.6
business 17
lifestyle 16.6
office 16.1
children 15.5
person 15.5
wife 15.2
friends 15
camera 14.8
parents 14.7
corporate 14.6
thirties 14.6
businessman 14.1
attractive 14
cheerful 13.8
businesswoman 13.7
businesspeople 13.3
adults 13.3
sibling 12.9
success 12.9
20s 12.8
confident 12.8
casual 12.7
colleagues 12.6
horizontal 12.6
diversity 12.5
generation 12.5
sofa 12.5
work 11.8
staff 11.5
joy 10.9
their 10.8
40s 10.7
partnership 10.6
enjoying 10.4
looking 10.4
meeting 10.4
kids 10.4
executive 10.2
girls 10
grandfather 10
forties 9.8
partners 9.7
mom 9.7
looking camera 9.6
four 9.6
females 9.5
togetherness 9.5
relationship 9.4
teenager 9.1
fun 9
handsome 8.9
kid 8.9
computer 8.8
grandmother 8.8
standing 8.7
mid adult 8.7
laugh 8.6
expression 8.5
face 8.5
senior 8.4
friendship 8.4
pretty 8.4
laptop 8.2
suit 8.1
working 8
lounge 7.8
half length 7.8
workers 7.8
married 7.7
professional 7.7
confidence 7.7
student 7.6
house 7.5
three 7.5
holding 7.4
successful 7.3
childhood 7.2
job 7.1
interior 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 99.9
human face 99.1
smile 98
clothing 97.2
man 89.7
posing 83.3
people 81.5
woman 62.6
text 61.9
black and white 60.5
crowd 0.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-48
Gender Female, 100%
Happy 53.4%
Calm 24.1%
Confused 14.1%
Disgusted 3.7%
Sad 1.6%
Angry 1.6%
Surprised 0.9%
Fear 0.5%

AWS Rekognition

Age 51-59
Gender Female, 99.6%
Calm 80.7%
Confused 11.8%
Happy 3.6%
Angry 1.4%
Surprised 0.8%
Disgusted 0.6%
Sad 0.6%
Fear 0.4%

AWS Rekognition

Age 47-53
Gender Female, 99.8%
Calm 77.6%
Confused 7.4%
Sad 6.1%
Angry 3.6%
Disgusted 2.3%
Fear 1.2%
Happy 1%
Surprised 0.8%

AWS Rekognition

Age 42-50
Gender Female, 97.6%
Happy 55.5%
Calm 32.2%
Confused 5.6%
Sad 2.5%
Disgusted 1.5%
Surprised 1.2%
Angry 1%
Fear 0.5%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 99.2%
a group of people posing for the camera 99.1%
a group of people sitting posing for the camera 98.9%