Human Generated Data

Title

The Brown Sisters, Cataumet, Massachusetts

Date

2005

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, 2006.74

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Cataumet, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2005

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.9
Person 99.9
Person 99.7
Person 99.4
Person 99
Apparel 97.7
Clothing 97.7
Face 90.3
Sleeve 86.3
Pants 85.1
People 84
Female 82.1
Hair 77.4
Woman 65.8
Shirt 65.4
Photo 63
Photography 63
Portrait 63
Finger 61.7
Long Sleeve 59.5
Girl 58.5
Denim 57.8
Jeans 57.8
Undershirt 57.2
Shorts 55.9

Imagga
created on 2022-01-28

happy 40.2
man 39.7
group 38.8
male 37.9
people 36.3
smiling 35.5
buddy 31.7
together 31.6
kin 31.2
person 28.1
smile 27.8
team 27.8
family 26.7
adult 26.7
women 26.1
happiness 25.9
men 25.8
teamwork 25.1
couple 24.4
attractive 23.8
corporate 23.2
portrait 22.7
father 22.6
mother 22.4
office 21.7
businesswoman 20.9
business 20.7
love 19.8
businessmen 19.5
businessman 19.5
confident 19.1
suit 19
diversity 17.3
handsome 17
child 16.8
parent 16.6
standing 16.5
success 16.1
two 16.1
sibling 16
friends 16
relationship 15.9
lifestyle 15.9
boy 15.7
casual 15.3
pretty 14.7
diverse 14.7
cheerful 14.7
daughter 14.3
businesspeople 14.3
indoors 14.1
dad 13.8
expression 13.7
partners 13.6
leadership 13.5
partnership 13.5
husband 13.1
professional 12.9
successful 12.8
brother 12.7
student 12.6
son 12.6
staff 12.6
confidence 12.5
education 12.1
executive 12.1
teenager 11.9
colleagues 11.7
30s 11.6
lady 11.4
home 11.2
sitting 11.2
camera 11.1
teen 11
joy 10.9
40s 10.7
workers 10.7
adolescent 10.6
ethnic 10.5
building 10.4
looking 10.4
meeting 10.4
friendship 10.3
horizontal 10.1
face 10
guy 10
parents 9.8
partner 9.7
boyfriend 9.7
boss 9.6
college 9.5
cute 9.3
communication 9.3
school 9.1
children 9.1
black 9.1
fashion 9.1
fun 9
job 8.9
their 8.8
generation 8.7
university 8.6
juvenile 8.6
wife 8.5
bow tie 8.3
businesswomen 7.9
work 7.9
thirties 7.8
mom 7.8
outside 7.7
girlfriend 7.7
youth 7.7
enjoying 7.6
females 7.6
adults 7.6
necktie 7.6
laughing 7.6
togetherness 7.6
smart 7.5
worker 7.5
manager 7.5
three 7.5
mature 7.5
holding 7.4
20s 7.3
friendly 7.3
girls 7.3
romance 7.2
look 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

person 99.9
smile 99
posing 98
human face 97
clothing 97
standing 95.9
woman 91.5
outdoor 89.6
crowd 1.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-59
Gender Female, 99.8%
Calm 67.3%
Happy 16.8%
Confused 7.5%
Angry 3.6%
Disgusted 1.5%
Surprised 1.3%
Fear 1.1%
Sad 0.9%

AWS Rekognition

Age 43-51
Gender Female, 99.4%
Calm 83.6%
Sad 12.7%
Angry 1.4%
Confused 1.4%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 48-54
Gender Female, 100%
Happy 38%
Calm 32.7%
Confused 11.6%
Surprised 5.1%
Angry 4.1%
Disgusted 3.6%
Sad 2.8%
Fear 2.1%

AWS Rekognition

Age 30-40
Gender Female, 99.7%
Calm 95.1%
Happy 2.8%
Sad 0.8%
Confused 0.4%
Angry 0.4%
Surprised 0.3%
Fear 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people posing for a photo 98.2%
a group of people posing for the camera 98.1%
a person standing in front of a group of people posing for a photo 95.5%