Human Generated Data

Title

The Brown Sisters, Ipswich, Massachusetts

Date

2003

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P2004.2

Copyright

© 2003 Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Ipswich, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2003

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 99.7
Human 99.7
Person 99.5
Person 99.4
Face 97.9
Clothing 95.7
Apparel 95.7
People 80.4
Hair 75.5
Female 68.3
Man 62.9
Photo 62.5
Portrait 62.5
Photography 62.5
Sleeve 55.2
Dating 55.1

Imagga
created on 2022-05-28

man 42.4
happy 38.9
male 38.6
smiling 36.2
couple 35.7
people 35.7
buddy 32
group 30.7
together 26.3
men 25.8
women 25.3
daughter 24.8
love 24.5
sibling 24.4
person 23.8
smile 23.5
team 23.3
portrait 22
happiness 22
business 21.9
attractive 21.7
corporate 21.5
adult 21.5
family 21.4
businessman 21.2
office 20.9
teamwork 20.4
brother 18.9
handsome 17.8
businesswoman 17.3
mother 17.1
businessmen 16.6
suit 16.6
standing 16.5
kin 16.4
executive 15.8
casual 15.3
businesspeople 15.2
friends 15
partners 14.6
diversity 14.4
looking 14.4
mature 14
confident 13.7
partnership 13.5
husband 13.4
relationship 13.1
boy 13.1
parent 13
expression 12.8
girls 12.8
two 12.7
30s 12.5
lady 12.2
teen 12
teenager 11.9
diverse 11.8
lifestyle 11.6
indoors 11.4
cheerful 11.4
meeting 11.3
fun 11.2
three 11.2
camera 11.1
father 11
work 11
colleagues 10.7
staff 10.6
pretty 10.5
ethnic 10.5
success 10.5
professional 10.4
senior 10.3
home 9.6
sitting 9.5
black 9.3
faces 8.8
40s 8.8
partner 8.7
affection 8.7
leadership 8.7
married 8.6
confidence 8.6
cute 8.6
wife 8.5
face 8.5
adults 8.5
studio 8.4
joy 8.4
grandma 8.2
worker 8.1
romance 8
romantic 8
businesswomen 7.9
brunette 7.9
workers 7.8
affectionate 7.7
child 7.7
formal 7.7
loving 7.6
females 7.6
laughing 7.6
fashion 7.5
horizontal 7.5
smart 7.5
friendship 7.5
successful 7.3
student 7.3
day 7.1
look 7
guy 7

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

human face 99.5
smile 97.7
person 96.6
clothing 96.2
standing 92.9
woman 90.5
posing 83.9
text 80.1
black and white 78.9
black 67.7
man 62.4
glasses 57.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-50
Gender Female, 99.5%
Calm 95.6%
Surprised 6.3%
Fear 5.9%
Confused 3%
Sad 2.2%
Happy 0.6%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 88.9%
Confused 9.8%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 48-56
Gender Female, 99.9%
Confused 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 54-62
Gender Female, 99.9%
Calm 96.4%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 1.6%
Angry 0.7%
Happy 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 61
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a couple of people posing for a photo 95.7%
a man and woman posing for a photo 93.5%
a man and a woman posing for a photo 93.4%

Text analysis

Google

oo
oo 0
0