Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

Date

2010

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2010.583

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 99.6
Person 99.6
Person 99.2
Face 98.8
Person 98.5
Person 98.2
Dating 87.3
People 86.2
Man 79.4
Apparel 77.4
Clothing 77.4
Photography 70.9
Portrait 70.9
Photo 70.9
Head 59.9
Person 59.7
Female 59
Hair 55.8

Clarifai
created on 2018-03-23

people 99.7
group 98.8
man 98.5
portrait 98.4
group together 97.8
three 97
four 96.8
adult 96.5
facial expression 92.5
music 89.7
five 88.9
actress 88.6
musician 87.9
several 85.5
two 85.5
woman 84.9
monochrome 82.5
actor 81.3
administration 79.8
facial hair 77.6

Imagga
created on 2018-03-23

man 55.1
male 46.8
businessman 36.2
suit 33.9
portrait 33
person 32.7
people 29.6
business 29.1
happy 28.2
adult 27.8
handsome 26.7
couple 25.3
senior 24.4
grandma 24.3
smiling 23.9
corporate 23.2
office 22.5
executive 22.4
men 22.3
tie 20.9
smile 19.9
professional 17.8
mature 17.7
standing 17.4
love 17.4
looking 16.8
work 16.5
elderly 16.3
worker 16.1
old 16
black 15.2
husband 15.1
attractive 14.7
grandfather 14.5
expression 14.5
face 14.2
job 14.2
guy 14.1
together 14
success 13.7
confident 13.6
jacket 13.6
married 13.4
shirt 13.1
two 12.7
hair 12.7
glasses 12
friendly 11.9
happiness 11.8
team 11.6
family 11.6
group 11.3
hat 11.3
brother 11.1
hand 10.6
cheerful 10.6
one 10.4
beard 10.4
relationship 10.3
casual 10.2
businesswoman 10
pose 10
lady 9.7
partners 9.7
partnership 9.6
formal 9.5
businesspeople 9.5
wife 9.5
meeting 9.4
manager 9.3
necktie 9.3
head 9.2
modern 9.1
fun 9
businessmen 8.8
boss 8.6
smart 8.5
teamwork 8.3
holding 8.3
successful 8.2
bow tie 8.1
romance 8
lifestyle 7.9
employee 7.9
look 7.9
retired 7.8
affection 7.7
mother 7.7
human 7.5
father 7.3
sibling 7.1
women 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.6
outdoor 92.4
standing 90.9
posing 90.2
suit 40
crowd 0.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 91.4%
Sad 24.4%
Angry 3.9%
Calm 62.4%
Surprised 0.7%
Disgusted 1.9%
Happy 4.9%
Confused 1.7%

AWS Rekognition

Age 57-77
Gender Female, 67.5%
Confused 10.2%
Calm 41%
Disgusted 8.6%
Angry 4.8%
Happy 18.6%
Sad 12.5%
Surprised 4.3%

AWS Rekognition

Age 38-59
Gender Female, 51.1%
Calm 54.8%
Sad 13.8%
Happy 3.6%
Disgusted 2.2%
Angry 4.1%
Surprised 2.1%
Confused 19.4%

AWS Rekognition

Age 35-52
Gender Male, 83.9%
Calm 7.2%
Happy 88%
Surprised 0.5%
Sad 1.4%
Disgusted 0.7%
Angry 0.8%
Confused 1.4%

Microsoft Cognitive Services

Age 60
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 98.1%
a group of people posing for the camera 98%
a man and woman posing for a photo 95.1%