Human Generated Data

Title

Untitled (family of four seated in living room around armchair, two boys in matching sailor shirts)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12978

Human Generated Data

Title

Untitled (family of four seated in living room around armchair, two boys in matching sailor shirts)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12978

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.3
Human 99.3
Person 99
Apparel 99
Clothing 99
Person 96.6
Footwear 94.6
Shoe 94.6
Person 94.1
People 93.5
Sitting 85.8
Furniture 80.5
Family 74
Shoe 72.8
Tie 72.7
Accessories 72.7
Accessory 72.7
Flooring 71.9
Shoe 61.9
Shoe 56.5
Shoe 51.6

Clarifai
created on 2019-11-16

people 99.7
group 98.3
adult 97.8
woman 97.4
man 96.2
group together 95.5
facial expression 93.2
sit 91.8
actor 89.9
wear 87.8
indoors 87.7
room 87.7
leader 87.6
furniture 87.4
chair 87
four 85.3
family 83.7
portrait 83.6
administration 83.5
two 83.1

Imagga
created on 2019-11-16

man 37
business 35.2
businessman 33.6
people 31.2
adult 30.6
office 30.1
businesswoman 28.2
person 28
male 27.9
corporate 27.5
kin 26
women 25.3
executive 25.3
work 24.3
men 24
happy 23.2
job 23
professional 22.8
salon 22.5
team 22.4
laptop 22
meeting 21.7
worker 21.2
communication 20.2
suit 19.8
smile 18.5
couple 18.3
attractive 18.2
smiling 18.1
lifestyle 18.1
sitting 18
success 17.7
teamwork 17.6
portrait 17.5
businesspeople 17.1
computer 16.9
working 16.8
indoors 16.7
chair 16.4
manager 15.8
together 15.8
indoor 15.5
confident 15.5
looking 15.2
room 14.8
group 14.5
home 14.4
pretty 14
handsome 13.4
modern 12.6
talking 12.4
happiness 11.8
career 11.4
table 11.3
successful 11
cheerful 10.6
lady 10.5
sexy 10.4
desk 10.4
company 10.2
employee 9.8
interior 9.7
technology 9.7
partnership 9.6
sofa 9.6
boss 9.6
two 9.3
hairdresser 9.2
window 9.2
holding 9.1
style 8.9
black 8.8
partner 8.7
elegant 8.6
face 8.5
casual 8.5
building 8.4
house 8.4
training 8.3
fashion 8.3
20s 8.2
notebook 7.9
love 7.9
model 7.8
colleagues 7.8
shop 7.7
couch 7.7
corporation 7.7
expression 7.7
formal 7.6
adults 7.6
life 7.3

Google
created on 2019-11-16

Photograph 97.1
People 95
Snapshot 88.6
Photography 72.5
Family 72.3
Black-and-white 68.3
Vintage clothing 64.7
Monochrome 64.3
Sitting 60.2
Child 57.3
Classic 56.7
Father 54

Microsoft
created on 2019-11-16

person 99.6
clothing 97.3
window 91.6
smile 88.5
footwear 86.6
man 81.7
text 79.2
suit 77.8
human face 75
group 65.5
people 63.4
furniture 57.4
black and white 55.3
posing 51

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 79.1%
Disgusted 0.3%
Sad 0.1%
Confused 0.7%
Happy 96.3%
Fear 0.2%
Surprised 0.4%
Calm 1.4%
Angry 0.6%

AWS Rekognition

Age 2-8
Gender Male, 68.7%
Confused 0.7%
Surprised 0.7%
Sad 4.6%
Disgusted 0.5%
Calm 1.4%
Fear 1.4%
Angry 10.5%
Happy 80.3%

AWS Rekognition

Age 26-40
Gender Male, 91.1%
Fear 1.1%
Surprised 0.5%
Angry 12.2%
Sad 74.5%
Disgusted 3%
Happy 0.3%
Calm 5%
Confused 3.4%

AWS Rekognition

Age 24-38
Gender Female, 99.6%
Confused 0.2%
Fear 0%
Calm 98.1%
Happy 0.2%
Sad 0.9%
Angry 0.2%
Surprised 0%
Disgusted 0.1%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 94.6%
Tie 72.7%

Categories

Imagga

people portraits 99.5%