Human Generated Data

Title

Untitled (family portrait with three children and parents sitting in front of painted backdrop)
Date

1931
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4248

Human Generated Data

Title

Untitled (family portrait with three children and parents sitting in front of painted backdrop)

People

Artist: Durette Studio, American 20th century

Date

1931

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 98.6
Human 98.6
Person 98.2
Person 98.1
Clothing 96.9
Apparel 96.9
Person 96.9
Person 96.6
People 94.8
Person 94.3
Family 84.9
Face 80.9
Female 75.1
Photography 72.3
Photo 72.3
Portrait 71.8
Girl 64.1
Coat 62.5
Footwear 61.5
Shoe 61.5
Suit 56.3
Overcoat 56.3
Worker 55.9
Hairdresser 55.6
Shoe 54

Clarifai
created on 2019-06-01

people 99.7
adult 98
man 96.8
group 96.3
woman 96.1
group together 94.8
wear 91.9
portrait 89.4
monochrome 85.6
child 83.8
two 83.6
music 81.8
four 81.8
facial expression 81.6
leader 81.4
musician 81.2
several 81
three 80.7
administration 79.4
outfit 78.9

Imagga
created on 2019-06-01

nurse 40.6
person 38.9
people 37.4
man 35.6
happy 32.6
male 32.1
adult 31.4
professional 29.8
hospital 26.5
office 25.7
business 24.9
portrait 24.6
doctor 24.4
job 23.9
patient 23
smile 22.8
smiling 22.4
businessman 22.1
medical 22.1
happiness 21.2
businesswoman 20.9
businesspeople 20.9
corporate 20.6
clinic 19.6
lab coat 19.5
coat 19.4
30s 19.2
attractive 18.9
team 18.8
health 18.8
occupation 18.3
women 18.2
lifestyle 18.1
looking 16.8
working 16.8
home 16.8
clothing 16.7
confident 16.4
men 16.3
indoors 15.8
camera 15.7
work 15.7
couple 15.7
face 15.6
colleagues 15.5
mother 15.2
worker 15
pretty 14.7
cheerful 14.6
group 14.5
casual 14.4
room 14.3
medicine 14.1
stethoscope 13.8
20s 13.7
family 13.4
day 13.3
career 13.3
mature 13
talking 12.4
practitioner 12.3
teamwork 12.1
successful 11.9
indoor 11.9
kin 11.8
case 11.6
care 11.5
elderly 11.5
building 11.4
meeting 11.3
standing 11.3
two 11
suit 11
employee 10.9
executive 10.5
love 10.3
sick person 10.1
color 10
clinical 9.8
lady 9.7
success 9.7
mid adult 9.7
uniform 9.6
brunette 9.6
daughter 9.5
staff 9.4
senior 9.4
company 9.3
bright 9.3
fashion 9.1
associates 8.9
coworkers 8.8
good mood 8.8
consultant 8.8
together 8.8
40s 8.8
partnership 8.6
four 8.6
formal 8.6
modern 8.4
communication 8.4
manager 8.4
holding 8.3
jacket 8.2
style 8.2
handsome 8
look 7.9
garment 7.9
doctors 7.9
30 35 years 7.9
discussing 7.9
forties 7.8
black 7.8
physician 7.8
businessperson 7.8
discussion 7.8
thirties 7.8
examination 7.8
partner 7.7
laboratory 7.7
expression 7.7
life 7.7
confidence 7.7
boss 7.7
ethnic 7.6
walking 7.6
desk 7.6
horizontal 7.5
human 7.5
one 7.5
alone 7.3
aged 7.2
waiter 7.2
interior 7.1

Google
created on 2019-06-01

Photograph 97.6
People 96
Snapshot 90.3
Standing 82.8
Photography 75.7
Black-and-white 74.4
Stock photography 74.1
Family 70.5
Gentleman 63.5
Vintage clothing 62.5
Monochrome 54.4

Microsoft
created on 2019-06-01

clothing 98.2
smile 97.5
human face 97.2
person 96.9
posing 94.6
man 74.7
baby 64.5
group 63

Face analysis

Amazon

AWS Rekognition

Age 26-44
Gender Male, 51.2%
Confused 3.7%
Surprised 5.9%
Sad 3.3%
Angry 3.6%
Happy 72.9%
Calm 5.6%
Disgusted 5%

AWS Rekognition

Age 26-43
Gender Female, 50.8%
Happy 45.1%
Calm 51.3%
Angry 45.4%
Confused 45.3%
Surprised 45.2%
Sad 47.7%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 53.9%
Angry 3%
Disgusted 1.4%
Confused 1.6%
Calm 4.7%
Sad 25.7%
Surprised 3%
Happy 60.7%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 48.3%
Angry 45.7%
Happy 46.4%
Confused 45.4%
Calm 48%
Surprised 45.8%
Disgusted 45.4%

AWS Rekognition

Age 26-43
Gender Male, 62.4%
Disgusted 1.3%
Sad 43.8%
Happy 1.6%
Confused 7.2%
Surprised 3.5%
Angry 4.5%
Calm 38.1%

Feature analysis

Amazon

Person 98.6%
Shoe 61.5%

Captions

Microsoft

a group of people posing for a photo 98.1%
a group of people posing for the camera 98%
a group of people posing for a picture 97.9%