Human Generated Data

Title

Untitled (two photographs: studio portrait of older man in suit; studio portrait of family of eleven in front of painted backdrop)

Date

1934

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6113

Human Generated Data

Title

Untitled (two photographs: studio portrait of older man in suit; studio portrait of family of eleven in front of painted backdrop)

People

Artist: Durette Studio, American 20th century

Date

1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Interior Design 100
Indoors 100
Person 97.6
Human 97.6
Room 89
Theater 79.8
Electronics 78.8
Screen 78.8
Display 75.7
Monitor 75.7
LCD Screen 71.7
Leisure Activities 71.6
Coat 60.6
Apparel 60.6
Overcoat 60.6
Clothing 60.6
Cinema 58
Suit 56.5

Clarifai
created on 2019-11-16

people 99.9
adult 97.7
portrait 97.6
man 97.2
one 94.6
leader 94.1
actor 92
group 89.8
wear 89.4
two 88.6
administration 87.3
woman 86.3
music 86
facial expression 85.6
monochrome 85.5
outfit 84.1
movie 83.7
chair 82
television 81.8
sit 76.4

Imagga
created on 2019-11-16

television 47
computer 43.8
business 43.1
businessman 42.4
laptop 39.3
office 36.4
man 34.9
male 30.5
desk 29.3
executive 29.2
person 29.1
telecommunication system 29
professional 26.5
work 25.1
corporate 24.9
working 24.7
suit 24
people 23.4
adult 23.1
happy 22.6
looking 20.8
blackboard 20.1
success 20.1
portrait 19.4
monitor 19
smiling 18.8
manager 18.6
sitting 18
handsome 17.8
modern 16.8
friendly 16.5
smile 16.4
businesswoman 16.4
technology 16.3
notebook 16.3
job 15.9
tie 15.2
worker 15.2
black 15.2
screen 15
background 14.6
standing 13.9
alone 13.7
indoor 13.7
career 13.3
cheerful 13
men 12.9
confident 12.7
casual 12.7
one 12.7
employee 12.5
leadership 12.5
businesspeople 12.3
face 12.1
expression 11.9
leader 11.6
attractive 11.2
display 11
communication 10.9
personal computer 10.6
indoors 10.5
boss 10.5
education 10.4
support 10.4
keyboard 10.3
call 10.3
help 10.2
youth 10.2
telephone 10
corporation 9.6
using 9.6
hands 9.6
serious 9.5
teacher 9.5
successful 9.2
student 9.1
human 9
advice 8.8
assistant 8.7
formal 8.6
workplace 8.6
broadcasting 8.6
desktop computer 8.4
hand 8.4
positive 8.3
occupation 8.2
school 8.1
home 8
lifestyle 8
center 7.9
receptionist 7.9
chalkboard 7.8
happiness 7.8
gesture 7.6
digital computer 7.6
thinking 7.6
meeting 7.5
writing 7.5
company 7.4
holding 7.4
camera 7.4
telecommunication 7.4
color 7.2
electronic equipment 7.2
bright 7.1
jacket 7.1
classroom 7
look 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 99.6
clothing 94.8
person 94.7
human face 93.1
old 92.5
man 91.6
monitor 90.6
black 90.3
indoor 88.7
black and white 79
white 68.3
posing 55.3
suit 52.1
older 24.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 46-64
Gender Male, 99.2%
Fear 1.2%
Surprised 2.1%
Angry 12.4%
Sad 1.9%
Disgusted 10.8%
Happy 9.3%
Calm 51.4%
Confused 11%

AWS Rekognition

Age 41-59
Gender Male, 54.9%
Happy 46.7%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45%
Angry 45%
Calm 53.2%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Male, 51.9%
Disgusted 48%
Happy 45.3%
Fear 45.4%
Confused 45.2%
Surprised 45.1%
Calm 48.9%
Angry 45.8%
Sad 46.4%

AWS Rekognition

Age 31-47
Gender Male, 54.8%
Angry 45.6%
Happy 45.7%
Calm 52.1%
Confused 45.1%
Disgusted 45.5%
Fear 45.2%
Sad 45.7%
Surprised 45.1%

AWS Rekognition

Age 51-69
Gender Male, 53.8%
Angry 45.2%
Happy 45.1%
Disgusted 45%
Confused 45.1%
Surprised 45%
Calm 53%
Fear 45%
Sad 46.5%

AWS Rekognition

Age 22-34
Gender Male, 54.5%
Surprised 45%
Fear 45.1%
Happy 45%
Sad 53.4%
Calm 45.8%
Disgusted 45.2%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 8-18
Gender Female, 54.8%
Calm 46.9%
Confused 45.2%
Happy 50.2%
Surprised 45.1%
Sad 46.4%
Fear 45.1%
Angry 45.4%
Disgusted 45.6%

AWS Rekognition

Age 16-28
Gender Female, 54.6%
Angry 45.1%
Confused 45.1%
Disgusted 45%
Happy 45%
Sad 46%
Fear 45%
Calm 53.7%
Surprised 45%

AWS Rekognition

Age 13-25
Gender Female, 54.5%
Confused 45%
Surprised 45%
Happy 45%
Sad 54.9%
Disgusted 45%
Angry 45%
Calm 45%
Fear 45%

AWS Rekognition

Age 22-34
Gender Male, 54.8%
Fear 45%
Calm 45%
Disgusted 45%
Happy 54.8%
Sad 45%
Confused 45%
Surprised 45%
Angry 45%

AWS Rekognition

Age 13-25
Gender Male, 54.3%
Surprised 45%
Disgusted 45.1%
Happy 50.9%
Sad 48%
Calm 45.6%
Confused 45.1%
Fear 45.1%
Angry 45.2%

AWS Rekognition

Age 17-29
Gender Female, 54.9%
Fear 45.1%
Calm 45.8%
Angry 45%
Disgusted 45%
Confused 45.1%
Surprised 45%
Sad 45.4%
Happy 53.6%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Captions

Microsoft

a black and white photo of a person 90%
an old black and white photo of a person 89%
a person sitting in front of a television 72.3%

Text analysis

Amazon

KR 3THATNA

Google

ARA
K3 31ART ARA
31ART
K3