Human Generated Data

Title

Untitled (man standing at microphone in front of band)

Date

1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4195

Human Generated Data

Title

Untitled (man standing at microphone in front of band)

People

Artist: Durette Studio, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.9
Person 98.9
Person 98.3
Person 97.3
Person 96.9
Sitting 91.1
Apparel 74.7
Clothing 74.7
Flooring 64
Furniture 60.2
Table 60
Restaurant 60
Cafeteria 59.5
Screen 56.6
Electronics 56.6
Chair 55.6

Clarifai
created on 2019-06-01

people 99.9
group 99.1
group together 97.8
desk 97.7
man 97.4
adult 97.3
woman 95.9
leader 93.4
education 93.3
league 93.2
room 92.8
meeting 92.3
classroom 90.6
furniture 90.2
chair 88.9
administration 88.2
teacher 84.8
three 81.8
speaker 81.6
television 80.4

Imagga
created on 2019-06-01

man 40.4
male 34.8
people 34.6
business 34
businessman 32.7
office 32.6
person 32.4
table 30.7
group 30.6
room 29.4
meeting 29.2
adult 29.1
women 27.7
teacher 26.9
professional 26.4
musical instrument 25.3
classroom 24.3
executive 24.1
sitting 24.1
smiling 23.9
work 22.8
businesswoman 22.7
men 22.3
team 21.5
corporate 21.5
businesspeople 20.9
desk 20.3
indoors 20.2
communication 20.2
teamwork 19.5
couple 18.3
laptop 18.2
happy 18.2
manager 16.8
worker 16.6
computer 16
job 15.9
together 15.8
smile 15.7
wind instrument 15.6
colleagues 15.5
confident 15.5
cheerful 15.4
brass 15.4
suit 15.3
talking 15.2
education 14.7
conference 14.7
indoor 14.6
lifestyle 13.7
successful 13.7
modern 13.3
happiness 13.3
holding 13.2
cornet 13.1
percussion instrument 13
chair 12.3
student 12.1
presentation 12.1
two 11.9
educator 11.8
interior 11.5
working 11.5
togetherness 11.3
looking 11.2
mature 11.2
coffee 11.1
portrait 11
board 10.9
drinking 10.5
boss 10.5
employee 10.5
workplace 10.5
success 10.5
learning 10.3
entrepreneur 10.2
training 10.2
class 9.6
speaker 9.5
color 9.5
stringed instrument 9.4
director 9.3
handsome 8.9
technology 8.9
to 8.9
leisure activity 8.8
colleague 8.8
home 8.8
two people 8.8
leader 8.7
marimba 8.7
collar 8.6
adults 8.5
enjoyment 8.4
study 8.4
blackboard 8.4
phone 8.3
hall 8.2
restaurant 8.1
new 8.1
explaining 7.9
chatting 7.9
diverse 7.8
standing 7.8
casual clothing 7.8
students 7.8
teaching 7.8
discussion 7.8
partners 7.8
content 7.7
cooperation 7.7
diversity 7.7
finance 7.6
plan 7.6
friends 7.5
senior 7.5
school 7.3

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

table 93.4
person 90.8
furniture 90.4
clothing 80.4
man 77.4
computer 53.3

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 50.7%
Confused 45.3%
Surprised 45.2%
Angry 45.3%
Calm 51.7%
Disgusted 45.2%
Sad 45.5%
Happy 46.7%

AWS Rekognition

Age 35-52
Gender Male, 97.8%
Confused 9.5%
Sad 13.8%
Calm 12%
Happy 10.2%
Surprised 9.2%
Disgusted 3.6%
Angry 41.7%

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 67.4%
a group of people in front of a mirror posing for the camera 67.3%
a group of people sitting at a desk in front of a mirror 67.2%

Text analysis

Amazon

D