Human Generated Data

Title

Russian Arms Dealers

Date

c. 2010

People

Artist: Manish Swarup, Indian born 1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Conley Harris and Howard Truelove Collection, 2016.125

Copyright

© Manish Swarup

Human Generated Data

Title

Russian Arms Dealers

People

Artist: Manish Swarup, Indian born 1968

Date

c. 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Clothing 98.8
Apparel 98.8
Overcoat 98.8
Coat 98.8
Human 97.4
Person 97.4
Person 97
Person 93.2
Person 91.5
Display 90.3
Screen 90.3
Monitor 90.3
Electronics 90.3
Tuxedo 87.4
Blazer 86.2
Jacket 86.2
Vehicle 77.7
Airplane 77.7
Transportation 77.7
Aircraft 77.7
Crowd 77.1
Suit 75.3
Tie 73
Accessory 73
Accessories 73
Indoors 73
Suit 72.4
Suit 69
Table 65.7
Furniture 65.7
Room 60.1
Chair 57.8
Desk 56.1
Flooring 55

Clarifai
created on 2018-02-19

business 97.1
room 96.8
meeting 95.7
adult 95.3
computer 94.4
furniture 93.8
technology 92.8
indoors 91.6
office 90.8
desk 90.7
league 90.6
people 90.2
education 89.1
leader 88
woman 87.3
chair 87.1
telephone 86.1
group 85.7
employee 84.7
man 84.3

Imagga
created on 2018-02-19

entrepreneur 68.4
businessman 60.1
executive 57.4
office 55.6
meeting 53.8
business 52.9
team 46.6
corporate 43.9
man 43.7
businesswoman 42.8
male 41.2
group 40.3
people 39.1
teamwork 38
professional 36.4
person 34.5
businesspeople 34.2
colleagues 32.1
table 32.1
communication 31.9
work 31.4
laptop 26.5
conference 26.4
suit 26.3
men 25.8
working 25.7
desk 24.6
discussion 24.4
job 23.9
talking 23.8
together 23.7
happy 22.6
computer 22.5
smiling 22.5
manager 22.4
presentation 22.4
workplace 21
worker 20.1
room 19.5
teacher 18.6
adult 18.6
success 18.5
modern 18.2
sitting 18.1
discussing 17.7
confident 17.3
successful 16.5
coworkers 15.7
businessmen 15.6
partners 15.6
women 15
associates 14.8
indoor 14.6
corporation 14.5
planning 14.5
smile 14.3
career 14.2
company 14
diverse 13.7
conversation 13.6
board 13.6
diversity 13.5
employee 13.3
indoors 13.2
mature 13
occupation 12.8
looking 12.8
seminar 12.8
busy 12.5
partnership 12.5
handsome 12.5
coffee 12.1
technology 11.9
portrait 11.7
speaker 11.6
partner 11.6
collar 11.5
staff 11.5
boss 11.5
director 11.4
education 11.3
cooperation 10.6
cheerful 10.6
hall 10.5
couple 10.5
standing 10.4
plan 10.4
student 10.4
training 10.2
two 10.2
finance 10.2
debate 9.9
colleague 9.8
ethnic 9.5
adults 9.5
pen 9.4
casual 9.3
document 9.3
life 9
explaining 8.9
interaction 8.9
paperwork 8.8
workers 8.7
jacket 8.7
30s 8.7
paper 8.6
gesture 8.6
classroom 8.5
building 8.5
attractive 8.4
color 8.4
interior 8
lifestyle 8
articulator 7.9
discuss 7.9
collaboration 7.9
30 35 years 7.9
happiness 7.8
40s 7.8
leader 7.7
leadership 7.7
formal 7.6
hand 7.6
horizontal 7.5
contemporary 7.5
center 7.5
notebook 7.5
educator 7.4
black 7.2

Google
created on 2018-02-19

Microsoft
created on 2018-02-19

wall 99.5
indoor 99.2
person 95.9
ceiling 86.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 98.8%
Disgusted 7.5%
Sad 2.6%
Surprised 15.1%
Angry 6.2%
Happy 5.7%
Calm 45.2%
Confused 17.7%

AWS Rekognition

Age 26-43
Gender Male, 85.7%
Confused 2.6%
Happy 4.9%
Sad 18.7%
Surprised 2.6%
Disgusted 25.6%
Angry 14.6%
Calm 31%

AWS Rekognition

Age 35-52
Gender Male, 90.1%
Calm 49.5%
Angry 6.1%
Confused 23.4%
Disgusted 4.7%
Surprised 8.9%
Happy 3.6%
Sad 3.7%

AWS Rekognition

Age 23-38
Gender Female, 57.8%
Happy 1.7%
Angry 12.7%
Disgusted 6.5%
Calm 39%
Sad 34.6%
Surprised 2.4%
Confused 3.1%

Microsoft Cognitive Services

Age 67
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Monitor 90.3%
Airplane 77.7%
Suit 75.3%
Tie 73%
Chair 57.8%

Captions

Microsoft

a group of people in a room 95.9%
a group of people standing in a room 95.2%
a group of people standing around a table 85.6%

Text analysis

Amazon

AK105
AK-104
AK-:102

Google

AK-102
A-105
AK-102 A-105