Human Generated Data

Title

US Embassy Athens, Greece
Date

c. 1961
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.5

Human Generated Data

Title

US Embassy Athens, Greece

People

Artist: Unidentified Artist,

Date

c. 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.5

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Apparel 99.7
Clothing 99.7
Overcoat 99.7
Coat 99.7
Suit 99.7
Accessories 99.4
Accessory 99.4
Tie 99.4
Person 99.2
Human 99.2
Suit 98.5
Person 98.3
Tuxedo 94
Blazer 93.8
Jacket 93.8
Glasses 84.3
Tie 68
Fashion 58.5

Clarifai
created on 2019-05-31

people 99.8
administration 98.3
group 97.7
adult 97.3
man 97.1
three 97
portrait 96.7
two 96.6
leader 95.8
facial expression 91.4
group together 90.5
outfit 86.6
wear 86.3
four 84
music 83.2
movie 82.9
actor 81.7
several 78.6
politician 78
chair 77.4

Imagga
created on 2019-05-31

businessman 58.3
man 50.5
business 46.8
male 43.3
executive 42.3
office 40.4
suit 39.4
corporate 38.7
people 34.6
men 33.5
person 33.4
team 33.2
baron 31.4
teamwork 30.6
happy 30.1
businesswoman 30
businesspeople 29.5
professional 28.6
meeting 28.3
bow tie 26
group 25.8
businessmen 25.4
portrait 25.3
smiling 24.6
adult 24.6
confident 23.7
necktie 23.7
work 22.8
manager 21.4
handsome 21.4
smile 20.7
colleagues 20.4
partnership 20.2
success 20.1
entrepreneur 19.9
company 18.6
successful 18.3
standing 18.3
worker 18
partner 17.4
boss 17.2
tie 17.1
grandma 17
senior 16.9
job 16.8
working 16.8
staff 16.4
formal 16.3
expression 16.2
desk 16.1
scholar 15.6
corporation 15.5
looking 15.2
communication 15.1
together 14.9
secretary 14.8
partners 14.6
mature 14
couple 14
face 13.5
intellectual 13.4
workplace 13.4
garment 13.3
computer 12.8
30s 12.5
diversity 12.5
leadership 12.5
building 11.9
colleague 11.7
jacket 11.6
shirt 11.2
friendly 11
employee 10.9
coworkers 10.8
40s 10.7
groom 10.7
discussion 10.7
busy 10.6
confidence 10.5
attractive 10.5
smart 10.4
sitting 10.3
old 9.8
businessperson 9.8
talking 9.5
women 9.5
career 9.5
glasses 9.3
modern 9.1
laptop 9.1
grandfather 9
cheerful 9
discussing 8.8
supporter 8.8
indoors 8.8
workers 8.7
happiness 8.6
elderly 8.6
adults 8.5
black 8.4
look 7.9
associates 7.9
businesswomen 7.9
diverse 7.8
conference 7.8
hands 7.8
table 7.8
agreement 7.8
clothing 7.8
project 7.7
two 7.6
hand 7.6
head 7.6
holding 7.4
indoor 7.3
aged 7.2

Google
created on 2019-05-31

Photograph 96.8
Snapshot 85.4
Black-and-white 80.7
Monochrome 67.6
History 66.1
Monochrome photography 64.7
Photography 62.4
Gentleman 61.7
Glasses 56.1
Family 53.1

Microsoft
created on 2019-05-31

person 99.9
man 99.9
wall 99.2
human face 98.6
suit 95.9
smile 94.8
clothing 94.8
glasses 90.1
indoor 89.8
standing 88.7
posing 88.3
tie 87
black and white 82.4
necktie 78.1
old 69.5
older 27.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-80
Gender Male, 98.7%
Confused 5.5%
Angry 4.5%
Sad 3.2%
Calm 80.8%
Disgusted 1.3%
Happy 1.7%
Surprised 3.1%

AWS Rekognition

Age 60-90
Gender Male, 98.1%
Calm 21.5%
Surprised 12.1%
Sad 4.2%
Confused 20.2%
Disgusted 8.6%
Happy 26.2%
Angry 7.3%

AWS Rekognition

Age 35-52
Gender Female, 99.4%
Disgusted 0.6%
Sad 66.7%
Confused 4.7%
Happy 1%
Angry 4.2%
Surprised 1.6%
Calm 21.2%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Suit 99.7%
Tie 99.4%
Person 99.2%
Glasses 84.3%

Categories

Imagga

people portraits 88.4%
paintings art 11%

Text analysis

Amazon

N