Human Generated Data

Title

US Embassy Athens, Greece

Date

c. 1961

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.3

Human Generated Data

Title

US Embassy Athens, Greece

People

Artist: Unidentified Artist,

Date

c. 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.3

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Apparel 99.3
Clothing 99.3
Overcoat 99.1
Coat 99.1
Person 95.3
Human 95.3
Person 93.4
Tuxedo 92.8
Person 92.5
Person 91.9
Suit 88.5
Suit 84.8
Attorney 83.6
Tie 81.4
Accessories 81.4
Accessory 81.4
Suit 81.3
Military Uniform 76.2
Officer 76.2
Military 76.2
Suit 75.4
Face 64
Jacket 62.1
Blazer 62.1
People 62.1
Bag 58.8

Clarifai
created on 2019-05-31

people 99.9
administration 98.7
group 98.6
leader 97.6
adult 97.5
group together 97.3
three 95.2
man 95
several 93.9
two 90.6
four 90.5
five 89.7
outfit 87
offense 86.9
military 86.6
wear 86.4
many 85.8
war 83.6
portrait 81.5
vehicle 80.1

Imagga
created on 2019-05-31

suit 84.8
man 47.7
business 43.7
businessman 43.3
male 41.2
clothing 38.9
garment 38.8
executive 33.2
professional 32.3
office 32.3
corporate 30.9
person 27.8
handsome 27.6
tie 27.5
people 27.3
adult 25.7
men 23.2
job 21.2
work 20.4
success 20.1
happy 20.1
confident 20
standing 20
covering 19.6
consumer goods 19.5
portrait 18.8
successful 18.3
smile 17.8
jacket 17.5
meeting 17
fashion 16.6
businesswoman 16.4
shirt 16
black 15.8
worker 15.7
team 15.2
manager 14.9
smiling 14.5
businessmen 13.7
attractive 13.3
businesspeople 13.3
career 13.3
company 13
group 12.9
face 12.1
looking 12
building 11.9
happiness 11.8
working 11.5
confidence 11.5
boss 11.5
formal 11.5
indoors 11.4
mature 11.2
teamwork 11.1
lifestyle 10.8
holding 10.7
baron 10.7
guy 10.7
elegant 10.3
expression 10.2
alone 10
hand 9.9
handshake 9.8
military uniform 9.8
entrepreneur 9.7
corporation 9.7
partnership 9.6
necktie 9.6
casual 9.3
human 9
leadership 8.6
profession 8.6
model 8.6
fashionable 8.5
senior 8.4
clothes 8.4
modern 8.4
color 8.3
occupation 8.3
20s 8.2
friendly 8.2
style 8.2
cheerful 8.1
home 8
couple 7.8
colleagues 7.8
partner 7.7
mid adult 7.7
outside 7.7
employee 7.6
serious 7.6
ethnic 7.6
finance 7.6
uniform 7.5
life 7.5
one 7.5
indoor 7.3
director 7.1
family 7.1
women 7.1
look 7
bow tie 7

Google
created on 2019-05-31

Microsoft
created on 2019-05-31

person 100
clothing 98.4
standing 94.1
man 90.8
smile 90
suit 89.8
old 89.2
tie 82.5
black 77.5
posing 77.1
human face 71.3
white 66.8
people 64.8
gentleman 62.6
formal wear 52.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 94%
Confused 29.6%
Happy 17.6%
Surprised 17.7%
Angry 11.7%
Disgusted 5%
Calm 15.2%
Sad 3.2%

AWS Rekognition

Age 30-47
Gender Male, 69.1%
Sad 13.1%
Angry 3.1%
Calm 69%
Confused 3%
Disgusted 2.3%
Happy 7.6%
Surprised 1.9%

AWS Rekognition

Age 23-38
Gender Female, 69.9%
Happy 7.7%
Disgusted 5.4%
Sad 36%
Surprised 3.7%
Angry 5.3%
Calm 38.6%
Confused 3.3%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Disgusted 45.1%
Sad 45.2%
Happy 45.2%
Surprised 45.7%
Angry 45.1%
Calm 53.5%
Confused 45.2%

AWS Rekognition

Age 45-66
Gender Female, 50.7%
Confused 46.5%
Surprised 45.9%
Angry 45.5%
Calm 45.6%
Disgusted 45.4%
Sad 50.7%
Happy 45.3%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%
Suit 88.5%
Tie 81.4%

Categories