Human Generated Data

Title

US Embassy Athens, Greece
Date

c. 1961
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.2

Human Generated Data

Title

US Embassy Athens, Greece

People

Artist: Unidentified Artist,

Date

c. 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.2

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Apparel 99
Shoe 99
Clothing 99
Footwear 99
Shoe 97.8
Overcoat 95.2
Suit 95.2
Human 94.7
Person 94.7
Accessories 94.4
Tie 94.4
Accessory 94.4
Person 93.8
Person 93.6
Shoe 93.3
Shoe 92.6
Shoe 91.9
Shoe 91.1
Person 90.8
Tie 82.5
Suit 79.3
Suit 78.9
Coat 78.1
Crowd 77.4
People 65.6
Performer 63
Home Decor 62.4
Shoe 56.1
Suit 51.9

Clarifai
created on 2019-05-31

people 100
group 98.9
adult 97.7
man 96.7
group together 96.2
administration 95.8
three 94.2
leader 93.2
wear 92.7
two 92.6
several 89.8
woman 87.4
outfit 86.9
four 86.3
actor 83.3
five 81.9
portrait 81.6
music 77.4
menswear 76.7
many 76.3

Imagga
created on 2019-05-31

suit 61
businessman 46.8
man 46.4
male 39.7
garment 38.9
business 38.3
clothing 38
bow tie 36.5
professional 35
necktie 30.7
office 28.9
executive 27.6
adult 27.3
person 26.8
corporate 26.6
portrait 25.9
handsome 25.8
people 25.1
groom 24.5
happy 24.4
tie 23.7
success 22.5
uniform 21.1
standing 20.9
attractive 20.3
successful 20.1
military uniform 20.1
confident 20
meeting 19.8
job 18.6
covering 18.5
consumer goods 18.1
work 18
team 17.9
building 17.4
smile 17.1
looking 16.8
manager 16.8
businesswoman 16.4
smiling 15.9
teamwork 15.8
men 15.5
group 13.7
businesspeople 13.3
face 12.8
worker 12.7
partnership 12.5
boss 12.4
career 12.3
black 12.1
happiness 11.7
lifestyle 11.6
jacket 11.4
cheerful 11.4
fashion 11.3
style 11.1
occupation 11
holding 10.7
colleagues 10.7
workplace 10.5
talking 10.4
guy 10.4
coat 10.3
elegant 10.3
expression 10.2
company 10.2
phone 10.1
modern 9.8
old 9.8
working 9.7
corporation 9.6
confidence 9.6
couple 8.7
shirt 8.4
communication 8.4
mature 8.4
love 7.9
together 7.9
model 7.8
partners 7.8
partner 7.7
pretty 7.7
casual 7.6
hand 7.6
call 7.4
day 7.1

Google
created on 2019-05-31

Photograph 96.3
Snapshot 86.7
Gentleman 86.6
Photography 62.4
Vintage clothing 61.7
Family 57.3
Suit 56.8
Black-and-white 56.4

Microsoft
created on 2019-05-31

person 100
clothing 97.8
posing 97.8
standing 97.2
man 94.4
black 86.5
smile 83.4
old 80
group 74.3
black and white 66.6
people 66.5
suit 66.3
white 65.7
gentleman 59.2
tie 52.3
clothes 32.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Angry 45.3%
Confused 45.4%
Surprised 45.4%
Happy 45.3%
Sad 45.9%
Calm 52.2%
Disgusted 45.5%

AWS Rekognition

Age 48-68
Gender Male, 99.4%
Surprised 14.6%
Sad 12.5%
Happy 1.7%
Angry 41.8%
Disgusted 1.8%
Confused 16.9%
Calm 10.7%

AWS Rekognition

Age 26-43
Gender Male, 90%
Happy 1.1%
Confused 0.7%
Angry 2.1%
Disgusted 0.4%
Surprised 0.5%
Sad 2.2%
Calm 92.9%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Disgusted 54.4%
Calm 45.4%
Angry 45%
Sad 45%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Angry 45.2%
Happy 45.6%
Sad 49.3%
Disgusted 45.2%
Confused 45.1%
Calm 49.4%
Surprised 45.2%

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99%
Suit 95.2%
Person 94.7%
Tie 94.4%
Coat 78.1%