Human Generated Data

Title

US Embassy Athens, Greece

Date

c. 1959

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.7

Human Generated Data

Title

US Embassy Athens, Greece

People

Artist: Unidentified Artist,

Date

c. 1959

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ise Gropius, BRGA.125.7

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Accessories 99.9
Accessory 99.9
Tie 99.9
Apparel 99.8
Clothing 99.8
Shoe 99.2
Footwear 99.2
Overcoat 98.1
Person 95.4
Human 95.4
Shoe 94.1
Shoe 90.9
Suit 89.1
Tuxedo 85.2
Person 83.8
Suit 80.7
Door 73.1
Sleeve 64.5
Pedestrian 63.6
Outdoors 61.1
Long Sleeve 58.7
Standing 55.4
Coat 51.4

Clarifai
created on 2019-05-31

people 99.8
adult 98
man 97.4
wear 95.6
one 94.4
street 93.7
administration 93.4
two 92.7
group together 92.2
military 91.6
war 89.1
portrait 89
group 87.9
outfit 86.8
three 86
leader 84.2
woman 84.2
veil 80.6
home 77.5
four 77.3

Imagga
created on 2019-05-31

crutch 51.8
staff 42
stick 31.1
street 27.6
city 24.1
people 24
adult 21.3
man 20.8
building 20.3
urban 20.1
pay-phone 18.8
attractive 18.2
person 18.2
telephone 17.5
male 17.1
business 16.4
fashion 15.8
architecture 15.6
portrait 14.9
outdoor 14.5
black 14.1
travel 14.1
call 14
old 13.9
women 13.4
pretty 13.3
standing 13
lady 12.2
wall 12
lifestyle 11.6
electronic equipment 11.6
outdoors 11.2
equipment 10.9
cute 10.8
happy 10.7
one 10.5
exterior 10.1
tourism 9.9
suit 9.8
sidewalk 9.8
style 9.6
sexy 9.6
bag 9.4
outside 9.4
smile 9.3
elegance 9.2
window 9.2
work 8.6
corporate 8.6
men 8.6
model 8.6
industry 8.5
fashionable 8.5
stone 8.4
modern 8.4
worker 8.3
20s 8.2
industrial 8.2
dress 8.1
clothing 7.7
walking 7.6
adults 7.6
tourist 7.5
human 7.5
holding 7.4
life 7.3
businesswoman 7.3
student 7.2
device 7.1
posing 7.1
happiness 7.1

Google
created on 2019-05-31

Microsoft
created on 2019-05-31

outdoor 99.8
suit 98.5
clothing 98.4
coat 95.4
man 95.2
person 92.2
black and white 87.9
standing 86.8
smile 75
footwear 73.3
old 43.2
clothes 16.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-90
Gender Male, 95.4%
Disgusted 1.1%
Sad 4.1%
Confused 1.9%
Happy 2.6%
Angry 4.9%
Surprised 1.2%
Calm 84.3%

AWS Rekognition

Age 49-69
Gender Male, 53.9%
Sad 45.3%
Confused 45.5%
Disgusted 45.6%
Surprised 45.2%
Angry 45.5%
Happy 45.1%
Calm 52.8%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.9%
Shoe 99.2%
Person 95.4%
Suit 89.1%
Coat 51.4%