Human Generated Data

Title

At the White House to Urge Extension of the NRA, left to right: William Green (1873-1952), Secretary of Labor Frances Perkins (1880-1965), and John Llewellyn Lewis (1880-1969) of the UMW
Date

1935
People

Artist: Associated Press, American Created 1846
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.43

Human Generated Data

Title

At the White House to Urge Extension of the NRA, left to right: William Green (1873-1952), Secretary of Labor Frances Perkins (1880-1965), and John Llewellyn Lewis (1880-1969) of the UMW

People

Artist: Associated Press, American Created 1846

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.43

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Clothing 99.9
Apparel 99.9
Overcoat 99.6
Tuxedo 96.4
Person 93.4
Human 93.4
Suit 93.4
Suit 93.1
Footwear 90.4
Shoe 90.4
Person 89.1
Person 85.2
Jacket 80
Blazer 80
Sleeve 63.8
Tie 63.1
Accessory 63.1
Accessories 63.1
People 61
Suit 58.5
Shoe 57.4
Coat 54.3

Clarifai
created on 2018-03-23

people 99.9
administration 99.1
leader 98.8
group 98.8
group together 98.1
adult 97.6
man 93.9
chair 93.5
three 93.3
four 92.2
several 92.2
wear 92
five 91.6
two 91.4
outfit 87.3
woman 85.2
portrait 84.2
home 83
offense 80.9
many 77.9

Imagga
created on 2018-03-23

suit 57.9
businessman 53
business 47.4
man 47
male 44.1
professional 39.5
corporate 38.7
office 36.4
person 35.1
executive 31.7
adult 30
people 29.6
handsome 29.4
building 27.1
job 25.6
standing 25.2
success 23.3
businesswoman 22.7
clothing 22.7
men 22.3
confident 21.8
portrait 20.7
happy 20.7
team 20.6
confidence 20.1
businesspeople 19.9
manager 19.5
formal 19.1
career 18.9
attractive 18.9
meeting 18.8
teamwork 18.5
looking 18.4
work 18
company 17.7
modern 17.5
successful 17.4
garment 16.6
businessmen 16.6
smile 16.4
tie 16.1
group 16.1
lifestyle 15.9
occupation 15.6
black 15.3
jacket 14.6
expression 14.5
smiling 14.5
partnership 14.4
casual 13.6
communication 13.4
worker 13.3
employee 12.8
alone 12.8
employment 12.6
boss 12.4
indoors 12.3
phone 12
guy 12
indoor 11.9
planner 11.7
corporation 11.6
face 11.4
fashion 11.3
shirt 11.2
20s 11
mid adult 10.6
30s 10.6
stand 10.4
outside 10.3
color 10
holding 9.9
diverse 9.8
cheerful 9.8
human 9.7
businessperson 9.7
consultant 9.7
colleagues 9.7
outdoors 9.7
1 9.6
style 9.6
urban 9.6
diversity 9.6
workplace 9.5
life 9.5
talking 9.5
room 9.4
day 9.4
happiness 9.4
mature 9.3
covering 9.2
inside 9.2
outdoor 9.2
consumer goods 9.1
one 9
working 8.8
good looking 8.8
couple 8.7
women 8.7
partner 8.7
leadership 8.6
bright 8.6
necktie 8.6
elegant 8.6
model 8.6
staff 8.1
call 8.1
nurse 7.7
pretty 7.7
only 7.6
serious 7.6
friendly 7.3

Google
created on 2018-03-23

photograph 96.2
suit 92.3
standing 89.9
gentleman 85.3
black and white 83.9
vintage clothing 82.7
snapshot 81.8
formal wear 74.9
family 68.8
monochrome photography 64.4
house 60.3
tuxedo 55.6
monochrome 52.4

Microsoft
created on 2018-03-23

person 100
standing 99.3
outdoor 98.7
suit 98
man 97.3
posing 93.2
dressed 60.6
old 57
clothes 29.2
necktie 18.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Female, 99%
Disgusted 61.4%
Calm 28%
Surprised 2.5%
Angry 3.8%
Happy 2.7%
Confused 0.9%
Sad 0.7%

AWS Rekognition

Age 57-77
Gender Male, 98.3%
Angry 3.6%
Happy 3.3%
Calm 71.7%
Surprised 4.9%
Sad 3.6%
Disgusted 2.7%
Confused 10.2%

AWS Rekognition

Age 45-63
Gender Male, 96.6%
Confused 2.6%
Sad 3.4%
Calm 1.7%
Disgusted 2.4%
Angry 87.6%
Happy 0.9%
Surprised 1.4%

Microsoft Cognitive Services

Age 62
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 64
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.4%
Suit 93.4%
Shoe 90.4%
Tie 63.1%
Coat 54.3%

Categories

Imagga

people portraits 99.6%
events parties 0.2%
streetview architecture 0.1%
paintings art 0.1%