Human Generated Data

Title

Members of the Executive Council of the AFL as They Arrived at the White House
Date

1935
People

Artist: Associated Press, American Created 1846
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.44

Human Generated Data

Title

Members of the Executive Council of the AFL as They Arrived at the White House

People

Artist: Associated Press, American Created 1846

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Apparel 99.9
Clothing 99.9
Coat 99.6
Overcoat 99.6
Person 99.2
Human 99.2
Suit 98.8
Person 98.3
Accessory 98
Accessories 98
Tie 98
Tuxedo 97.1
Tie 96.4
Tie 95.8
Person 95.1
Person 94.8
Suit 94.3
Person 91.6
Person 89.8
Suit 89.7
Suit 89.6
Person 89.4
Person 88.6
Person 88.5
Suit 87.1
People 84.1
Suit 83.3
Suit 82.8
Suit 78.9
Jacket 78.2
Blazer 78.2
Suit 74.9
Hat 72.5
Tie 68.3
Attorney 58.6
Shorts 58.2
Furniture 57.5
Couch 57.5
Man 56.8
Family 56.1

Clarifai
created on 2018-03-23

people 100
group 99.6
leader 99.6
administration 99.5
group together 99.1
adult 98.5
several 96.2
many 95.1
five 95
chair 95
portrait 94.3
man 93.6
four 91.8
wear 89.4
offense 87.8
lawyer 87.6
home 87.2
three 86.9
outfit 86.9
trial 86

Imagga
created on 2018-03-23

man 49
metropolitan 47.4
male 43.9
businessman 40.6
business 35.2
people 31.8
ruler 30.9
executive 28.6
person 27.7
adult 26.3
suit 26.3
office 23.4
corporate 23.2
men 23.2
handsome 22.3
professional 21.7
portrait 21.3
businesspeople 19.9
senior 19.7
job 19.4
worker 18.6
mature 17.6
happy 17.5
face 16.3
success 16.1
work 15.7
confident 15.4
group 15.3
hand 15.2
standing 14.8
businessmen 14.6
looking 14.4
tie 14.2
clothing 14.1
jacket 14
manager 13.9
occupation 13.7
smiling 13.7
baron 13.3
black 12.8
casual 12.7
indoors 12.3
meeting 12.2
couple 12.2
company 12.1
modern 11.9
old 11.8
team 11.6
smile 11.4
expression 11.1
successful 11
happiness 11
indoor 10.9
businesswoman 10.9
lifestyle 10.8
corporation 10.6
career 10.4
adults 10.4
alone 10
cheerful 9.7
businessperson 9.7
working 9.7
look 9.6
elderly 9.6
building 9.6
kin 9.5
industry 9.4
room 9.3
human 9
engineer 8.9
computer 8.8
colleagues 8.7
boss 8.6
desk 8.5
communication 8.4
attractive 8.4
laptop 8.2
home 8
together 7.9
businesswomen 7.8
color 7.8
table 7.8
mid adult 7.7
partnership 7.7
employee 7.6
formal 7.6
fashion 7.5
clothes 7.5
holding 7.4
teamwork 7.4

Google
created on 2018-03-23

photograph 95.6
black and white 87.5
gentleman 83.9
suit 74.9
monochrome photography 72.8
vintage clothing 62.1
family 59.3
monochrome 57.7

Microsoft
created on 2018-03-23

person 100
posing 98.2
clothing 94.6
group 93.5
standing 91.6
suit 84.7
people 82
old 78.9
necktie 33.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-90
Gender Male, 96.6%
Sad 5.4%
Angry 4.3%
Calm 58.4%
Happy 20.1%
Disgusted 2%
Surprised 2.4%
Confused 7.4%

AWS Rekognition

Age 35-53
Gender Male, 98.8%
Angry 6.8%
Calm 49.9%
Disgusted 8.2%
Surprised 4.6%
Sad 6.2%
Happy 17.7%
Confused 6.5%

AWS Rekognition

Age 60-90
Gender Female, 99%
Angry 2.6%
Sad 1%
Confused 1.4%
Happy 1%
Disgusted 13.6%
Surprised 0.6%
Calm 79.7%

AWS Rekognition

Age 57-77
Gender Male, 99.3%
Angry 0.7%
Disgusted 0.3%
Surprised 0.5%
Calm 94.6%
Sad 1.3%
Confused 1.7%
Happy 0.8%

AWS Rekognition

Age 35-53
Gender Male, 99.1%
Angry 7.3%
Happy 3.1%
Surprised 1.8%
Sad 12.9%
Calm 69.4%
Confused 2.1%
Disgusted 3.3%

AWS Rekognition

Age 57-77
Gender Male, 99%
Confused 6.9%
Calm 68.1%
Sad 10%
Surprised 2.7%
Disgusted 2.7%
Happy 2.8%
Angry 6.9%

AWS Rekognition

Age 60-90
Gender Male, 99.7%
Confused 28.1%
Disgusted 5.7%
Surprised 9.2%
Sad 2.1%
Angry 7.3%
Happy 37%
Calm 10.6%

AWS Rekognition

Age 60-90
Gender Male, 99.9%
Angry 2.3%
Confused 22.8%
Calm 68.2%
Disgusted 0.6%
Surprised 1.2%
Happy 2.4%
Sad 2.5%

AWS Rekognition

Age 45-63
Gender Male, 95%
Confused 6.8%
Happy 3.7%
Disgusted 4.1%
Angry 46.3%
Surprised 4.1%
Sad 25.1%
Calm 9.9%

AWS Rekognition

Age 26-43
Gender Female, 50.8%
Disgusted 45.1%
Happy 45%
Surprised 45.1%
Sad 53.7%
Calm 45.6%
Angry 45.3%
Confused 45.1%

Microsoft Cognitive Services

Age 76
Gender Male

Microsoft Cognitive Services

Age 62
Gender Male

Microsoft Cognitive Services

Age 72
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 75
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Suit 98.8%
Tie 98%
Hat 72.5%

Captions

Microsoft

John L. Lewis, Frances Perkins posing for a photo 99.5%
John L. Lewis, Frances Perkins posing for the camera 99.4%
John L. Lewis, Frances Perkins posing for a picture 99.3%