Human Generated Data

Title

Thomas Kennedy, Fagon, President John Llewellyn Lewis (1880-1969), Philip Murray (1886-1952), and John Birkley
Date

1922
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.31

Human Generated Data

Title

Thomas Kennedy, Fagon, President John Llewellyn Lewis (1880-1969), Philip Murray (1886-1952), and John Birkley

People

Artist: Unidentified Artist,

Date

1922

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.31

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Person 99.1
Human 99.1
Tie 99.1
Accessories 99.1
Accessory 99.1
Shoe 99
Footwear 99
Clothing 99
Apparel 99
Shoe 98.6
Shoe 98.2
Shoe 98.1
Tie 98
Suit 97.7
Overcoat 97.7
Shoe 97.7
Shoe 97.2
Person 96.5
Person 94.7
Person 94.4
Tie 94.3
Shoe 94.3
Person 94.2
Suit 90.3
People 89.9
Suit 89.1
Suit 86.6
Hat 83.9
Standing 83.8
Shoe 81.6
Crowd 60.3
Face 58.8
Family 58
Man 57.6
Tuxedo 56.5
Performer 56.2
Tire 55.5
Coat 54.5

Clarifai
created on 2023-10-30

people 99.9
group together 99.5
group 98.5
administration 98.2
wear 97.3
leader 97.1
lid 97.1
man 96.9
several 96.5
four 96.3
veil 96.3
three 95.8
fedora 95.5
outfit 95.5
five 94.5
adult 94.2
many 90
chair 89
two 87.7
actor 87.5

Imagga
created on 2022-06-03

military uniform 100
uniform 100
clothing 100
consumer goods 71.9
covering 71.1
man 47
male 44
commodity 35.5
people 33.5
professional 32.1
adult 31.1
work 30.6
person 30.5
job 29.2
men 28.3
business 27.9
doctor 27.2
portrait 27.2
worker 26.7
occupation 25.7
hospital 23.5
medical 22.9
businessman 21.2
helmet 20.5
profession 20.1
handsome 19.6
medicine 19.4
smile 19.2
care 18.9
happy 18.8
engineer 18.6
hat 18.4
success 17.7
health 17.4
corporate 17.2
construction 17.1
architect 16.4
confident 16.4
stethoscope 16.4
office 16.1
smiling 15.9
suit 15.6
building 14.3
looking 13.6
builder 13.6
team 13.4
nurse 13.4
manager 13
standing 13
mature 13
industry 12.8
attractive 12.6
mid adult 12.5
confidence 12.4
face 12.1
teamwork 12
one 11.9
lifestyle 11.6
workplace 11.4
tie 11.4
company 11.2
safety 11
20s 11
jacket 10.7
working 10.6
clinic 10.5
staff 10.5
group 10.5
career 10.4
coat 10.3
architecture 10.2
successful 10.1
businesswoman 10
industrial 10
holding 9.9
hardhat 9.8
middle aged 9.7
serious 9.5
engineering 9.5
meeting 9.4
shirt 9.3
two 9.3
doctors 8.8
practitioner 8.8
physician 8.8
contractor 8.8
lab 8.7
diversity 8.6
executive 8.3
guy 8.3
friendly 8.2
outdoors 8.2
surgeon 8.2
equipment 8.2
protection 8.2
foreman 8
patient 7.9
look 7.9
workers 7.8
expertise 7.8
designer 7.7
emergency 7.7
project 7.7
expression 7.7
casual 7.6
illness 7.6
development 7.6
build 7.6
plan 7.6
site 7.5
help 7.4

Google
created on 2022-06-03

Suit trousers 98.4
Photograph 94.2
Hat 92.4
White 92.2
Coat 88.1
Standing 86.4
Collar 84.1
Style 83.9
Headgear 83
Sun hat 82.8
Suit 81.7
Blazer 78.3
Crew 77.4
Formal wear 76.6
White-collar worker 76.4
Vintage clothing 75.2
Snapshot 74.3
Tie 73.9
Monochrome photography 71.5
Team 71.1

Microsoft
created on 2022-06-03

person 99.9
outdoor 99.3
old 98.5
clothing 97.2
military uniform 96.3
man 95.7
group 94.3
standing 93.4
posing 92.4
hat 85
black 71.5
fedora 65
white 64.1
people 59.4
gentleman 56.5
cowboy hat 50.7
suit 49.4
clothes 16.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Surprised 27.2%
Calm 24.2%
Fear 20.8%
Sad 8.4%
Confused 6.9%
Angry 6.6%
Happy 6.1%
Disgusted 5%

AWS Rekognition

Age 33-41
Gender Male, 100%
Happy 91.4%
Calm 7.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 91%
Surprised 6.3%
Happy 6.3%
Fear 5.9%
Sad 2.8%
Confused 0.3%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Confused 91.2%
Surprised 7.4%
Fear 5.9%
Calm 5.2%
Sad 2.2%
Angry 0.9%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 82.6%
Calm 93.3%
Surprised 6.5%
Fear 6.4%
Happy 2.5%
Sad 2.3%
Confused 0.7%
Angry 0.6%
Disgusted 0.4%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Shoe
Suit
Hat
Coat
Person 99.1%
Person 96.5%
Person 94.7%
Person 94.4%
Person 94.2%
Tie 99.1%
Tie 98%
Tie 94.3%
Shoe 99%
Shoe 98.6%
Shoe 98.2%
Shoe 98.1%
Shoe 97.7%
Shoe 97.2%
Shoe 94.3%
Shoe 81.6%
Suit 97.7%
Suit 90.3%
Suit 89.1%
Suit 86.6%
Hat 83.9%
Coat 54.5%

Categories

Imagga

people portraits 82.5%
paintings art 17.1%