Human Generated Data

Title

Untitled (men holding trophy)

Date

1947

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21710

Human Generated Data

Title

Untitled (men holding trophy)

People

Artist: John Howell, American active 1930s-1960s

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 98.8
Human 98.8
Person 97.4
Person 97.3
Apparel 95.5
Clothing 95.5
Accessory 92.4
Accessories 92.4
Tie 92.4
Overcoat 88
Coat 88
Suit 88
Person 86.8
Sleeve 73.7
Trophy 69.9
Suit 69.4
Person 67
Face 64.2
Shirt 59.9
Tuxedo 57.2
People 57
Head 55.8

Imagga
created on 2022-03-11

senior 52.5
man 45.7
male 36.2
elderly 35.4
sax 34.4
brass 34.3
wind instrument 33.8
person 33.6
couple 33.1
people 31.8
adult 30.2
mature 28.8
old 27.8
happy 25.7
retired 22.3
grandfather 22.2
executive 21.6
cornet 21.3
businessman 21.2
portrait 20.7
men 19.7
older 19.4
retirement 19.2
looking 18.4
musical instrument 18
business 17.6
medical 16.8
lifestyle 16.6
professional 16.3
husband 16.2
home 15.9
smiling 15.9
together 15.8
smile 15.7
health 15.3
indoors 14.9
happiness 14.9
aged 14.5
casual 14.4
love 14.2
grandma 14
glasses 13.9
cheerful 13.8
sitting 13.7
married 13.4
worker 13.3
wife 13.3
office 12.8
60s 12.7
women 12.6
gray 12.6
work 12.6
team 12.5
handsome 12.5
job 12.4
age 12.4
doctor 12.2
human 12
occupation 11.9
look 11.4
face 11.4
kin 11.2
pensioner 11.1
patient 10.9
70s 10.8
family 10.7
illness 10.5
hair 10.3
manager 10.2
company 10.2
hand 9.9
care 9.9
citizen 9.8
grandmother 9.8
half length 9.7
group 9.7
table 9.5
marriage 9.5
meeting 9.4
hospital 9.4
expression 9.4
camera 9.2
room 9.1
lady 8.9
nurse 8.9
entrepreneur 8.8
middle aged 8.8
day 8.6
businesspeople 8.5
enjoying 8.5
desk 8.5
writing 8.4
to 8
sixties 7.8
casual clothing 7.8
hands 7.8
discussion 7.8
expertise 7.8
eyes 7.7
stage 7.7
teacher 7.7
profession 7.7
loving 7.6
adults 7.6
friends 7.5
friendship 7.5
teamwork 7.4
suit 7.3
indoor 7.3
businesswoman 7.3
success 7.2
romance 7.1
romantic 7.1
planner 7.1
working 7.1
medicine 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

person 98.9
clothing 93.9
man 93.1
smile 92.2
text 90.7
suit 85.6
human face 72.5
posing 40.2

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Female, 56.4%
Happy 86.6%
Calm 5.3%
Sad 3.1%
Surprised 2.6%
Confused 1.6%
Disgusted 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.6%
Happy 94.9%
Surprised 3.3%
Calm 0.6%
Confused 0.3%
Fear 0.3%
Sad 0.3%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 70%
Confused 22.8%
Disgusted 2.1%
Sad 2.1%
Happy 1.1%
Angry 0.8%
Surprised 0.7%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 92.4%
Suit 88%

Captions

Microsoft

a group of people posing for a photo 86%
a group of people posing for the camera 85.9%
a group of men posing for a photo 82.9%

Text analysis

Amazon

se
118e-1

Google

as
as