Human Generated Data

Title

Untitled (football player #22 with parents)

Date

1962

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2445

Human Generated Data

Title

Untitled (football player #22 with parents)

People

Artist: Harry Annas, American 1897 - 1980

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-17

Apparel 100
Clothing 100
Human 99.7
Person 99.7
Helmet 99.5
Person 98.5
Helmet 97.9
Helmet 97.3
Person 96.9
People 96.6
Field 92.5
Sports 91.8
Sport 91.8
Person 89.6
Team Sport 88.7
Team 88.7
Shoe 87.9
Footwear 87.9
Crowd 85.9
Football 84.2
Shirt 83.3
Shorts 82.6
Face 79.8
Overcoat 79.4
Suit 79.4
Photo 74.5
Photography 74.5
Portrait 74.5
Building 74.3
Person 70.7
Plant 67.6
Female 67.3
Pants 61.9
Jersey 61.5
Girl 60.7
Shoe 60.2
American Football 60
Football Helmet 60
Text 58
Coat 57.5
Smile 56.5

Clarifai
created on 2019-06-17

people 99.5
adult 97
man 96.1
group together 95.3
monochrome 95.2
wear 93.8
group 93.3
woman 92.9
portrait 90.4
four 83.2
five 83.2
three 82.9
several 82.7
outfit 82.6
veil 81.3
child 79.4
leader 78.5
retro 78.4
administration 75
one 73.8

Imagga
created on 2019-06-17

nurse 65.2
man 45.7
male 39.8
people 36.3
person 34.8
professional 30.5
doctor 28.2
happy 27.6
adult 25.7
medical 24.7
team 24.2
hospital 24.1
business 23.7
group 23.4
standing 22.6
men 22.3
job 21.2
businessman 21.2
mature 20.5
looking 20
worker 19.9
uniform 19.9
coat 19.4
medicine 19.4
confident 19.1
handsome 18.7
stethoscope 18.6
beach 18.6
teamwork 17.6
portrait 17.5
health 17.4
smiling 17.4
smile 17.1
care 15.6
occupation 15.6
suit 15
together 14.9
couple 14.8
lifestyle 14.5
life 14.2
staff 13.9
friendly 13.7
clinic 13.7
kin 13.5
human 13.5
profession 13.4
work 13.3
women 12.7
colleagues 12.6
family 12.5
success 12.1
lab coat 11.9
businesswoman 11.8
doctors 11.8
happiness 11.8
sea 11.7
expertise 11.6
silhouette 11.6
working 11.5
attendant 11.2
love 11.1
casual 11
ocean 10.9
clinical 10.7
water 10.7
guy 10.6
elderly 10.5
sand 10.5
tie 10.4
senior 10.3
sky 10.2
two 10.2
successful 10.1
old 9.8
cheerful 9.8
office 9.6
boy 9.6
corporate 9.5
hand 9.1
attractive 9.1
black 9
vacation 9
child 8.9
indoors 8.8
consultant 8.8
diversity 8.7
partnership 8.6
illness 8.6
walk 8.6
clothing 8.6
walking 8.5
career 8.5
summer 8.4
holding 8.3
20s 8.2
healthy 8.2
specialist 8.2
sunset 8.1
coast 8.1
day 7.8
assistant 7.8
husband 7.7
outside 7.7
30s 7.7
crowd 7.7
confidence 7.7
businesspeople 7.6
meeting 7.5
fun 7.5
executive 7.5
world 7.5
camera 7.4
positive 7.4
patient 7.3
mother 7.3
employee 7.2
practitioner 7.1
travel 7

Google
created on 2019-06-17

Microsoft
created on 2019-06-17

person 97
posing 96
outdoor 95.7
standing 91.2
clothing 85.9
smile 75.8
baseball 64.5
man 61.1
sports uniform 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 99.8%
Confused 11.5%
Angry 4.2%
Surprised 7.7%
Happy 10%
Sad 4.5%
Disgusted 22.7%
Calm 39.4%

AWS Rekognition

Age 48-68
Gender Male, 54.9%
Calm 51.2%
Happy 46.7%
Disgusted 46%
Sad 45.3%
Angry 45.2%
Surprised 45.3%
Confused 45.2%

AWS Rekognition

Age 45-63
Gender Male, 55%
Sad 48%
Angry 45.4%
Surprised 45.1%
Calm 50.9%
Happy 45.1%
Disgusted 45.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 81.6%
Angry 4.2%
Surprised 4.3%
Confused 2.7%
Calm 78%
Disgusted 1.7%
Happy 4.1%
Sad 5%

AWS Rekognition

Age 29-45
Gender Female, 50.5%
Surprised 45.1%
Sad 46%
Disgusted 45.1%
Confused 45.1%
Happy 52.9%
Angry 45.2%
Calm 45.7%

AWS Rekognition

Age 23-38
Gender Male, 52.7%
Disgusted 45.2%
Angry 45.7%
Calm 48%
Sad 46.5%
Happy 48.3%
Confused 45.7%
Surprised 45.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 99.5%
Shoe 87.9%
Coat 57.5%

Captions

Microsoft

a group of people posing for a photo 97.5%
a group of people posing for the camera 97.4%
a group of people posing for a picture 97.3%

Text analysis

Amazon

SAFETY
KODAK
SAFETY FILM KODAK
FILM
22

Google

22 KODAK SAFETY FILM
KODAK
FILM
22
SAFETY