Human Generated Data

Title

Untitled ("Beat Generation" teenagers, St. Louis, Missouri)

Date

1959, printed later

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1009

Human Generated Data

Title

Untitled ("Beat Generation" teenagers, St. Louis, Missouri)

People

Artist: Martin Schweig, American 20th century

Date

1959, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.5
Person 98.6
Clothing 97.8
Apparel 97.8
Sleeve 95.8
Long Sleeve 70.4
Pants 69.3
Shirt 64.8
Man 63
Suspenders 55.1

Imagga
created on 2022-01-08

golfer 100
player 90.1
nurse 71.2
contestant 70.1
doctor 66.9
medical 59.3
person 58.3
stethoscope 55.1
hospital 51.1
professional 47.5
medicine 45.9
man 43.1
team 38.6
health 36.9
innocent 36.9
care 36.3
male 36.2
happy 35.2
uniform 34.6
people 34.1
smile 33.6
smiling 33.4
adult 29.2
clinic 28.8
doctors 28.6
job 28.4
confident 27.4
portrait 25.3
standing 25.3
work 25.2
group 25
occupation 24.8
coat 24.3
practitioner 23.6
surgeon 23.6
handsome 23.2
worker 22.3
profession 22.1
friendly 22
women 20.6
mature 20.5
teamwork 20.5
staff 20.1
physician 19.6
specialist 18.9
business 18.3
working 17.7
men 17.2
office 16.9
colleagues 16.6
illness 16.2
patient 16.2
student 15.7
clinical 15.7
successful 15.6
attractive 15.4
looking 15.2
healthy 15.2
workers 14.6
laboratory 14.5
senior 13.1
lifestyle 13
success 12.9
assistant 12.7
health care 12.7
sick 12.6
confidence 12.5
businessman 12.4
indoors 12.3
30s 11.6
diversity 11.6
cheerful 11.4
help 11.2
lab coat 11.2
positive 11.1
happiness 11
surgical 10.9
ill 10.7
lab 10.7
expertise 10.7
lady 10.6
partnership 9.6
hair 9.5
intern 8.9
practice 8.7
brunette 8.7
outside 8.6
meeting 8.5
two 8.5
human 8.3
20s 8.3
businesswoman 8.2
suit 8.1
nurses 7.9
scrubs 7.9
general 7.9
guy 7.9
coworkers 7.9
couple 7.9
surgery 7.8
middle aged 7.8
isolate 7.6
black 7.2
face 7.1
pretty 7

Google
created on 2022-01-08

Shirt 94.6
Smile 91.1
Sleeve 87.2
Gesture 85.3
Collar 84.1
Style 83.9
Black-and-white 83.2
T-shirt 81.6
Belt 79.6
Font 75
White-collar worker 74.5
Uniform 73.8
Crew 73.1
Monochrome photography 71.8
Event 71.2
Monochrome 69.8
Team 69.5
Workwear 68.6
Vintage clothing 63.9
Brand 63.5

Microsoft
created on 2022-01-08

person 99.8
wall 99.2
clothing 97.4
smile 95.9
text 94.8
standing 93.5
man 93.1
human face 86.4
player 80.6
shirt 78.8
posing 73.8
boy 68.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 96.9%
Calm 1.2%
Confused 0.7%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Happy 53.4%
Calm 35.1%
Disgusted 3.3%
Angry 2.4%
Sad 2%
Surprised 1.7%
Confused 1.2%
Fear 0.9%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Happy 97.5%
Angry 0.5%
Surprised 0.5%
Disgusted 0.4%
Calm 0.4%
Sad 0.3%
Confused 0.2%
Fear 0.2%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 93%
a group of people posing for the camera 92.9%
a group of men posing for a photo 92.8%

Text analysis

Amazon

GENERATION
BEAT
THE
THE THE BEAT GINTRATION BEAT
REA
GINTRATION
B
HIPVELLE
by
TAX

Google

GENERATION
BEAT
BEAT THE GENERATION
THE