Human Generated Data

Title

Untitled (two young men and young woman posed wearing Beat Generation jackets and smiling at each other)

Date

1959

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10168

Human Generated Data

Title

Untitled (two young men and young woman posed wearing Beat Generation jackets and smiling at each other)

People

Artist: Martin Schweig, American 20th century

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.3
Person 99.3
Person 99.1
Person 98.5
Clothing 97.2
Apparel 97.2
Shorts 97
Sleeve 82.2
Hand 81.5
Word 77.7
Crowd 71.2
Female 65.3
Finger 63.3
Pants 63.2
Man 62.3
Face 60.9
Suit 56.8
Coat 56.8
Overcoat 56.8

Imagga
created on 2022-01-29

person 55.4
golfer 45.8
man 44.3
player 38.3
male 36.9
professional 31.6
people 31.2
contestant 30.3
uniform 28.6
adult 28.6
nurse 28.4
doctor 26.3
handsome 24.9
portrait 24.6
happy 24.4
medical 23.8
standing 22.6
team 22.4
job 22.1
businessman 22.1
men 21.5
occupation 21.1
smiling 21
business 20.6
hospital 19.8
suit 19.8
worker 18.8
mature 18.6
smile 18.5
stethoscope 18.5
work 17.3
black 16.8
medicine 16.7
profession 16.3
staff 16.1
looking 16
planner 15.7
group 15.3
teamwork 14.8
health 14.6
working 14.1
care 14
confident 13.6
senior 13.1
clothing 12.3
coat 12.1
human 12
success 11.3
happiness 11
doctors 10.8
clinic 10.5
patient 10.3
specialist 10.1
holding 9.9
studio 9.9
architect 9.7
hands 9.5
corporate 9.4
helmet 9.4
casual 9.3
surgeon 9.2
successful 9.1
friendly 9.1
one 9
cheerful 8.9
indoors 8.8
together 8.8
confidence 8.6
face 8.5
hat 8.2
healthy 8.2
engineer 8.1
office 8
executive 8
boy 7.8
clinical 7.8
expertise 7.8
modern 7.7
elderly 7.7
businesspeople 7.6
fashion 7.5
attendant 7.5
dark 7.5
camera 7.4
inside 7.4
lifestyle 7.2

Google
created on 2022-01-29

Sports uniform 94.5
Shorts 88.1
Sleeve 87.2
Gesture 85.3
Style 83.8
Black-and-white 82.9
Smile 78.7
Sports equipment 75.1
T-shirt 74.3
Crew 73.5
Uniform 73.2
Monochrome photography 71.8
Player 71.7
Font 71.6
Sportswear 69.7
Event 69.6
Team 68.1
Monochrome 67.2
Competition event 66.6
Sports 65.7

Microsoft
created on 2022-01-29

person 99.7
text 95.3
clothing 93.8
standing 86.2
man 80
player 63.3
posing 51.3

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 77.5%
Calm 67.9%
Happy 29.6%
Surprised 0.8%
Sad 0.5%
Angry 0.4%
Disgusted 0.4%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Female, 99.4%
Calm 88.1%
Surprised 10.4%
Sad 0.6%
Confused 0.2%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people posing for a photo 85.1%
a group of people posing for the camera 85%
a group of people posing for a picture 84.9%

Text analysis

Amazon

GENERATION
BEAT
THE
THE THE BEAT GENERATION BEAT
HIPVILLE
HIPVILLE U.S.A
U.S.A
BER

Google

BEAT THE GENERATION
BEAT
GENERATION
THE