Human Generated Data

Title

Untitled (man with boy, playing baseball)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17298

Human Generated Data

Title

Untitled (man with boy, playing baseball)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Apparel 98.3
Clothing 98.3
Shoe 98.1
Footwear 98.1
Person 97.7
Accessories 97
Accessory 97
Tie 97
Shoe 94.6
Overcoat 90
Suit 90
Coat 90
Sunglasses 84.3
Shoe 77.1
Tarmac 68.6
Asphalt 68.6
Face 66.1
Female 64.3
Photo 64.2
Portrait 64.2
Photography 64.2
Finger 63.7
Jacket 59.9
Musical Instrument 58.9
Musician 58.9
Path 58.7
Leisure Activities 58.1
Plant 56.9
Sleeve 56
Long Sleeve 55.9
Tree 55.7
Pants 55.6

Imagga
created on 2022-02-26

man 29
person 24.5
male 23.5
musical instrument 23.1
world 18
danger 17.3
wind instrument 16.8
people 16.7
destruction 16.6
mask 14.9
accordion 14.2
comedian 13.8
adult 13.7
nuclear 13.6
life 13.5
performer 13.5
disaster 12.7
protective 12.7
black 12.6
gas 12.5
silhouette 12.4
cricket bat 12.2
smoke 12.1
protection 11.8
radioactive 11.8
toxic 11.7
keyboard instrument 11.4
suit 11
dirty 10.8
sky 10.8
radiation 10.8
outdoor 10.7
cricket equipment 10.7
chemical 10.6
business 10.3
men 10.3
dark 10
stalker 9.9
human 9.7
businessman 9.7
military 9.7
device 9.6
boy 9.6
clothing 9.4
player 9.3
industrial 9.1
environment 9
soldier 8.8
entertainer 8.7
explosion 8.7
gun 8.7
sax 8.6
motion 8.6
walking 8.5
safety 8.3
sign 8.3
holding 8.3
sports equipment 8.2
music 8.1
symbol 8.1
success 8
brass 8
newspaper 8
building 7.9
standing 7.8
accident 7.8
statue 7.8
ballplayer 7.7
protect 7.7
active 7.4
against 7.4
sport 7.3
sunset 7.2
portrait 7.1
women 7.1
night 7.1
love 7.1
summer 7.1
work 7.1
day 7.1

Google
created on 2022-02-26

Trousers 96.1
Photograph 94.1
Tie 86.5
Black-and-white 85.3
Gesture 85.3
Style 84
Suit 80.5
Smile 79.5
Hat 76.8
Shorts 75.8
Monochrome photography 75.5
Happy 74.9
Monochrome 74.5
Snapshot 74.3
Formal wear 74.3
Vintage clothing 71.4
Boot 69.4
Classic 68
Event 67.3
Stock photography 65.3

Microsoft
created on 2022-02-26

clothing 94.5
text 92.9
person 90.8
outdoor 87.5
black and white 83.2
footwear 60.4
man 60.3
smile 59.6

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 92.4%
Calm 55.8%
Angry 15.9%
Surprised 11.8%
Happy 6.3%
Disgusted 4.6%
Confused 2.1%
Sad 2.1%
Fear 1.4%

AWS Rekognition

Age 25-35
Gender Female, 57.1%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Confused 0%
Fear 0%
Surprised 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 98.1%
Tie 97%
Sunglasses 84.3%

Captions

Microsoft

an old photo of a person 64%

Text analysis

Google

A O
O
A