Human Generated Data

Title

Untitled (man in plaid shirt, pipe in mouth, holding large dead fish)
Date

1958
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18817

Human Generated Data

Title

Untitled (man in plaid shirt, pipe in mouth, holding large dead fish)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98.9
Human 98.9
Apparel 98.8
Clothing 98.8
Helmet 96.9
Railing 93.6
Hardhat 73.1
Shorts 59.8
Portrait 58.4
Photography 58.4
Face 58.4
Photo 58.4
Hat 57.3

Imagga
created on 2022-03-05

steel drum 38.9
musical instrument 37.2
percussion instrument 34
man 28.9
snow 22.6
male 21.3
outdoors 21.1
people 20.1
person 19.9
winter 19.6
cold 18.9
fun 17.9
uniform 17.3
park bench 17.2
bench 16.5
outdoor 16
holiday 15.8
adult 15.1
season 14.8
leisure 14.1
sport 14
military uniform 13.8
sitting 13.7
seat 13.3
clothing 13.2
men 12.9
furniture 12.8
child 12.5
sea 11.7
accordion 11.6
water 11.3
happy 11.3
travel 11.3
outside 11.1
hat 10.9
recreation 10.7
vacation 10.6
park 10.6
portrait 10.3
summer 10.3
active 9.9
worker 9.8
sky 9.6
action 9.3
activity 8.9
mountain 8.9
fence 8.6
play 8.6
adventure 8.5
keyboard instrument 8.5
black 8.4
joy 8.3
ice 8.3
cool 8
working 7.9
day 7.8
face 7.8
color 7.8
ride 7.7
sunny 7.7
construction 7.7
hobby 7.6
guy 7.5
one 7.5
calm 7.3
wind instrument 7.3
work 7.2
lifestyle 7.2
little 7.1

Google
created on 2022-03-05

Photograph 94.2
White 92.2
Black 89.8
Sleeve 87.2
Cap 87.1
Standing 86.4
Comfort 85.1
Black-and-white 85
Style 83.9
Travel 81.4
Hat 80.6
Bag 80.3
Tartan 79.5
Rectangle 76.8
Street fashion 76.6
Shorts 76.4
Luggage and bags 75.7
Beard 74.3
Snapshot 74.3
Eyewear 72.2

Microsoft
created on 2022-03-05

person 92
clothing 91.5
black and white 89.5
outdoor 89
text 86.8
snow 80.1
human face 60.2
man 53.9
monochrome 52.2
fog 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Calm 93.7%
Surprised 1.8%
Confused 1.6%
Sad 1.4%
Angry 0.9%
Disgusted 0.3%
Fear 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Helmet 96.9%

Captions

Microsoft

a person sitting on a bench in front of a fence 65.2%
a person sitting on a bench 65.1%
a person sitting in front of a fence 65%

Text analysis

Amazon

KODAK--1A--E1TW

Google

MJI7--YT33A°2--XAGO
MJI7--YT33A°2--XAGO