Human Generated Data

Title

Untitled (man in coal car)
Date

c. 1970
People

Artist: Michael Mathers, American born 1945
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1811

Human Generated Data

Title

Untitled (man in coal car)

People

Artist: Michael Mathers, American born 1945

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Face 93.6
Clothing 76.8
Apparel 76.8
Handrail 76.2
Banister 76.2
Wood 68.9
Photography 67.3
Photo 67.3
Furniture 66.4
Sitting 65.5
Portrait 65
Window 63.3
Carpenter 57.2
Sleeve 56.7
Door 56.3
Wall 55.2

Imagga
created on 2022-01-22

steel drum 80.9
percussion instrument 68.4
musical instrument 59.3
old 25.8
retro 22.1
grunge 21.3
frame 20
vintage 19
texture 18
business 17.6
paper 17.2
empty 17.2
computer 17.1
drumstick 16.7
aged 16.3
antique 15.6
border 15.4
design 14.6
blank 14.6
damaged 14.3
black 13.8
dirty 13.5
stick 13.1
wall 12.8
film 12.8
album 12.6
art 12.4
ancient 12.1
notebook 11.8
space 11.6
box 11.6
laptop 10.9
material 10.7
device 10.7
photograph 10.6
old fashioned 10.5
office 10.4
grungy 10.4
work 10.2
wood 10
male 9.9
container 9.7
textured 9.6
man 9.4
historic 9.2
people 8.9
businessman 8.8
happy 8.8
memory 8.7
spot 8.6
blackboard 8.6
structure 8.6
rusty 8.6
backdrop 8.2
single 8.2
technology 8.2
style 8.2
digital 8.1
graphic 8
working 8
card 7.9
grime 7.8
decay 7.7
modern 7.7
desk 7.6
book 7.5
grain 7.4
brown 7.4
template 7.3
rough 7.3
businesswoman 7.3
board 7.2
suit 7.2
open 7.2
smile 7.1
portrait 7.1
adult 7.1
information 7.1
job 7.1

Google
created on 2022-01-22

Flash photography 88
Wood 84.2
Black-and-white 83.1
Tints and shades 77
Rectangle 75.1
Monochrome 74.2
Monochrome photography 72.8
Metal 66.7
Symmetry 64.8
Sitting 62.9
Stock photography 62.7
Rolling 58.1
Room 56.7
Portrait photography 55.6
Darkness 54.3
Still life photography 53.8
Fence 53.3
Street 52.9
Roof 50.6

Microsoft
created on 2022-01-22

black and white 93.7
person 82.8
text 72.6
clothing 72
monochrome 62

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Disgusted 40.6%
Confused 14.1%
Angry 12.5%
Sad 12.4%
Fear 10.2%
Calm 6.8%
Surprised 2.6%
Happy 0.8%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man sitting on top of a wooden door 33.7%
a man flying through the door 29.9%
a man standing in front of a building 29.8%