Human Generated Data

Title

Untitled (man leaning on his cane in living room, "Oldest Resident")
Date

1950, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.406

Human Generated Data

Title

Untitled (man leaning on his cane in living room, "Oldest Resident")

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97.1
Human 97.1
Tie 81.2
Accessories 81.2
Accessory 81.2
Stick 77.2
Monitor 75.9
Electronics 75.9
Display 75.9
Screen 75.9
Cane 72.8
Rug 63.9
Suit 63.4
Clothing 63.4
Coat 63.4
Overcoat 63.4
Apparel 63.4
Furniture 59.9
Door 57.8

Imagga
created on 2022-01-08

man 26.2
male 23.5
person 23.3
people 22.9
adult 22.1
chair 18.6
musical instrument 18.3
business 17.6
device 17.1
home 16.7
office 15.3
indoors 14.9
room 14.3
work 14.3
suit 14.2
portrait 13.6
smile 13.5
crutch 13
lifestyle 13
staff 12.9
seat 12.9
black 12.9
fashion 12.8
one 12.7
attractive 12.6
cheerful 12.2
sitting 12
men 12
happy 11.9
computer 11.5
interior 11.5
businessman 11.5
looking 11.2
inside 11
laptop 11
smiling 10.8
working 10.6
corporate 10.3
old 9.7
human 9.7
urban 9.6
happiness 9.4
house 9.2
pretty 9.1
holding 9.1
call 9
posing 8.9
stringed instrument 8.9
sexy 8.8
professional 8.8
building 8.4
dark 8.3
life 8.2
technology 8.2
style 8.2
stick 8.2
lady 8.1
light 8
furniture 7.9
standing 7.8
mid adult 7.7
electronic instrument 7.7
youth 7.7
worker 7.5
executive 7.5
window 7.3
alone 7.3
family 7.1
child 7.1
modern 7

Google
created on 2022-01-08

Coat 86.5
Houseplant 85.5
Plant 85.3
Chair 82.5
Tints and shades 76.6
Wood 75.3
Suit 74.8
Monochrome 74.8
Flooring 73.8
Monochrome photography 72.5
Room 67.9
Flowerpot 66.3
Rectangle 65.4
Sitting 63.5
Stock photography 62.7
Vintage clothing 62.1
Art 61.3
Guitar 58.3
Formal wear 57
Curtain 56.3

Microsoft
created on 2022-01-08

window 94.5
clothing 92
person 91.3
indoor 89.2
text 83.6
black 78.4
black and white 65.9
piano 59.8
footwear 54.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 75-85
Gender Male, 96.4%
Calm 68.5%
Confused 12.3%
Surprised 8.6%
Fear 3.5%
Sad 2%
Disgusted 1.8%
Angry 1.7%
Happy 1.6%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Tie 81.2%
Rug 63.9%
Suit 63.4%

Captions

Microsoft

a man standing in front of a window 86.6%
a man that is standing in front of a window 84%
a man standing next to a window 82.6%