Human Generated Data

Title

Home of Postmaster Brown, Old Rag, Virginia
Date

1935
People

Artist: Arthur Rothstein, American 1915 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1058

Human Generated Data

Title

Home of Postmaster Brown, Old Rag, Virginia

People

Artist: Arthur Rothstein, American 1915 - 1985

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1058

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Furniture 97.5
Person 97.4
Human 97.4
Clothing 86.2
Apparel 86.2
Sitting 80.6
Table 78.9
Face 76.8
Screen 68.7
Electronics 68.7
Desk 66.2
Monitor 63.4
Display 63.4
Text 63.3
Living Room 59.8
Room 59.8
Indoors 59.8
Shelf 57.6
LCD Screen 56.9
Cabinet 56.3

Clarifai
created on 2023-10-30

people 100
adult 98.8
one 98.7
two 96.5
man 95.9
leader 95.1
group 94.2
furniture 93.5
administration 93.2
typewriter 93.1
three 92.8
group together 92.5
chair 89.6
wear 88.5
elderly 86.2
writer 85.3
sit 84.4
vehicle 82.4
newspaper 82.2
war 80.4

Imagga
created on 2022-05-28

room 28.1
man 26.2
home 20.7
people 19
barbershop 18.7
person 18.6
indoors 18.4
male 17.7
chair 17.5
shop 16.8
interior 15.9
old 13.9
hospital 13.8
sitting 13.7
adult 13.7
mercantile establishment 13.3
office 12.6
table 12
television 11.5
senior 11.2
computer 11
window 11
indoor 10.9
architecture 10.9
house 10.9
smiling 10.8
couple 10.4
lifestyle 10.1
patient 10.1
lamp 10.1
smile 10
equipment 9.9
furniture 9.8
building 9.7
device 9.7
ancient 9.5
glass 9.3
health 9
place of business 9
seat 8.7
men 8.6
grandfather 8.6
modern 8.4
inside 8.3
happy 8.1
working 7.9
medical 7.9
work 7.8
portrait 7.8
couch 7.7
monitor 7.7
industry 7.7
illness 7.6
bed 7.6
technology 7.4
phone 7.4
light 7.3
family 7.1
love 7.1
happiness 7
medicine 7

Google
created on 2022-05-28

Black 89.6
Coat 85.7
Black-and-white 85.7
Style 84
Monochrome 76
Vintage clothing 75.1
Monochrome photography 74.9
Suit 72.1
Room 70.1
Classic 68.1
Blazer 66.6
Stock photography 63.3
Sitting 63.2
History 61.9
White-collar worker 59
Formal wear 56.3
Retro style 54.9
Chair 52.2

Microsoft
created on 2022-05-28

wall 97.1
man 94.2
indoor 93.3
black and white 88.7
person 86.5
drawing 85.7
clothing 85.4
sketch 82.1
text 77.2
old 49

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 94.6%
Calm 97.7%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Confused 0.7%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Calm 51.1%
Sad 27.3%
Surprised 11.5%
Fear 8.9%
Confused 6.5%
Disgusted 5.7%
Angry 1.9%
Happy 0.6%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%

Categories

Imagga

interior objects 48.6%
food drinks 41%
paintings art 8.4%

Captions

Microsoft
created on 2022-05-28

a man sitting on a table 83.7%
a man sitting at a table 83.6%
a man sitting at a desk 83.5%

Text analysis

Amazon

THE
LISTENER
THE SILENT LISTENER
SILENT
CHRIST
THIS
HEAD
EVERY
GUEST
AT EVERY MER
AT
MER
THE ONSEEN GUEST
CONVERSATION
TO EVERY CONVERSATION
TO
ONSEEN
OF THIS HOUSE
HOUSE
CHRIST IS THE HEAD
OF
IS

Google

CHRIST IS THE HEAD OF THIS HOUSE THE UNSEEN GUEST AT EVERY MERL THE SILENT LISTENER TO EVERY CONVERSATION
CHRIST
IS
THE
HEAD
OF
THIS
HOUSE
UNSEEN
GUEST
AT
EVERY
MERL
SILENT
LISTENER
TO
CONVERSATION