Human Generated Data

Title

Pay-day in the Army of the Potomac
Date

1863
People

Artist: Winslow Homer, American 1836 - 1910
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9314

Human Generated Data

Title

Pay-day in the Army of the Potomac

People

Artist: Winslow Homer, American 1836 - 1910

Date

1863

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9314

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 98.5
Person 98.5
Person 98.2
Person 94.9
Person 93.4
Person 91.9
Person 91.4
Person 90.9
Person 89.7
Art 86
Painting 76.8
Person 66.2
Person 65.4
Mail 58.3
Envelope 58.3

Clarifai
created on 2018-10-18

people 99.9
illustration 99.3
man 98
group 97.9
print 97.7
adult 96.5
art 95.2
woodcut 94.9
chair 92.2
one 91.5
paper 91.2
money 90.2
engraving 89.4
currency 87.1
administration 87
old 85.2
many 84.8
retro 82.9
leader 82.5
vintage 82.4

Imagga
created on 2018-10-18

graffito 73.9
decoration 51.4
money 39.2
currency 37.7
cash 33.9
finance 31.3
paper 29.3
dollar 28.8
bank 27.8
old 27.2
vintage 24.8
banking 23.9
bill 23.8
retro 22.1
wealth 20.7
dollars 20.3
envelope 20.1
antique 20.1
sketch 19
business 18.8
grunge 18.7
financial 18.7
banknote 18.4
ancient 18.2
exchange 16.2
bills 15.6
comic book 15.2
drawing 15.1
note 14.7
art 14.6
stamp 14.1
savings 14
texture 13.9
map 13.2
design 13.1
rich 13
investment 12.8
one 12.7
representation 12.6
pay 12.5
capital 12.3
economy 12.1
close 12
hundred 11.6
us 11.6
container 11.4
aged 10.9
market 10.7
states 10.6
payment 10.6
travel 10.6
notes 10.5
banknotes 9.8
sign 9.8
world 9.8
geography 9.6
commerce 9.3
letter 9.2
black 9
collection 9
history 9
pattern 8.9
symbol 8.8
painting 8.1
pound 7.7
finances 7.7
mail 7.7
profit 7.7
united 7.6
ornate 7.3
global 7.3
dirty 7.2

Google
created on 2018-10-18

art 84.9
history 75.6
illustration 64.2
visual arts 53.4
font 50.9

Microsoft
created on 2018-10-18

text 100
book 100

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 38-59
Gender Male, 97.9%
Sad 35%
Angry 9.9%
Calm 43.4%
Surprised 2.7%
Happy 1.5%
Disgusted 2.7%
Confused 4.8%

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Disgusted 19.5%
Calm 8.9%
Sad 22.2%
Angry 14.5%
Confused 22.4%
Happy 2%
Surprised 10.5%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Surprised 45.3%
Disgusted 47%
Happy 45.3%
Sad 46.1%
Calm 50.1%
Confused 45.6%
Angry 45.6%

AWS Rekognition

Age 30-47
Gender Male, 54.6%
Confused 45.4%
Sad 46%
Surprised 45.3%
Happy 45.2%
Disgusted 50%
Angry 46.3%
Calm 46.9%

AWS Rekognition

Age 26-43
Gender Male, 83.2%
Confused 10.5%
Happy 2.4%
Calm 30.3%
Surprised 5.9%
Disgusted 7.7%
Sad 16.4%
Angry 26.7%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Confused 45.6%
Angry 45.4%
Happy 49.7%
Calm 45.8%
Disgusted 47.1%
Surprised 45.5%
Sad 45.8%

AWS Rekognition

Age 26-43
Gender Male, 52.8%
Disgusted 45.2%
Happy 45.2%
Surprised 45.2%
Sad 49.3%
Calm 49.5%
Angry 45.5%
Confused 45.2%

AWS Rekognition

Age 57-77
Gender Male, 93.1%
Surprised 2.3%
Calm 61.2%
Angry 2.8%
Sad 17.7%
Happy 9.3%
Confused 5.5%
Disgusted 1.2%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Sad 46.3%
Disgusted 45.2%
Angry 45.5%
Happy 45.1%
Confused 45.2%
Surprised 45.2%
Calm 52.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 46.3%
Disgusted 46.3%
Angry 45.8%
Confused 45.9%
Sad 47.6%
Surprised 45.5%
Calm 47.5%

AWS Rekognition

Age 38-59
Gender Female, 50.2%
Angry 45%
Disgusted 45%
Sad 45.2%
Surprised 45.1%
Calm 45%
Happy 54.6%
Confused 45%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Disgusted 46.5%
Sad 46.8%
Angry 45.1%
Surprised 45.1%
Happy 51.1%
Calm 45.1%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Male, 53.7%
Disgusted 45.1%
Sad 50.3%
Angry 45.4%
Surprised 45.3%
Happy 47.1%
Calm 46.3%
Confused 45.5%

AWS Rekognition

Age 26-44
Gender Male, 53.3%
Surprised 45.5%
Angry 45.7%
Confused 45.7%
Disgusted 45.2%
Happy 47%
Sad 46.7%
Calm 49.3%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Calm 45.8%
Confused 45.5%
Sad 46.4%
Disgusted 49.3%
Happy 45.7%
Angry 46.9%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Sad 45.5%
Happy 52.7%
Angry 45.5%
Disgusted 45.3%
Calm 45.2%
Surprised 45.5%
Confused 45.3%

AWS Rekognition

Age 30-47
Gender Male, 53.4%
Sad 53.6%
Happy 45.3%
Angry 45.5%
Disgusted 45%
Calm 45.3%
Surprised 45.1%
Confused 45.2%

AWS Rekognition

Age 35-55
Gender Female, 50.9%
Angry 45.3%
Surprised 46.8%
Sad 45.3%
Happy 50.7%
Confused 45.4%
Calm 45.7%
Disgusted 45.7%

AWS Rekognition

Age 45-65
Gender Male, 54.7%
Disgusted 45.6%
Sad 47.6%
Confused 45.8%
Calm 49.7%
Angry 45.8%
Surprised 45.4%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Confused 45.8%
Angry 45.7%
Surprised 45.3%
Calm 50.7%
Disgusted 45.3%
Happy 45.4%
Sad 46.8%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Surprised 46.2%
Happy 45.1%
Angry 45.2%
Calm 53%
Sad 45.1%
Disgusted 45.3%
Confused 45.2%

AWS Rekognition

Age 10-15
Gender Female, 52%
Sad 46.6%
Happy 45.1%
Calm 46.4%
Surprised 45.2%
Disgusted 50.8%
Angry 45.5%
Confused 45.3%

AWS Rekognition

Age 15-25
Gender Male, 54.7%
Calm 50.3%
Surprised 45.3%
Disgusted 46.1%
Happy 45.1%
Confused 45.6%
Sad 46.8%
Angry 45.7%

AWS Rekognition

Age 11-18
Gender Male, 53.4%
Confused 45.6%
Surprised 45.5%
Sad 46.3%
Calm 51.4%
Angry 45.9%
Disgusted 45.1%
Happy 45.2%

AWS Rekognition

Age 30-47
Gender Male, 52.5%
Confused 45.6%
Happy 45.3%
Calm 49.6%
Disgusted 45.6%
Angry 45.9%
Sad 46.2%
Surprised 46.9%

AWS Rekognition

Age 26-43
Gender Female, 54%
Surprised 45%
Confused 45%
Angry 45.1%
Happy 45.2%
Disgusted 45%
Sad 54.6%
Calm 45%

AWS Rekognition

Age 57-77
Gender Male, 53.1%
Calm 48%
Disgusted 45.2%
Confused 45.4%
Sad 48%
Angry 46.2%
Surprised 46.2%
Happy 45.9%

AWS Rekognition

Age 26-44
Gender Female, 50.4%
Sad 45.3%
Surprised 45.1%
Angry 45.4%
Disgusted 53.7%
Happy 45.1%
Confused 45.2%
Calm 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Angry 45.2%
Disgusted 45.6%
Sad 45.3%
Calm 53.5%
Confused 45.2%
Surprised 45.1%
Happy 45.1%

AWS Rekognition

Age 30-47
Gender Male, 55%
Surprised 45.9%
Angry 46.1%
Confused 46.3%
Disgusted 45.7%
Happy 45.6%
Sad 47.7%
Calm 47.7%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Sad 53.2%
Surprised 45.1%
Angry 45.5%
Disgusted 45.1%
Happy 45.1%
Confused 45.2%
Calm 45.9%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Angry 46.2%
Surprised 45.5%
Sad 47.1%
Happy 45.3%
Confused 45.6%
Calm 49.9%
Disgusted 45.3%

AWS Rekognition

Age 35-52
Gender Female, 52.2%
Surprised 45.4%
Disgusted 52.2%
Sad 45.5%
Confused 45.4%
Happy 45.4%
Angry 45.6%
Calm 45.6%

AWS Rekognition

Age 60-90
Gender Female, 53.2%
Calm 45.5%
Sad 50.3%
Happy 46.8%
Surprised 46%
Angry 45.6%
Confused 45.3%
Disgusted 45.6%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Confused 49.6%
Disgusted 49.7%
Calm 49.6%
Sad 50%
Surprised 49.6%
Happy 49.5%
Angry 49.6%

AWS Rekognition

Age 29-45
Gender Female, 53.8%
Angry 46%
Calm 45.6%
Surprised 47.6%
Happy 46.2%
Sad 47.3%
Disgusted 46.7%
Confused 45.5%

AWS Rekognition

Age 60-90
Gender Male, 50.4%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Calm 49.7%
Sad 50.2%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 51%
Calm 45.1%
Surprised 45.3%
Angry 45.5%
Happy 45.3%
Disgusted 45.5%
Confused 45.6%
Sad 52.8%

AWS Rekognition

Age 48-68
Gender Female, 52.7%
Angry 45.9%
Disgusted 47.4%
Sad 48.9%
Surprised 45.5%
Calm 46.3%
Happy 45.7%
Confused 45.4%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft
created on 2018-10-18

a close up of a book 57.4%
close up of a book 51.8%
a hand holding a book 51.7%

Text analysis

Amazon

SENDINGMONEYHOME
WEEKLY.
HARPER'S WEEKLY.
HARPER'S
THE
DY
PTI

Google

136 HARPER'S WEEKLY 137 10 SENDING MONEY HOME THE LETTER AIwmn PAY-DAY IN THE ARMY OF THE POTOMAC-[DRAW r MR. HoMEn.
136
WEEKLY
137
THE
OF
POTOMAC-
[
DRAW
MR.
HARPER'S
10
SENDING
MONEY
HOME
LETTER
AIwmn
PAY
-
DAY
IN
ARMY
r
HoMEn.