Human Generated Data

Title

Fire-Works on the Night of the Fourth of July
Date

1868
People

Artist: Winslow Homer, American 1836 - 1910

Artist: Unidentified Artist,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9326

Human Generated Data

Title

Fire-Works on the Night of the Fourth of July

People

Artist: Winslow Homer, American 1836 - 1910

Artist: Unidentified Artist,

Date

1868

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9326

Machine Generated Data

Tags

Amazon
created on 2019-07-16

Human 98.7
Person 98.7
Art 97.5
Painting 96.8
Person 96.2
Person 95.1
Person 93.6
Person 93.4
Person 79.8
Person 79
Person 78.8
Drawing 77.7
Crowd 75.5
Audience 70.9
Person 70.8
Person 51.1

Clarifai
created on 2019-07-16

people 99.9
group 99.3
many 98.3
adult 96.8
man 96.1
child 95.8
portrait 94.8
one 93.2
group together 89.1
leader 88.7
chair 88
administration 87.9
wear 87.8
retro 87.1
uniform 86.3
outfit 85.7
art 83.3
boy 83.1
furniture 82
woman 81.8

Imagga
created on 2019-07-16

currency 31.4
money 30.6
cash 29.3
finance 26.2
art 25.1
vintage 24.8
paper 24.4
bill 23.8
decoration 22.8
old 22.3
retro 22.1
antique 21.9
bank 21.5
dollar 21.3
grunge 21.3
graffito 19.4
banking 19.3
ancient 19
financial 18.7
design 18.6
business 18.2
wealth 18
savings 17.7
note 16.5
banknote 15.5
texture 14.6
tray 14.3
exchange 14.3
container 14.3
economy 13.9
pattern 13.7
floral 13.6
drawing 12.9
investment 12.8
one 12.7
hundred 12.6
close 12
aged 11.8
tile 11.7
receptacle 11.6
dollars 11.6
stamp 11.6
sketch 11.5
letter 11
flower 10.8
history 10.7
bills 10.7
us 10.6
pay 10.5
detail 10.5
structure 10.3
rich 10.2
frame 10.1
banknotes 9.8
sculpture 9.8
payment 9.6
profit 9.6
symbol 9.4
decorative 9.2
ornate 9.1
backdrop 9.1
religion 9
artistic 8.7
loan 8.6
black 8.4
church 8.3
border 8.1
ceramic ware 8.1
success 8
textured 7.9
color 7.8
travel 7.7
spirituality 7.7
notes 7.7
wallpaper 7.7
sign 7.5
plant 7.5
silhouette 7.4
representation 7.4
damask 7.4
style 7.4
object 7.3
rough 7.3
blackboard 7.2
architecture 7
leaf 7

Google
created on 2019-07-16

People 95.5
Art 85.1
Painting 78.7
Illustration 71
Crowd 66.3
Picture frame 63.8
Photography 62.4
History 57.6
Visual arts 55
Artwork 51.1

Microsoft
created on 2019-07-16

human face 94.9
drawing 94.7
text 93.2
person 91.7
cartoon 91.6
clothing 80.8
illustration 78.2
sketch 71
posing 58.4
poster 58
man 53.7
picture frame 29.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 95%
Happy 12.2%
Disgusted 2.4%
Calm 43.8%
Sad 19.8%
Angry 5.5%
Surprised 4.2%
Confused 12.2%

AWS Rekognition

Age 20-38
Gender Female, 91.9%
Disgusted 9%
Surprised 4.6%
Calm 50.5%
Confused 2.1%
Sad 23.6%
Happy 4.1%
Angry 6%

AWS Rekognition

Age 15-25
Gender Male, 72.2%
Happy 8.3%
Sad 11.7%
Surprised 13.8%
Disgusted 30%
Confused 6.1%
Calm 10.8%
Angry 19.4%

AWS Rekognition

Age 14-25
Gender Male, 96.1%
Angry 9.7%
Calm 46%
Disgusted 12.2%
Surprised 11%
Happy 1.5%
Confused 10.8%
Sad 9%

AWS Rekognition

Age 26-43
Gender Male, 98%
Disgusted 2.8%
Surprised 59.5%
Happy 3.6%
Sad 1.3%
Confused 9.3%
Angry 8.5%
Calm 14.9%

AWS Rekognition

Age 26-43
Gender Female, 65.7%
Surprised 8.6%
Angry 4.6%
Calm 57.4%
Confused 7.5%
Sad 8.9%
Disgusted 5.7%
Happy 7.2%

AWS Rekognition

Age 15-25
Gender Male, 88.3%
Happy 3.8%
Calm 57.3%
Confused 6.8%
Angry 6.3%
Sad 11.1%
Surprised 8.2%
Disgusted 6.4%

AWS Rekognition

Age 45-63
Gender Male, 97.5%
Sad 4.5%
Calm 12%
Surprised 1.9%
Happy 1.5%
Disgusted 63.6%
Angry 11.2%
Confused 5.2%

AWS Rekognition

Age 26-43
Gender Male, 82.3%
Happy 4.6%
Disgusted 1.3%
Calm 8.3%
Confused 19.4%
Sad 7%
Angry 2.8%
Surprised 56.7%

AWS Rekognition

Age 48-68
Gender Male, 88.9%
Angry 0.4%
Surprised 0.3%
Confused 0.4%
Calm 96.9%
Sad 1.5%
Disgusted 0.2%
Happy 0.4%

AWS Rekognition

Age 14-25
Gender Male, 74.6%
Calm 35.6%
Sad 8.9%
Confused 14.9%
Disgusted 1.6%
Angry 7.4%
Happy 11.8%
Surprised 19.7%

AWS Rekognition

Age 60-80
Gender Male, 98.9%
Confused 2.2%
Angry 1.4%
Calm 87.4%
Disgusted 0.5%
Surprised 1.1%
Happy 2%
Sad 5.3%

AWS Rekognition

Age 26-43
Gender Male, 75.7%
Angry 9.6%
Calm 10.6%
Disgusted 3.8%
Surprised 58.2%
Happy 1.2%
Confused 10.9%
Sad 5.8%

AWS Rekognition

Age 48-68
Gender Male, 93.2%
Angry 5.5%
Disgusted 4.4%
Happy 7.5%
Calm 13.9%
Confused 5.7%
Surprised 54%
Sad 8.9%

AWS Rekognition

Age 26-43
Gender Male, 89.7%
Happy 0.3%
Disgusted 0.3%
Calm 89.2%
Sad 4%
Angry 1.4%
Surprised 1.8%
Confused 3.1%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Happy 45.2%
Calm 45.5%
Surprised 45.1%
Angry 45.3%
Sad 53.8%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 45.1%
Confused 46%
Sad 49%
Disgusted 45.1%
Angry 47.8%
Surprised 45.2%
Calm 46.7%

AWS Rekognition

Age 26-43
Gender Male, 61.1%
Sad 1.2%
Confused 7.9%
Calm 1.7%
Happy 4.8%
Angry 2.8%
Disgusted 1.9%
Surprised 79.8%

AWS Rekognition

Age 35-55
Gender Male, 95.6%
Sad 3.4%
Angry 2.5%
Disgusted 0.8%
Confused 3.1%
Calm 81.2%
Surprised 1.6%
Happy 7.4%

AWS Rekognition

Age 26-43
Gender Male, 90.9%
Calm 71.4%
Angry 5.8%
Happy 2.9%
Sad 4.9%
Disgusted 2.6%
Surprised 6.5%
Confused 5.9%

AWS Rekognition

Age 26-44
Gender Male, 96.9%
Sad 3.4%
Calm 87.7%
Happy 1.3%
Confused 2.1%
Surprised 1.4%
Angry 2.3%
Disgusted 1.9%

AWS Rekognition

Age 17-27
Gender Male, 64.2%
Sad 47.1%
Angry 8.6%
Calm 11.9%
Confused 9.6%
Happy 3.4%
Surprised 7.4%
Disgusted 12%

AWS Rekognition

Age 26-43
Gender Male, 85.4%
Disgusted 1.2%
Angry 3%
Surprised 3.2%
Calm 35.9%
Confused 4.7%
Sad 44.9%
Happy 7.2%

AWS Rekognition

Age 26-43
Gender Female, 63.3%
Calm 79.3%
Angry 2.2%
Surprised 4.1%
Happy 7.4%
Sad 1.7%
Confused 2.6%
Disgusted 2.6%

AWS Rekognition

Age 26-43
Gender Female, 74.1%
Surprised 1.8%
Disgusted 1%
Happy 3.9%
Sad 1.5%
Angry 1.2%
Confused 1.4%
Calm 89.2%

AWS Rekognition

Age 35-52
Gender Male, 98.2%
Surprised 1.6%
Disgusted 0.9%
Angry 3.6%
Happy 0.4%
Confused 6.9%
Calm 42.3%
Sad 44.3%

AWS Rekognition

Age 23-38
Gender Female, 53.6%
Confused 6.7%
Sad 8.7%
Angry 8.9%
Surprised 7.7%
Disgusted 11.5%
Calm 55.6%
Happy 1.1%

AWS Rekognition

Age 15-25
Gender Female, 80.5%
Disgusted 1.7%
Surprised 5.3%
Confused 9.5%
Happy 9.6%
Calm 49.3%
Sad 14.9%
Angry 9.6%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Happy 45.2%
Surprised 45.3%
Calm 47.2%
Confused 45.8%
Sad 50.6%
Angry 45.5%
Disgusted 45.4%

AWS Rekognition

Age 29-45
Gender Male, 93%
Sad 25.7%
Surprised 9.9%
Calm 35.8%
Happy 10.7%
Confused 9.2%
Disgusted 3.3%
Angry 5.2%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Surprised 45.4%
Sad 45.1%
Happy 45.1%
Confused 45.2%
Calm 54.1%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 89.8%
Happy 3%
Calm 27.6%
Surprised 37.8%
Angry 3.9%
Sad 22.1%
Disgusted 1.9%
Confused 3.7%

AWS Rekognition

Age 23-38
Gender Female, 51.8%
Calm 54.1%
Disgusted 45.5%
Sad 45.1%
Surprised 45.1%
Happy 45.1%
Confused 45%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Happy 45.4%
Disgusted 45.4%
Confused 45.9%
Sad 47.5%
Calm 49.7%
Angry 45.5%
Surprised 45.6%

AWS Rekognition

Age 26-44
Gender Female, 51.8%
Happy 45.2%
Surprised 45.4%
Calm 48.7%
Confused 45.5%
Sad 49.1%
Angry 45.8%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Male, 92.9%
Disgusted 27.1%
Angry 6.3%
Happy 13.3%
Calm 21.4%
Confused 6.9%
Sad 4.5%
Surprised 20.5%

AWS Rekognition

Age 26-43
Gender Male, 88%
Surprised 9.7%
Happy 2.6%
Calm 64.7%
Disgusted 2.7%
Angry 6.5%
Confused 7.3%
Sad 6.4%

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Surprised 7.2%
Calm 36.3%
Confused 8.8%
Happy 1.6%
Sad 28.7%
Disgusted 8%
Angry 9.4%

AWS Rekognition

Age 12-22
Gender Male, 87.1%
Happy 0.7%
Calm 0.5%
Confused 2.6%
Angry 46.7%
Sad 41.1%
Surprised 4.3%
Disgusted 4.1%

AWS Rekognition

Age 30-47
Gender Male, 54.1%
Happy 45.1%
Surprised 45.1%
Angry 45.2%
Confused 45.4%
Sad 54%
Calm 45.2%
Disgusted 45%

AWS Rekognition

Age 14-25
Gender Male, 50.4%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Calm 50.2%
Angry 46.2%
Disgusted 45.2%
Sad 46.8%
Confused 45.7%
Surprised 45.8%
Happy 45.2%

AWS Rekognition

Age 12-22
Gender Female, 53.5%
Surprised 45.2%
Disgusted 45.1%
Happy 45%
Sad 52.7%
Angry 45.3%
Confused 45.3%
Calm 46.5%

AWS Rekognition

Age 19-36
Gender Male, 50.3%
Confused 45.2%
Happy 45.1%
Calm 50.9%
Sad 47.2%
Angry 46.2%
Disgusted 45.1%
Surprised 45.2%

AWS Rekognition

Age 23-38
Gender Female, 53.5%
Disgusted 45.4%
Surprised 45.5%
Calm 46.3%
Confused 45.2%
Sad 50.7%
Happy 45.3%
Angry 46.7%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Disgusted 49.5%
Sad 50.2%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Angry 49.7%
Calm 49.5%

AWS Rekognition

Age 23-38
Gender Male, 53%
Calm 46.7%
Disgusted 45.2%
Angry 46%
Sad 49.8%
Surprised 45.9%
Happy 45.7%
Confused 45.6%

AWS Rekognition

Age 20-38
Gender Female, 53.8%
Confused 45.3%
Calm 50.1%
Disgusted 45.4%
Surprised 45.9%
Sad 46.8%
Angry 46.3%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Happy 45.9%
Surprised 45.9%
Angry 46.2%
Confused 45.4%
Sad 45.8%
Calm 49.5%
Disgusted 46.1%

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Angry 45.4%
Surprised 45.5%
Happy 52.3%
Disgusted 45.4%
Sad 45.8%
Confused 45.2%
Calm 45.5%

AWS Rekognition

Age 26-43
Gender Male, 73%
Disgusted 0.3%
Surprised 1.1%
Confused 1.3%
Happy 0.1%
Calm 17.5%
Sad 76.9%
Angry 2.8%

AWS Rekognition

Age 30-47
Gender Male, 54.4%
Happy 8%
Calm 10.6%
Confused 13.7%
Angry 10.9%
Sad 45.7%
Surprised 7.2%
Disgusted 4%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Angry 49.7%
Calm 49.6%
Disgusted 49.5%
Surprised 49.5%
Happy 49.6%
Confused 49.5%
Sad 50%

AWS Rekognition

Age 23-38
Gender Female, 53.1%
Disgusted 45.2%
Happy 51.2%
Sad 45.4%
Angry 45.4%
Calm 45.8%
Surprised 46.9%
Confused 45.2%

AWS Rekognition

Age 29-45
Gender Male, 50.5%
Surprised 49.6%
Happy 49.5%
Disgusted 49.6%
Sad 49.6%
Angry 49.6%
Confused 49.6%
Calm 50%

AWS Rekognition

Age 26-44
Gender Male, 50.1%
Sad 50.2%
Surprised 49.5%
Calm 49.5%
Happy 49.6%
Confused 49.6%
Disgusted 49.5%
Angry 49.6%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft
created on 2019-07-16

an old photo of a person 60.2%
a person posing for the camera 60.1%
a person posing for a photo 52.1%

Text analysis

Amazon

HARPER'S
WEEKLY.
FOURTH
OF
THE
ON
FIRE
'IT
PAGE
'IT ['898T
['898T
FIRE ON THE NIGHT OF THE FOURTH OF JUL.Y. WINneoW PAGE 446.]
JUL.Y.
446.]
NIGHT
ATaf
WINneoW
SI

Google

FIRE-WORKS ON THE NIGHT OF TIE FOURTH OF JULY.-DRAWN BY WINSLOW HOMER.-[SEE PAGE 446.] 445 JULY 11, 1868. HARPER'S WEEKLY
FIRE-WORKS
ON
THE
NIGHT
OF
TIE
FOURTH
JULY.-DRAWN
BY
WINSLOW
HOMER.-[SEE
PAGE
446.]
445
JULY
11,
1868.
HARPER'S
WEEKLY