Human Generated Data

Title

The Songs of the War
Date

1861
People

Artist: Winslow Homer, American 1836 - 1910

Artist: Unidentified Artist,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9297

Human Generated Data

Title

The Songs of the War

People

Artist: Winslow Homer, American 1836 - 1910

Artist: Unidentified Artist,

Date

1861

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9297

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.2
Person 99.2
Person 99
Person 98
Art 96.7
Person 96.4
Person 95.2
Person 94.5
Person 94.3
Person 94.2
Person 93.4
Person 93.3
Person 92
Person 90.3
Person 89.3
Person 88.3
Mammal 87.4
Horse 87.4
Animal 87.4
Person 85.8
Person 85.1
Person 85
Painting 84.3
Person 84.1
Person 80.8
Person 79.4
Person 78.8
Person 71.7
Duel 70.1
Person 70
Person 67.2
Drawing 64.2
Text 59.6
Archaeology 56.1
Person 53.3
Person 52.5
Person 50.8

Clarifai
created on 2018-10-18

people 100
illustration 100
print 99.9
group 99.7
adult 99.2
man 99.1
engraving 98.6
art 98.5
many 98.4
woodcut 98
cavalry 96.9
administration 96.6
weapon 96.5
leader 96.4
lithograph 96.1
vehicle 95.9
military 95.3
war 93.3
skirmish 93.1
several 91.3

Imagga
created on 2018-10-18

sketch 100
drawing 100
representation 100
art 28
vintage 24.8
grunge 23
design 20.8
retro 19.7
old 18.8
silhouette 17.4
ancient 17.3
antique 16.5
decoration 15.8
graphic 14.6
man 12.8
paint 12.7
history 12.5
pattern 12.3
black 12
style 11.9
texture 11.8
clip art 11.1
wall 11.1
aged 10.9
painting 10.8
frame 10.8
cartoon 10.7
symbol 10.1
letter 10.1
decorative 10
culture 9.4
money 9.4
flower 9.2
religion 9
creative 8.8
stamp 8.7
paper 8.6
horse 8.5
business 8.5
finance 8.5
wallpaper 8.4
currency 8.1
ornament 7.8
us 7.7
dollar 7.4
backgrounds 7.3
border 7.2
animal 7.1
decor 7.1
architecture 7

Google
created on 2018-10-18

art 80.7
horse like mammal 79.9
history 75.9
visual arts 60
black and white 57.6
illustration 57.5
human behavior 50.9

Microsoft
created on 2018-10-18

text 100
book 99.9
posing 58.3
old 46.8
vintage 28.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99%
Angry 1.3%
Calm 9.8%
Confused 2.5%
Disgusted 3%
Surprised 81.3%
Happy 1%
Sad 1.1%

AWS Rekognition

Age 26-43
Gender Male, 98.2%
Angry 4.5%
Disgusted 2.4%
Sad 2.4%
Happy 1.3%
Confused 5.8%
Calm 58.7%
Surprised 24.9%

AWS Rekognition

Age 26-43
Gender Male, 94.7%
Confused 3.8%
Angry 4.2%
Disgusted 1.3%
Calm 54%
Happy 5.1%
Surprised 17.6%
Sad 14.1%

AWS Rekognition

Age 26-43
Gender Male, 99.4%
Surprised 4.1%
Disgusted 4.7%
Sad 7.6%
Confused 7.6%
Happy 1.6%
Angry 68.8%
Calm 5.6%

AWS Rekognition

Age 29-45
Gender Male, 99.1%
Disgusted 1%
Angry 4.8%
Confused 7.3%
Happy 0.6%
Calm 21.7%
Surprised 61.2%
Sad 3.5%

AWS Rekognition

Age 23-38
Gender Female, 53.7%
Surprised 45.5%
Happy 45.1%
Calm 53.3%
Sad 45.5%
Disgusted 45.3%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 23-38
Gender Male, 97.1%
Sad 3%
Disgusted 3.2%
Angry 5.8%
Happy 4.9%
Confused 8.6%
Surprised 54.5%
Calm 19.9%

AWS Rekognition

Age 45-65
Gender Male, 97.1%
Confused 11.3%
Angry 9.7%
Surprised 7.9%
Disgusted 8.9%
Happy 19.9%
Calm 27.9%
Sad 14.4%

AWS Rekognition

Age 27-44
Gender Male, 79.1%
Confused 3.8%
Happy 1.2%
Disgusted 17%
Calm 1.3%
Surprised 72.2%
Sad 0.4%
Angry 4.1%

AWS Rekognition

Age 23-38
Gender Male, 96.5%
Calm 0%
Confused 0.2%
Sad 0%
Disgusted 99.4%
Happy 0%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Disgusted 49.5%
Calm 49.7%
Sad 49.6%
Angry 49.7%
Confused 49.7%
Happy 49.5%
Surprised 49.7%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Sad 45.7%
Confused 45.4%
Disgusted 47.6%
Surprised 46.5%
Happy 46.7%
Angry 47%
Calm 46.1%

AWS Rekognition

Age 23-38
Gender Female, 52.4%
Surprised 45.5%
Angry 45.6%
Sad 45.4%
Calm 52.3%
Confused 45.1%
Disgusted 45.8%
Happy 45.2%

AWS Rekognition

Age 45-66
Gender Female, 53.4%
Confused 45.2%
Angry 46.4%
Surprised 45.3%
Disgusted 45.8%
Happy 45.6%
Calm 45.3%
Sad 51.4%

AWS Rekognition

Age 38-59
Gender Male, 54.8%
Happy 45.3%
Confused 45.2%
Calm 48.5%
Surprised 45.1%
Disgusted 45.3%
Sad 46.8%
Angry 48.8%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Sad 50%
Surprised 49.5%
Angry 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.5%
Calm 49.7%

AWS Rekognition

Age 23-38
Gender Male, 54.6%
Confused 45.8%
Happy 45.2%
Calm 46.9%
Surprised 45.3%
Disgusted 45.3%
Sad 50%
Angry 46.5%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Surprised 49.6%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Calm 50.3%
Disgusted 49.5%
Sad 49.5%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Angry 49.5%
Surprised 49.6%
Sad 49.6%
Happy 49.5%
Confused 49.5%
Calm 50%
Disgusted 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Calm 49.6%
Angry 49.6%
Surprised 49.5%
Sad 50.2%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 38-57
Gender Male, 50.1%
Calm 49.7%
Surprised 49.5%
Angry 49.6%
Happy 49.6%
Disgusted 50%
Confused 49.5%
Sad 49.6%

AWS Rekognition

Age 29-45
Gender Male, 94%
Sad 1.2%
Calm 91%
Confused 1.1%
Surprised 2.9%
Happy 1.9%
Disgusted 0.2%
Angry 1.6%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Calm 49.8%
Sad 47.9%
Happy 45.1%
Surprised 45.4%
Angry 45.9%
Confused 45.5%
Disgusted 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Confused 45.1%
Angry 51.1%
Disgusted 46%
Sad 45.7%
Calm 46.5%
Happy 45.1%
Surprised 45.4%

AWS Rekognition

Age 11-18
Gender Female, 53.3%
Confused 45.2%
Disgusted 45.2%
Calm 46.8%
Sad 51.7%
Surprised 45.3%
Happy 45.3%
Angry 45.4%

AWS Rekognition

Age 9-14
Gender Male, 50.4%
Calm 49.6%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Disgusted 50.2%
Confused 49.5%
Sad 49.6%

AWS Rekognition

Age 35-52
Gender Male, 53.6%
Disgusted 45.2%
Angry 45.8%
Confused 45.2%
Happy 45.2%
Calm 51.3%
Surprised 45.2%
Sad 46.9%

AWS Rekognition

Age 23-38
Gender Male, 50.4%
Sad 50.4%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Calm 49.6%
Disgusted 49.6%
Confused 49.6%
Sad 49.6%
Angry 49.6%
Surprised 49.6%
Happy 50%

AWS Rekognition

Age 57-77
Gender Female, 50.8%
Surprised 45%
Happy 45%
Angry 45.2%
Calm 45.9%
Sad 53.8%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Male, 50.2%
Calm 49.6%
Disgusted 50.3%
Confused 49.5%
Sad 49.5%
Angry 49.6%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 17-27
Gender Female, 51%
Confused 45.1%
Angry 45.2%
Surprised 45.1%
Disgusted 54.2%
Happy 45%
Calm 45.2%
Sad 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 50.1%
Disgusted 49.5%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Confused 49.6%
Sad 49.6%

AWS Rekognition

Age 45-65
Gender Male, 50.5%
Angry 49.5%
Disgusted 49.5%
Happy 49.6%
Calm 50.1%
Sad 49.8%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 49-69
Gender Male, 51.9%
Confused 45.4%
Happy 45.8%
Disgusted 47.7%
Calm 45.6%
Surprised 45.5%
Sad 48.7%
Angry 46.3%

AWS Rekognition

Age 35-52
Gender Male, 50.7%
Surprised 0.2%
Happy 0.1%
Confused 1%
Angry 0.2%
Calm 1.3%
Disgusted 0.1%
Sad 97.1%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Sad 49.6%
Happy 49.6%
Surprised 49.6%
Disgusted 49.6%
Confused 49.6%
Angry 49.6%
Calm 50%

AWS Rekognition

Age 45-65
Gender Female, 50.5%
Confused 49.5%
Disgusted 49.5%
Calm 49.5%
Sad 49.7%
Surprised 49.6%
Happy 50%
Angry 49.6%

AWS Rekognition

Age 45-66
Gender Female, 50.2%
Surprised 45.1%
Happy 45.6%
Calm 45.1%
Sad 53.8%
Disgusted 45.1%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 38-59
Gender Female, 50.5%
Disgusted 49.5%
Sad 49.7%
Calm 50.2%
Angry 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Horse 87.4%
Painting 84.3%

Categories

Imagga

paintings art 99.7%
streetview architecture 0.1%
beaches seaside 0.1%

Text analysis

Amazon

DIXIE
GLORY
GLORY HALLELUAH
HALLELUAH
HARPER'S
HARPER'S WEEKLY.
WEEKLY.
THE
The
THE SONGS THE WAIL
WAIL
SONGS
LET BENONDE

Google

45
The
bold
soldier
boy
b
IIFT
BEHIND
DIXIE
GLORY
THE
SONGS
OF
WAR
45 gues mar The bold soldier boy el b GULL IIFT,BEHIND MR DIXIE GLORY HALLELUA THE SONGS OF THE WAR
gues
mar
el
GULL
,
MR
HALLELUA