Human Generated Data

Title

The Seventy-Ninth Regiment (Highlanders) New York State Militia

Date

1861

People

Artist: Winslow Homer, American 1836 - 1910

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of W. G. Russell Allen, M9295

Human Generated Data

Title

The Seventy-Ninth Regiment (Highlanders) New York State Militia

People

Artist: Winslow Homer, American 1836 - 1910

Date

1861

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Person 99.1
Person 99.1
Military 97.4
Military Uniform 97.3
Person 95.7
Person 95
Person 94.7
Person 94.5
Person 94.3
Army 94.2
Armored 94.2
Person 92.1
Person 91.6
Person 90.9
People 88.8
Person 88.1
Person 87.3
Person 85.1
Person 83.8
Art 82
Soldier 81.8
Person 79.1
Troop 74.6
Painting 63.4
Drawing 61.1
Animal 61.1
Bird 61.1
Crowd 58.7

Imagga
created on 2022-02-26

sand 27.7
travel 24.6
landscape 24.5
sky 23.6
tourism 22.3
tree 20.7
private 20.6
desert 18.4
rock 18.2
beach 17.2
water 16.7
sea 16.4
summer 15.4
old 14.6
vacation 13.9
ancient 13.8
ocean 13.4
mountain 13.3
tourist 11.9
tropical 11.9
graffito 11.9
drawing 11.7
trees 11.6
outdoors 11.4
zebra 11.1
snow 11
scenery 10.8
coast 10.8
park 10.7
rural 10.6
stone 10.6
resort 10.4
shore 10.2
sketch 10.1
outdoor 9.9
landmark 9.9
environment 9.9
history 9.8
structure 9.7
architecture 9.4
winter 9.4
palm 9.4
village 9.1
national 9.1
cemetery 8.9
sun 8.9
wild 8.7
lonely 8.7
scene 8.7
decoration 8.5
hill 8.4
lake 8.2
building 8.2
natural 8
wildlife 8
day 7.8
sunny 7.7
cloud 7.7
fishing 7.7
clouds 7.6
rocks 7.5
art 7.5
equine 7.4
dry 7.4
island 7.3
horizon 7.2
holiday 7.2
wall 7.1
grass 7.1
scenic 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 97.8
drawing 93.1
sketch 91.5
outdoor 86.8
old 81.7
person 79.7
people 66.7
group 56.1
posing 45.8
stone 16.3

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 57%
Calm 99.6%
Confused 0.2%
Surprised 0.1%
Fear 0%
Sad 0%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 40.4%
Angry 20.5%
Fear 19.9%
Sad 7.2%
Surprised 3.8%
Happy 3.2%
Disgusted 3.2%
Confused 1.9%

AWS Rekognition

Age 23-31
Gender Female, 74.8%
Disgusted 97.1%
Calm 1.7%
Happy 0.5%
Surprised 0.4%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Sad 0%

AWS Rekognition

Age 22-30
Gender Male, 98.2%
Calm 66.9%
Surprised 14%
Confused 10.4%
Disgusted 3.4%
Happy 2.6%
Angry 1.3%
Fear 1%
Sad 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Disgusted 48.6%
Happy 13.6%
Sad 11.7%
Calm 11.6%
Confused 5.6%
Surprised 3.8%
Angry 3%
Fear 2%

AWS Rekognition

Age 33-41
Gender Male, 65.5%
Calm 35%
Angry 33.3%
Disgusted 18.2%
Fear 4.3%
Sad 2.4%
Confused 2.3%
Surprised 2.3%
Happy 2%

AWS Rekognition

Age 29-39
Gender Male, 95.4%
Calm 98.8%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Sad 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Angry 57.6%
Calm 13.9%
Sad 13.1%
Disgusted 10.4%
Confused 2.3%
Surprised 1%
Happy 0.9%
Fear 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 99.9%
Fear 0.1%
Disgusted 0%
Confused 0%
Sad 0%
Surprised 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 98.3%
Calm 99.7%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 38-46
Gender Male, 99.5%
Calm 98.4%
Sad 0.6%
Angry 0.6%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 88.7%
Fear 34.1%
Calm 27.2%
Disgusted 24.4%
Angry 7.5%
Surprised 3%
Happy 2.4%
Confused 0.9%
Sad 0.5%

AWS Rekognition

Age 34-42
Gender Male, 93.1%
Fear 49.9%
Calm 14.8%
Surprised 10.1%
Happy 9.5%
Angry 4.5%
Sad 4.2%
Disgusted 3.6%
Confused 3.4%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 93.8%
Angry 1.9%
Fear 1%
Disgusted 0.9%
Surprised 0.8%
Happy 0.6%
Sad 0.5%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Male, 96.8%
Calm 90.9%
Disgusted 4.7%
Confused 1.8%
Sad 1%
Angry 0.4%
Surprised 0.4%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Calm 99.4%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 43-51
Gender Male, 99.2%
Calm 96.2%
Angry 1.3%
Surprised 0.6%
Disgusted 0.6%
Confused 0.5%
Happy 0.4%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.4%
Calm 61.2%
Disgusted 34.2%
Happy 1.5%
Angry 1.4%
Surprised 0.7%
Confused 0.4%
Sad 0.3%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 89.1%
Disgusted 9%
Surprised 0.8%
Confused 0.3%
Fear 0.3%
Happy 0.2%
Angry 0.2%
Sad 0.1%

AWS Rekognition

Age 20-28
Gender Male, 96.3%
Calm 95.6%
Surprised 1.6%
Happy 1.6%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Female, 84.6%
Calm 95.2%
Disgusted 1.5%
Surprised 0.9%
Confused 0.8%
Sad 0.6%
Fear 0.4%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 16-22
Gender Male, 99.7%
Calm 97.4%
Disgusted 0.6%
Surprised 0.5%
Happy 0.4%
Angry 0.4%
Confused 0.3%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Female, 54.7%
Calm 98.9%
Confused 0.7%
Surprised 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0.1%
Sad 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 63.4%
Bird 61.1%

Captions

Microsoft

a vintage photo of a group of people posing for a picture 81.7%
a vintage photo of a group of people posing for the camera 78.5%
a group of people posing for a photo 78.4%

Text analysis

Amazon

STATE
NEW
YORK
HARPER'S
THE
HARPER'S WEEKLY.
(HIGHLANDERS)
REGIMENT
WEEKLY.
THE SEVENTY-NINTH REGIMENT (HIGHLANDERS) NEW YORK STATE MILITIA,
SEVENTY-NINTH
-
MILITIA,
GES
STORE

Google

iRGULANDERS)
YORK
MLLITIA
25,
HARPER'S
MAY
1861.]
NEW
iRGULANDERS) NEW YORK STATE MLLITIA MAY 25, 1861.] HARPER'S WEEKLY.
STATE
WEEKLY.