Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.69

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Person 99.4
Person 98.5
Person 98.4
Person 98.1
Person 97.8
Person 95.6
Nature 95.4
Military 93.8
Outdoors 93.7
Person 93.7
Person 92.7
Military Uniform 90.9
Person 90.7
Person 87.9
Person 87.6
Crowd 85.3
Army 84
Armored 84
People 83.7
Person 83.2
Person 82.7
Person 82.2
Person 80.5
Person 80.3
Building 78.7
Person 77.9
Soldier 77.8
Countryside 71.8
Officer 66
Ground 66
Person 61.7
Rural 60.3
Transportation 58.1
Hut 56.5
Person 55.9
Car 55.2
Vehicle 55.2
Automobile 55.2

Imagga
created on 2022-01-09

plow 50.7
sky 37.8
tool 36.1
wall 30.4
landscape 29.8
travel 26.8
tourism 23.1
sea 20.3
rock 20
sand 19.6
tree 19.2
mountain 18.8
park 18.1
desert 17.3
beach 17.2
rural 16.8
vacation 16.4
scenery 16.3
water 16
scenic 15.8
coast 15.3
clouds 15.2
ocean 15
stone 14.5
house 14.3
summer 14.2
road 13.6
field 13.4
trees 13.4
dairy 13.2
shore 13.2
grass 12.7
ranch 12.6
architecture 12.5
horizon 11.7
farm 11.6
sunrise 11.3
outdoors 11.2
old 11.2
fence 11.1
pen 10.9
land 10.9
national 10.9
outdoor 10.7
country 10.5
building 10.5
england 10.5
structure 10.4
coastline 10.4
cloud 10.3
seaside 10.3
enclosure 10.1
island 10.1
valley 9.6
day 9.4
hill 9.4
waves 9.3
peaceful 9.2
countryside 9.1
erosion 8.8
resort 8.8
natural 8.7
scene 8.7
rocks 8.5
mountains 8.3
snow 8.3
environment 8.2
canyon 7.8
seascape 7.7
city 7.5
tourist 7.4
sun 7.3
tranquil 7.2
cliff 7.2
sunset 7.2
meadow 7.2
holiday 7.2
history 7.2
agriculture 7
weather 7
nobody 7

Google
created on 2022-01-09

Landscape 77.2
Tints and shades 75.4
Sky 74.3
Motor vehicle 69.4
Art 69.2
Military organization 67.3
Visual arts 65.8
Event 65.8
Pole 65.4
History 65.2
Horizon 59.4
Vintage clothing 58.8
Infantry 58.5
Crew 56.4
Paper product 55.8
Working animal 55
Squad 51
Troop 50.2

Microsoft
created on 2022-01-09

outdoor 99.7
sky 98.6
grass 97.6
standing 79.6
person 76.2
field 76.2
group 71.6
old 69.9
white 64.9
black and white 58.8
several 10.1

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Sad 57.6%
Calm 26.7%
Confused 11%
Disgusted 2.2%
Happy 0.9%
Angry 0.8%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 42-50
Gender Male, 83.9%
Surprised 53.2%
Calm 23.4%
Happy 8.3%
Confused 7.3%
Sad 3.9%
Disgusted 1.9%
Fear 1.2%
Angry 0.9%

AWS Rekognition

Age 23-31
Gender Male, 99.1%
Sad 64.1%
Calm 27.2%
Surprised 2.4%
Fear 2.2%
Angry 1.4%
Confused 1%
Happy 0.9%
Disgusted 0.8%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Calm 42.7%
Sad 20.9%
Confused 16.1%
Happy 7.7%
Fear 6.1%
Disgusted 2.9%
Angry 1.8%
Surprised 1.7%

AWS Rekognition

Age 16-22
Gender Female, 84.8%
Calm 96.4%
Sad 2.6%
Happy 0.3%
Fear 0.3%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 99.1%
Calm 48.4%
Disgusted 22.2%
Angry 8.3%
Sad 6.1%
Happy 4.5%
Fear 4.2%
Confused 3.6%
Surprised 2.9%

AWS Rekognition

Age 7-17
Gender Male, 66.4%
Calm 61.2%
Happy 35.2%
Confused 1.4%
Sad 0.7%
Fear 0.7%
Disgusted 0.4%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 35-43
Gender Male, 65.1%
Sad 74.1%
Calm 16.3%
Happy 3.2%
Fear 2.4%
Angry 1.9%
Surprised 0.9%
Disgusted 0.6%
Confused 0.6%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Disgusted 24.8%
Fear 22.9%
Happy 18.9%
Calm 12.3%
Confused 7.5%
Angry 6.1%
Sad 4.5%
Surprised 3.1%

AWS Rekognition

Age 37-45
Gender Male, 86.9%
Happy 97.9%
Disgusted 0.8%
Calm 0.8%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 98.4%
Disgusted 52.1%
Sad 21.4%
Calm 18.6%
Surprised 2.3%
Confused 2.2%
Fear 1.5%
Angry 1%
Happy 0.8%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Sad 54.1%
Calm 22%
Happy 16.3%
Angry 2.3%
Disgusted 2.3%
Confused 1.3%
Fear 1%
Surprised 0.7%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Confused 32.2%
Calm 31.6%
Sad 23.4%
Disgusted 7.2%
Angry 3.2%
Surprised 1.2%
Fear 0.7%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Female, 93.1%
Calm 74.3%
Happy 22.4%
Sad 0.9%
Disgusted 0.6%
Confused 0.5%
Angry 0.5%
Surprised 0.4%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a herd of cattle standing on top of a dirt field 86.9%
a group of cattle standing on top of a dirt field 86.8%
a herd of cattle standing on top of a grass covered field 81.1%

Text analysis

Amazon

any