Human Generated Data

Title

Untitled (The ceremony for the driving of the golden spike at Promontory Summit, Utah)
Date

May 10, 1869
People

Artist: Andrew Joseph Russell, American 1830 - 1902
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1966

Human Generated Data

Title

Untitled (The ceremony for the driving of the golden spike at Promontory Summit, Utah)

People

Artist: Andrew Joseph Russell, American 1830 - 1902

Date

May 10, 1869

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.7
Human 98.7
Person 98.4
Person 98.3
Person 98.2
Nature 98
Person 97.9
Person 97.1
Person 95.6
Outdoors 95.1
Person 92.6
Person 91.4
Person 91.1
Person 90.4
Person 90.3
Person 89.5
Person 88.8
Person 87.7
Military 87.4
Military Uniform 87.4
Person 85.2
Person 83
Person 82.2
Snow 80.5
Person 78.5
Person 78.5
Winter 75.6
Person 75.4
Storm 73.2
Armored 72.2
Army 72.2
Person 71.7
People 71.5
Person 69.6
Person 68.9
Crowd 67.2
Person 66.9
Funeral 63.2
Blizzard 59.8
Soldier 56
Troop 55.3

Imagga
created on 2022-01-23

snow 100
weather 100
winter 40.9
landscape 37.9
season 31.2
cold 31
forest 30.5
tree 28.5
frost 25
trees 24
frozen 23.9
grunge 23.8
ice 23.2
sky 21
scenery 19.8
outdoors 19.4
rural 19.4
vintage 19
city 18.3
scene 18.2
park 17.3
old 16.7
outdoor 16.1
scenic 15.8
snowy 15.6
seasonal 14.9
structure 14.4
woods 14.3
paper 14.1
texture 13.9
antique 13.9
light 13.4
countryside 12.8
aged 12.7
morning 12.7
wood 12.5
architecture 12.5
old fashioned 12.4
ancient 12.1
travel 12
branch 11.9
frame 11.7
space 11.6
wallpaper 11.5
retro 11.5
country 11.4
sun 11.3
grain 11.1
fall 10.9
freeze 10.7
fog 10.6
grungy 10.4
day 10.2
field 10
tourism 9.9
history 9.8
icy 9.8
scenics 9.6
worn 9.6
rough 9.1
landmark 9
black 9
plant 9
sunlight 8.9
mountain 8.9
snowing 8.9
autumn 8.8
covered 8.7
natural 8.7
artistic 8.7
stain 8.6
chandelier 8.6
rustic 8.6
empty 8.6
town 8.4
silhouette 8.3
historic 8.2
environment 8.2
pattern 8.2
border 8.1
dirty 8.1
building 8.1
water 8
cool 8
snowfall 7.9
frosty 7.8
nobody 7.8
storm 7.7
obsolete 7.7
mountains 7.4
backgrounds 7.3
yellow 7.3
art 7.2
river 7.1

Google
created on 2022-01-23

Plant 94.1
Art 84.4
People 79.9
Adaptation 79.3
Font 74.9
Visual arts 68.5
Vintage clothing 67.2
Painting 67.1
Paper product 67
History 66.6
Event 66.2
Illustration 66.1
Room 65
Stock photography 64.2
Crowd 63.1
Landscape 60.8
Photographic paper 57.8
Collection 57.4
Photograph album 56.3
Working animal 52.4

Microsoft
created on 2022-01-23

old 90.3
text 84.2
tree 80.5
sky 72.1
group 70.9
altar 23.3

Face analysis

Amazon

AWS Rekognition

Age 18-24
Gender Male, 95.5%
Calm 93.8%
Angry 2.3%
Sad 1.4%
Happy 0.9%
Confused 0.5%
Disgusted 0.4%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 14-22
Gender Male, 62.2%
Calm 98.7%
Fear 0.4%
Sad 0.4%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 94%
Calm 90.4%
Disgusted 3.8%
Angry 2.1%
Happy 1.5%
Confused 0.7%
Surprised 0.6%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Female, 99.5%
Calm 57.6%
Sad 25.3%
Surprised 8.6%
Happy 2.7%
Fear 2.5%
Angry 1.2%
Disgusted 1.1%
Confused 1%

AWS Rekognition

Age 28-38
Gender Male, 84.3%
Calm 99.3%
Happy 0.2%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 94.8%
Happy 1.6%
Confused 1%
Sad 1%
Disgusted 0.6%
Angry 0.6%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 89.5%
Calm 94.9%
Sad 1.4%
Disgusted 1%
Happy 0.9%
Angry 0.7%
Surprised 0.4%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 97.6%
Disgusted 35.4%
Calm 18.8%
Sad 13.5%
Confused 10%
Happy 7.6%
Angry 5.8%
Surprised 5.8%
Fear 3%

AWS Rekognition

Age 30-40
Gender Female, 80.5%
Calm 90.4%
Happy 7.5%
Sad 0.7%
Disgusted 0.4%
Surprised 0.3%
Angry 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 65.6%
Calm 92.9%
Sad 3.8%
Confused 0.9%
Happy 0.8%
Angry 0.6%
Fear 0.5%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 45-53
Gender Male, 91%
Calm 99.4%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 99.5%
Calm 88.8%
Sad 3.5%
Angry 2.7%
Disgusted 1.7%
Surprised 1.3%
Confused 0.8%
Happy 0.7%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 97.7%
Happy 86.8%
Calm 4.9%
Confused 2%
Angry 1.5%
Sad 1.5%
Disgusted 1.3%
Surprised 1.1%
Fear 0.8%

AWS Rekognition

Age 18-26
Gender Female, 57%
Calm 97%
Sad 1.4%
Angry 0.6%
Happy 0.2%
Fear 0.2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 35-43
Gender Male, 94.9%
Calm 81.9%
Angry 5.2%
Happy 3.9%
Sad 3%
Confused 2.2%
Disgusted 1.7%
Surprised 1.6%
Fear 0.6%

AWS Rekognition

Age 45-53
Gender Male, 99.6%
Calm 58.5%
Happy 14.7%
Surprised 11.7%
Sad 4.8%
Angry 3.6%
Confused 3.3%
Disgusted 2.2%
Fear 1.3%

AWS Rekognition

Age 21-29
Gender Male, 81.6%
Calm 78.4%
Happy 18.4%
Sad 1.2%
Confused 0.6%
Angry 0.5%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 16-24
Gender Male, 73.9%
Calm 92.4%
Happy 2.2%
Confused 1.9%
Sad 1.3%
Angry 1%
Surprised 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 18-26
Gender Male, 96.6%
Calm 59.6%
Fear 17.9%
Sad 8.6%
Happy 8.1%
Confused 1.9%
Disgusted 1.7%
Angry 1.2%
Surprised 1%

AWS Rekognition

Age 24-34
Gender Female, 90.6%
Calm 73.7%
Fear 11.2%
Disgusted 5.6%
Sad 2.3%
Surprised 2.2%
Happy 1.8%
Confused 1.8%
Angry 1.4%

AWS Rekognition

Age 10-18
Gender Male, 60.8%
Calm 85.3%
Angry 7.3%
Sad 3.2%
Confused 1.4%
Fear 0.8%
Surprised 0.8%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 25-35
Gender Male, 95.7%
Calm 68.3%
Sad 14.2%
Happy 9.5%
Angry 2.6%
Surprised 1.5%
Fear 1.3%
Confused 1.3%
Disgusted 1.2%

AWS Rekognition

Age 16-22
Gender Male, 97.7%
Happy 60.6%
Calm 32.7%
Angry 2.3%
Sad 1.5%
Surprised 1.1%
Disgusted 1%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Male, 93.9%
Happy 64%
Calm 9.8%
Disgusted 6.4%
Angry 5.2%
Surprised 4.5%
Sad 4.5%
Confused 4.3%
Fear 1.3%

AWS Rekognition

Age 22-30
Gender Male, 77.6%
Calm 90.2%
Sad 3.8%
Happy 2.7%
Confused 1.3%
Angry 0.6%
Disgusted 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Female, 88.2%
Calm 76.3%
Sad 17.8%
Happy 2.1%
Angry 1.7%
Confused 0.8%
Fear 0.6%
Surprised 0.4%
Disgusted 0.4%

AWS Rekognition

Age 19-27
Gender Female, 77.5%
Calm 70.2%
Sad 18.5%
Happy 4.3%
Confused 4.3%
Angry 0.9%
Disgusted 0.8%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 22-30
Gender Female, 64.7%
Happy 74.5%
Calm 13.9%
Sad 4.9%
Fear 2.3%
Angry 1.3%
Confused 1.2%
Surprised 1%
Disgusted 0.7%

AWS Rekognition

Age 24-34
Gender Male, 57.5%
Calm 88.2%
Sad 5%
Happy 3.8%
Confused 1.4%
Angry 0.6%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 92.3%
Calm 85.5%
Sad 7.4%
Happy 3.1%
Confused 1.4%
Angry 1.1%
Disgusted 0.7%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Male, 92.4%
Calm 93.2%
Happy 3.2%
Sad 1.4%
Confused 0.9%
Angry 0.6%
Fear 0.3%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Calm 62.5%
Disgusted 23.8%
Sad 6.9%
Angry 2.6%
Happy 2.4%
Surprised 0.6%
Fear 0.6%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Male, 90.9%
Calm 57.9%
Sad 20.2%
Happy 12.3%
Surprised 2.9%
Angry 2.4%
Disgusted 2.4%
Confused 1.1%
Fear 0.8%

AWS Rekognition

Age 23-33
Gender Male, 51.2%
Calm 66.5%
Happy 20.5%
Sad 4.7%
Angry 3.7%
Confused 1.7%
Fear 1.3%
Surprised 0.9%
Disgusted 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 94.8%
Sad 1.8%
Angry 1.8%
Disgusted 0.5%
Surprised 0.3%
Confused 0.3%
Happy 0.3%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Female, 86.1%
Calm 92.3%
Sad 3.1%
Fear 2.1%
Happy 0.9%
Confused 0.6%
Angry 0.4%
Disgusted 0.4%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Male, 85.5%
Calm 97.2%
Sad 2.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 24-34
Gender Male, 63.1%
Calm 92.4%
Sad 3.4%
Confused 1.2%
Happy 0.9%
Angry 0.8%
Disgusted 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Male, 98.5%
Calm 89.1%
Angry 3.3%
Happy 3.1%
Sad 2.8%
Confused 0.7%
Disgusted 0.4%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99%
Calm 95.5%
Happy 3.2%
Angry 0.4%
Sad 0.4%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 97.8%
Calm 43.7%
Happy 27.1%
Surprised 9%
Angry 7.5%
Sad 4.2%
Disgusted 3.7%
Fear 3.3%
Confused 1.5%

AWS Rekognition

Age 30-40
Gender Male, 91.3%
Calm 69.2%
Confused 7.7%
Disgusted 7.3%
Angry 6.4%
Sad 3.5%
Surprised 3.4%
Happy 1.5%
Fear 1%

AWS Rekognition

Age 14-22
Gender Male, 98.1%
Calm 83.6%
Happy 8.4%
Sad 2.9%
Confused 1.9%
Angry 1.9%
Fear 0.4%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 10-18
Gender Female, 87%
Calm 65.5%
Happy 14.3%
Sad 7.2%
Confused 5.4%
Fear 4.7%
Angry 1.2%
Surprised 1%
Disgusted 0.7%

AWS Rekognition

Age 22-30
Gender Male, 84.3%
Calm 61%
Happy 22.9%
Sad 6.2%
Disgusted 3.9%
Surprised 2.3%
Angry 2%
Confused 1%
Fear 0.8%

AWS Rekognition

Age 22-30
Gender Female, 66.3%
Calm 96%
Happy 1.8%
Sad 1.3%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 97.9%
Calm 90.7%
Sad 4.5%
Happy 1.5%
Angry 0.9%
Surprised 0.7%
Confused 0.6%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 18-24
Gender Male, 88.9%
Calm 78.8%
Angry 5.5%
Sad 4.9%
Fear 3.1%
Confused 2.8%
Happy 2%
Surprised 1.6%
Disgusted 1.2%

AWS Rekognition

Age 9-17
Gender Male, 85.6%
Calm 37.9%
Sad 23.2%
Fear 15.4%
Confused 6.9%
Happy 5.9%
Disgusted 3.9%
Angry 3.7%
Surprised 3.1%

AWS Rekognition

Age 16-22
Gender Male, 86.1%
Calm 65%
Sad 18.6%
Happy 5.4%
Confused 3.9%
Angry 3.6%
Fear 1.5%
Disgusted 1.2%
Surprised 0.8%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 47.1%
Happy 31.2%
Surprised 6.6%
Sad 5%
Angry 4.1%
Disgusted 2.6%
Fear 1.9%
Confused 1.5%

AWS Rekognition

Age 24-34
Gender Female, 94.8%
Calm 67.4%
Happy 19.1%
Sad 3.8%
Confused 2.8%
Fear 2.8%
Angry 2%
Surprised 1.2%
Disgusted 0.9%

AWS Rekognition

Age 19-27
Gender Female, 79.1%
Calm 90.8%
Surprised 2.1%
Happy 1.9%
Angry 1.4%
Sad 1.3%
Confused 1%
Fear 1%
Disgusted 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 64.4%
Happy 24.9%
Surprised 3.3%
Angry 2.3%
Sad 1.9%
Disgusted 1.6%
Confused 1%
Fear 0.5%

AWS Rekognition

Age 16-24
Gender Female, 94.2%
Calm 87.9%
Happy 5.3%
Sad 2%
Angry 1.8%
Confused 1%
Fear 0.8%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Calm 79.9%
Sad 9.4%
Happy 7%
Angry 1.2%
Confused 0.9%
Surprised 0.6%
Fear 0.5%
Disgusted 0.5%

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

an old photo of a group of people posing for a picture 68.4%
an old photo of a group of people in a room 68.3%
an old photo of a group of people posing for the camera 64.5%