Human Generated Data

Title

Untitled (group shot, Capitol Building)

Date

c.1940

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22323

Human Generated Data

Title

Untitled (group shot, Capitol Building)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

c.1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.7
Human 99.7
Architecture 99.4
Building 99.4
Dome 99.4
Person 99.2
Person 99
Person 98.3
Person 98.2
Person 97.7
Person 97.4
Person 97.3
Person 96.6
Person 96.4
Person 94.5
Person 94.4
Person 92
Person 91.2
Person 88.3
Person 85.8
Person 82.7
Steeple 81.8
Tower 81.8
Spire 81.8
Face 78.8
Person 78.5
Person 76.5
Temple 71.7
Person 71.1
Downtown 64.9
City 64.9
Town 64.9
Urban 64.9
Clothing 63.1
Apparel 63.1
Shrine 61.1
Worship 61.1
Nature 59.6
Pillar 58.5
Column 58.5
Pedestrian 58.3
Tree 58
Plant 58
People 55.6
Person 42

Imagga
created on 2022-03-11

structure 75.6
fountain 72.9
building 70.8
architecture 63.6
dome 50.3
palace 44
religion 32.3
monument 31.8
church 31.5
temple 29.8
city 29.2
house 29.1
tourism 28.9
travel 28.9
cathedral 28.2
residence 28.1
landmark 28
night 27.6
history 26.9
old 26.5
sky 24.9
historic 24.8
capital 24.7
tourist 20.9
national 20
famous 19.6
culture 18.8
golden 17.2
picket fence 16.7
orthodox 16.7
fence 16
gold 15.7
faith 15.3
cross 15.1
historical 15.1
place 14.9
statue 14.9
united 14.3
roof 14.2
hill 14.1
government 13.7
holy 13.5
dwelling 13.5
capitol 12.9
congress 12.9
states 12.6
school 12.5
god 12.5
column 12.4
ancient 12.1
square 11.8
worship 11.6
town 11.2
senate 10.9
cupola 10.8
st 10.7
saint 10.6
stone 10.6
light 10
barrier 10
politics 9.8
symbol 9.4
religious 9.4
traditional 9.2
federal 8.9
university 8.8
facade 8.8
illuminated 8.6
dark 8.4
lights 8.4
tower 8.1
sacred 7.8
law 7.8
district 7.8
winter 7.7
shrine 7.6
brick 7.5
exterior 7.4
art 7.2
trees 7.1
urban 7

Google
created on 2022-03-11

Black 89.6
World 88.9
Tree 84.4
Style 83.8
Black-and-white 82.6
Plant 80.6
Tints and shades 77.3
Snapshot 74.3
Symmetry 73.2
Monochrome 72.3
Monochrome photography 71.6
Dome 70.8
Facade 70.7
Dome 69.4
Monument 68.2
Vintage clothing 67.4
Holy places 67
Event 66.6
Building 65.7
Finial 65.5

Microsoft
created on 2022-03-11

outdoor 98.4
black and white 87.4
tree 79.1
sky 71.6
text 60.1
church 58.1
night 56.8
government building 28.7

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 78.9%
Calm 99.8%
Sad 0%
Surprised 0%
Confused 0%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Male, 52.8%
Calm 88%
Happy 6.5%
Sad 1.8%
Surprised 1.2%
Confused 0.9%
Disgusted 0.6%
Fear 0.5%
Angry 0.5%

AWS Rekognition

Age 41-49
Gender Male, 98.4%
Happy 51.6%
Calm 47.1%
Fear 0.4%
Surprised 0.3%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 6-16
Gender Female, 99.1%
Calm 89.7%
Happy 6.8%
Surprised 1.2%
Fear 1.1%
Sad 0.4%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 42-50
Gender Female, 70.4%
Calm 97.8%
Happy 1.6%
Sad 0.3%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.4%
Happy 64.1%
Calm 33.4%
Surprised 0.9%
Sad 0.6%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Female, 76.9%
Calm 98.2%
Happy 1%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 98.8%
Happy 96.5%
Calm 1.5%
Disgusted 0.7%
Confused 0.4%
Sad 0.3%
Surprised 0.3%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 16-22
Gender Female, 54.7%
Happy 49.1%
Calm 38.4%
Sad 7%
Angry 2.1%
Disgusted 1.4%
Fear 0.8%
Confused 0.6%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Male, 58.9%
Calm 93.7%
Happy 6%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Female, 98.6%
Calm 71.7%
Fear 11.7%
Happy 7.9%
Sad 3.9%
Surprised 1.7%
Disgusted 1.4%
Angry 1.3%
Confused 0.4%

AWS Rekognition

Age 38-46
Gender Male, 65.6%
Calm 95.1%
Happy 2.3%
Sad 0.9%
Disgusted 0.5%
Angry 0.5%
Surprised 0.4%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 92.2%
Calm 75.3%
Happy 22.8%
Confused 0.7%
Fear 0.4%
Surprised 0.3%
Disgusted 0.3%
Sad 0.2%
Angry 0.2%

AWS Rekognition

Age 7-17
Gender Female, 99.8%
Happy 97.2%
Calm 1.2%
Confused 0.8%
Fear 0.4%
Surprised 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Female, 76.5%
Calm 77.6%
Fear 8.6%
Happy 5.1%
Sad 4.2%
Confused 2.3%
Angry 1.2%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 25-35
Gender Male, 91.9%
Calm 48.7%
Fear 34.3%
Sad 7.6%
Happy 4.8%
Surprised 2%
Confused 1.5%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 43-51
Gender Female, 78.3%
Calm 79.7%
Happy 15.5%
Disgusted 1.7%
Sad 0.9%
Surprised 0.7%
Confused 0.6%
Angry 0.6%
Fear 0.2%

AWS Rekognition

Age 16-24
Gender Male, 54%
Happy 81.4%
Calm 17.5%
Surprised 0.4%
Confused 0.3%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Female, 81.3%
Calm 64.1%
Sad 17.3%
Happy 8.4%
Surprised 2.8%
Disgusted 2%
Fear 2%
Confused 1.9%
Angry 1.5%

AWS Rekognition

Age 37-45
Gender Male, 92%
Calm 99.3%
Sad 0.4%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 87.1%
Happy 95.4%
Calm 2.4%
Fear 0.8%
Surprised 0.7%
Sad 0.3%
Angry 0.3%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 55.7%
Calm 83.4%
Surprised 8.6%
Happy 2.9%
Angry 1.6%
Fear 1.3%
Disgusted 1%
Sad 0.8%
Confused 0.4%

AWS Rekognition

Age 30-40
Gender Female, 82%
Calm 98.5%
Sad 0.4%
Confused 0.3%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0%

AWS Rekognition

Age 37-45
Gender Female, 95.9%
Calm 69.5%
Happy 21.7%
Sad 2.5%
Surprised 2.3%
Fear 2.3%
Disgusted 0.9%
Angry 0.6%
Confused 0.3%

AWS Rekognition

Age 28-38
Gender Female, 58.2%
Happy 58.8%
Calm 38.7%
Sad 0.6%
Surprised 0.5%
Confused 0.4%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Female, 65.6%
Happy 96.9%
Calm 2.6%
Fear 0.2%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.6%
Calm 68.6%
Happy 12.4%
Disgusted 6.7%
Sad 4.6%
Confused 4.2%
Angry 1.9%
Surprised 0.9%
Fear 0.6%

AWS Rekognition

Age 45-51
Gender Female, 99.8%
Calm 87.6%
Sad 5.7%
Happy 1.4%
Fear 1.3%
Surprised 1.1%
Confused 1.1%
Disgusted 0.9%
Angry 0.8%

AWS Rekognition

Age 26-36
Gender Male, 76.7%
Calm 98.6%
Happy 0.4%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Male, 98.5%
Happy 78.6%
Calm 19.9%
Sad 0.6%
Surprised 0.3%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 95.3%
Fear 28.2%
Surprised 18.3%
Confused 16.8%
Calm 12.9%
Angry 9.5%
Happy 6.8%
Disgusted 5.5%
Sad 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a building 81%
a group of people in front of a building 80.9%
a group of people standing in front of a large building 73%

Text analysis

Google

E (( e CT
CT
e
E
((