Human Generated Data

Title

Untitled (judges at bench, U.S. Circuit of Appeals Washington DC)

Date

1936

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22240

Human Generated Data

Title

Untitled (judges at bench, U.S. Circuit of Appeals Washington DC)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.6
Human 99.6
Person 99.6
Person 99.3
Indoors 99
Room 99
Person 98.5
Person 98.2
Jury 97
Court 90.5
People 61.5
Judge 57

Imagga
created on 2022-03-11

altar 100
structure 100
architecture 48.7
building 33.4
church 33.3
religion 32.3
monument 30.8
landmark 29.8
travel 27.5
city 27.4
history 26.8
old 24.4
cathedral 24
historic 22.9
statue 22.5
tourism 22.3
sculpture 21.6
famous 21.4
fountain 19.9
stone 19.4
ancient 19
column 18.3
god 18.2
marble 18.1
culture 18
tourist 17.2
historical 16.9
palace 16.1
religious 15.9
art 15.8
temple 15.5
holy 14.4
light 14
square 13.6
faith 13.4
water 13.4
cross 13.2
house 13
pray 12.6
night 12.4
capital 12.3
gold 12.3
interior 11.5
place 11.2
catholic 10.8
saint 10.6
spirituality 10.6
attraction 10.5
golden 10.3
exterior 10.1
traditional 10
tower 9.8
baroque 9.8
arch 9.7
st 9.7
sky 9.6
town 9.3
street 9.2
facade 8.9
catholicism 8.8
sacred 8.8
urban 8.7
wall 8.7
worship 8.7
dome 8.7
inside 8.3
ornate 8.2
home 8
antique 8
museum 7.9
chapel 7.8
orthodox 7.8
destination 7.5
east 7.5
symbol 7.4
holiday 7.2

Google
created on 2022-03-11

Property 94.3
Photograph 94.1
White 92.2
Black 89.9
Textile 87.6
Black-and-white 86.2
Style 84.2
Curtain 82.5
Art 79.7
Monochrome 78.5
Monochrome photography 76.9
Picture frame 76.6
Rectangle 75
Font 74.4
Snapshot 74.3
Event 74
Entertainment 68.8
Decoration 68.1
Room 66.6
Building 65.4

Microsoft
created on 2022-03-11

curtain 95.6
white 66.6
altar 18.7

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.3%
Sad 53.6%
Happy 16.3%
Calm 16.1%
Angry 6.4%
Surprised 2.6%
Confused 2.2%
Disgusted 1.7%
Fear 1.1%

AWS Rekognition

Age 40-48
Gender Male, 99.8%
Sad 52.1%
Confused 19.6%
Calm 15.1%
Happy 4.1%
Angry 4.1%
Disgusted 3%
Surprised 1.3%
Fear 0.7%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 95.1%
Surprised 2.9%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%
Angry 0.3%
Sad 0.2%
Happy 0.2%

AWS Rekognition

Age 37-45
Gender Male, 100%
Happy 45.8%
Calm 25.8%
Sad 15.1%
Confused 6.7%
Surprised 3%
Angry 1.6%
Disgusted 1.2%
Fear 0.8%

AWS Rekognition

Age 52-60
Gender Male, 100%
Sad 84.7%
Confused 13.1%
Happy 0.9%
Angry 0.5%
Calm 0.5%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

an old photo of a person 60.1%

Text analysis

Amazon

8
3
65
2
12
8 R 12 2 4 3
4
R

Google

6
12
5
12 6 5