Human Generated Data

Title

Untitled (group portrait of clergymen and altar boys on front steps of church)

Date

1951

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9356

Human Generated Data

Title

Untitled (group portrait of clergymen and altar boys on front steps of church)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Handrail 98.9
Banister 98.9
Person 98.4
Human 98.4
Person 98.4
Person 94.7
Architecture 94.2
Building 94.2
Person 92.2
Person 90.3
Staircase 85.4
Apparel 84.7
Clothing 84.7
Person 83.3
Person 81.6
Person 76.3
Person 71.5
Tower 68.8
Steeple 68.8
Spire 68.8
Person 68.4
Railing 66.6
Pillar 63.7
Column 63.7
Arched 61.8
Arch 61.8
Worship 57.8
Pedestrian 56
Home Decor 55.2

Imagga
created on 2022-01-23

architecture 57.8
building 43.1
city 32.4
percussion instrument 31.5
church 31.4
tourism 29.7
musical instrument 28.7
travel 28.2
old 27.9
upright 26.8
landmark 26.2
cathedral 24.8
piano 24.8
religion 24.2
stone 23.6
monument 23.3
history 23.3
column 21.9
keyboard instrument 21.8
ancient 21.6
famous 21.4
palace 19.6
stringed instrument 19.2
arch 19.1
statue 19
house 17.3
historic 16.5
facade 15.9
urban 15.7
tourist 15.7
marimba 15
culture 14.5
sculpture 14.4
town 13.9
window 13.9
street 13.8
university 13.8
structure 13.4
catholic 13.1
exterior 12.9
sky 12.1
antique 12.1
marble 11.7
door 11.4
historical 11.3
religious 11.2
hall 10.9
square 10.9
dome 10.6
medieval 10.6
attraction 10.5
art 10.4
scene 10.4
construction 10.3
wall 10.3
balcony 10.2
holiday 10
vintage 9.9
tower 9.8
place 9.3
traditional 9.1
style 8.9
basilica 8.9
catholicism 8.8
entrance 8.7
brick 8.5
people 8.4
detail 8
century 7.8
roman 7.8
worship 7.7
architectural 7.7
spirituality 7.7
windows 7.7
united 7.6
cross 7.5
temple 7.5
residence 7.5
fountain 7.4
water 7.3
design 7.3
day 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

church 95.4
black and white 89.4
building 85.4
clothing 84.4
person 79.7
statue 75.4
white 69.1
man 53
wedding dress 51.2
arch 33.2
altar 29
pew 21.5
colonnade 10.9

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 83.3%
Happy 36.2%
Sad 35.8%
Calm 14.3%
Fear 6.1%
Angry 3.8%
Disgusted 1.9%
Surprised 1.3%
Confused 0.5%

AWS Rekognition

Age 39-47
Gender Female, 99.7%
Calm 68.8%
Happy 22.6%
Fear 1.9%
Confused 1.8%
Disgusted 1.7%
Surprised 1.6%
Sad 1.2%
Angry 0.4%

AWS Rekognition

Age 25-35
Gender Female, 58.9%
Calm 93.9%
Disgusted 2%
Confused 1.1%
Sad 0.9%
Happy 0.7%
Fear 0.6%
Surprised 0.4%
Angry 0.4%

AWS Rekognition

Age 53-61
Gender Male, 96.6%
Calm 80.5%
Confused 6.6%
Angry 3.6%
Surprised 2.1%
Happy 2.1%
Fear 1.8%
Sad 1.7%
Disgusted 1.7%

AWS Rekognition

Age 28-38
Gender Male, 97.1%
Calm 97.9%
Fear 0.9%
Sad 0.4%
Disgusted 0.4%
Surprised 0.2%
Happy 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99%
Fear 48.8%
Sad 27.8%
Happy 9.9%
Angry 6.1%
Calm 2.9%
Disgusted 2%
Surprised 1.6%
Confused 0.9%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 86.1%
Sad 9%
Happy 1.9%
Fear 1%
Disgusted 0.8%
Angry 0.5%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 43-51
Gender Female, 52.6%
Calm 93.1%
Disgusted 4%
Happy 1%
Surprised 0.6%
Sad 0.5%
Confused 0.4%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 35-43
Gender Male, 92%
Calm 93%
Disgusted 2.5%
Confused 1.2%
Happy 0.9%
Sad 0.9%
Fear 0.6%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 27-37
Gender Male, 98.6%
Calm 45.7%
Sad 42.9%
Confused 6.2%
Happy 3%
Disgusted 1%
Surprised 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Female, 90.5%
Sad 96.6%
Happy 1%
Calm 0.8%
Disgusted 0.5%
Angry 0.3%
Surprised 0.3%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 31-41
Gender Female, 57.2%
Calm 96.3%
Happy 0.9%
Disgusted 0.7%
Sad 0.6%
Confused 0.4%
Fear 0.4%
Angry 0.4%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Calm 92.2%
Sad 2.4%
Disgusted 2%
Happy 0.9%
Surprised 0.8%
Angry 0.7%
Fear 0.6%
Confused 0.4%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 99.6%
Sad 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%
Surprised 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 76.8%
Sad 41.1%
Calm 28.2%
Fear 12.3%
Happy 8.1%
Disgusted 4.1%
Confused 2.9%
Angry 2.5%
Surprised 0.8%

AWS Rekognition

Age 28-38
Gender Male, 96.3%
Happy 29.9%
Calm 23.4%
Confused 15.4%
Disgusted 14.2%
Sad 6.2%
Fear 4%
Angry 3.5%
Surprised 3.3%

AWS Rekognition

Age 35-43
Gender Male, 97.7%
Calm 82.6%
Happy 4.7%
Confused 4.6%
Surprised 3.1%
Sad 2.4%
Fear 1.3%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 28-38
Gender Male, 81.7%
Calm 96.9%
Sad 1.7%
Fear 0.6%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.1%
Sad 48.5%
Calm 26.5%
Happy 15.1%
Fear 3.4%
Angry 2.5%
Confused 1.7%
Disgusted 1.2%
Surprised 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 98.4%
Staircase 85.4%

Captions

Microsoft

a group of people sitting on a bench in front of a building 76.3%
a group of people sitting on a bench in front of a brick building 65.1%
a group of people on a bench in front of a building 65%

Text analysis

Amazon

CEI
KODVK-EVEELA
CREAM