Human Generated Data

Title

Untitled (group portrait of priest sitting with teenagers in formalwear at front of church)

Date

1936

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9109

Human Generated Data

Title

Untitled (group portrait of priest sitting with teenagers in formalwear at front of church)

People

Artist: Martin Schweig, American 20th century

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9109

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.2
Human 99.2
Poster 97.4
Advertisement 97.4
Person 97.4
Person 96.3
Person 94.8
Person 94.1
Person 92.9
Person 91.5
Person 86.6
Person 86.3
Art 84.6
People 78.3
Person 67.8
Person 67
Person 65.6
Painting 63.8
Crowd 59
Drawing 56.6
Person 54.8
Person 46.7
Person 42.4

Clarifai
created on 2023-10-26

people 99.9
many 99.3
group 99.3
child 98.9
education 95.7
adult 95.5
man 94.6
group together 94.5
boy 94.1
school 91.2
woman 90.9
crowd 86.5
son 84.3
spectator 83.8
music 82.1
athlete 79.3
sit 78.7
war 76.9
room 76.9
portrait 76

Imagga
created on 2022-01-23

tray 34.3
receptacle 27.8
container 22.8
black 17.4
vintage 17.3
old 16.7
art 15.3
people 15
circa 13.8
silhouette 13.2
retro 13.1
grunge 12.7
aged 12.7
mail 12.4
design 12.4
balcony 12.2
office 12
man 12
decoration 11.9
postmark 11.8
postage 11.8
postal 11.8
envelope 11.7
stamp 11.6
window 11.5
male 11.3
group 11.3
letter 11
business 10.9
film 10.8
newspaper 10.6
ancient 10.4
interior 9.7
crowd 9.6
message 9.1
paint 9
texture 9
building 9
pattern 8.9
computer 8.9
address 8.8
antique 8.7
frame 8.7
architecture 8.6
adult 8.4
screen 8.4
negative 8.3
symbol 8.1
transportation 8.1
post office 7.9
philately 7.9
printed 7.9
modern 7.7
motion 7.7
card 7.6
fine 7.6
product 7.4
global 7.3
digital 7.3
blackboard 7.2
home 7.2
history 7.1
decor 7.1
travel 7
sunglasses 7

Google
created on 2022-01-23

Picture frame 94.5
Art 84.3
Font 81.4
Painting 77.6
Rectangle 70.2
Event 69
Illustration 68.9
Suit 67.6
Visual arts 65.3
Room 63.6
History 62.3
Team 60.7
Collection 59.4
Uniform 58.7
Paper product 56.1
Vintage clothing 54.2
Monochrome 52.9
Crowd 51

Microsoft
created on 2022-01-23

text 99.3
person 97.9
clothing 85
posing 78.4
group 57.3
picture frame 17.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 92.4%
Calm 98.6%
Sad 0.7%
Surprised 0.3%
Happy 0.2%
Disgusted 0.1%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 83.2%
Happy 10%
Sad 4.3%
Fear 0.9%
Surprised 0.9%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 30-40
Gender Male, 97.2%
Calm 73.9%
Sad 11.6%
Happy 10.1%
Surprised 1.2%
Disgusted 1%
Fear 0.9%
Confused 0.8%
Angry 0.5%

AWS Rekognition

Age 23-31
Gender Male, 98.8%
Calm 99.3%
Sad 0.4%
Happy 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 45.9%
Happy 40.7%
Sad 6.3%
Confused 2.4%
Surprised 1.9%
Disgusted 1.7%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 38-46
Gender Female, 62.6%
Happy 85.2%
Calm 13%
Sad 0.8%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Female, 74.1%
Calm 80.7%
Happy 16.1%
Surprised 0.9%
Sad 0.9%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 36-44
Gender Female, 67.5%
Sad 46.5%
Calm 38.5%
Happy 7.4%
Fear 3.4%
Surprised 3.1%
Angry 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Male, 93.2%
Calm 64.8%
Sad 34%
Happy 0.6%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 67.8%
Happy 19.7%
Sad 8.8%
Surprised 1.7%
Disgusted 0.6%
Confused 0.6%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 34-42
Gender Male, 98.3%
Calm 87.3%
Surprised 9.7%
Sad 1.5%
Happy 1%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.8%
Calm 53.3%
Sad 31.2%
Happy 13.4%
Confused 1.1%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 42-50
Gender Male, 99.7%
Sad 57.6%
Calm 27.8%
Happy 11.4%
Confused 1.2%
Disgusted 0.6%
Surprised 0.6%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 43-51
Gender Male, 99.2%
Happy 93.9%
Surprised 2.6%
Sad 1.3%
Calm 1.1%
Fear 0.6%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.3%
Calm 42.4%
Sad 29.7%
Happy 20.3%
Disgusted 2.5%
Angry 1.6%
Confused 1.6%
Surprised 1.4%
Fear 0.4%

AWS Rekognition

Age 37-45
Gender Male, 97.8%
Calm 86.1%
Sad 13.2%
Surprised 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 62.1%
Happy 14.7%
Sad 8.7%
Surprised 6.7%
Confused 3%
Disgusted 2.5%
Fear 1.2%
Angry 1.1%

AWS Rekognition

Age 29-39
Gender Male, 98.5%
Calm 89.7%
Sad 6.9%
Happy 0.8%
Surprised 0.7%
Disgusted 0.6%
Angry 0.5%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 93%
Sad 5.2%
Happy 1%
Confused 0.4%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Male, 86.3%
Sad 43.1%
Happy 27.2%
Calm 23.5%
Disgusted 2.1%
Confused 1.4%
Fear 1.1%
Surprised 1.1%
Angry 0.6%

AWS Rekognition

Age 27-37
Gender Male, 98%
Calm 56.5%
Happy 33.8%
Fear 4%
Surprised 2.3%
Sad 1.5%
Angry 0.8%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 28-38
Gender Male, 99%
Calm 99.4%
Sad 0.3%
Confused 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 56.9%
Sad 41.6%
Confused 0.8%
Angry 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 34-42
Gender Male, 98.4%
Sad 72.3%
Calm 25.7%
Happy 0.7%
Confused 0.5%
Fear 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 93.7%
Sad 4.2%
Surprised 0.5%
Confused 0.5%
Happy 0.3%
Disgusted 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Female, 76.1%
Sad 66.5%
Calm 22.7%
Happy 5.2%
Confused 3.4%
Surprised 0.7%
Fear 0.6%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 39-47
Gender Male, 99.7%
Sad 80.5%
Calm 10.3%
Happy 2.7%
Confused 2.5%
Disgusted 1.5%
Angry 1%
Surprised 0.9%
Fear 0.5%

AWS Rekognition

Age 34-42
Gender Male, 98.8%
Calm 42.5%
Sad 33.3%
Surprised 15.3%
Disgusted 2.6%
Confused 2.5%
Happy 1.8%
Angry 1.5%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Poster 97.4%

Categories

Text analysis

Amazon

TESCE

Google

3.
3.