Human Generated Data

Title

Untitled (children seated in several rows of chairs with women looking on, Methodist Church)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2763

Human Generated Data

Title

Untitled (children seated in several rows of chairs with women looking on, Methodist Church)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Human 99.5
Person 99.5
Person 97.6
Person 97.3
Person 97.1
Person 97
Person 96.9
Crowd 95.3
Audience 90.4
Clothing 90.4
Apparel 90.4
Furniture 89.8
Chair 89.8
People 89.5
Person 89.2
Face 85.2
Female 84
Person 83.8
Dress 81.3
Indoors 79.9
Person 79.6
Person 78.6
Person 78.3
Coat 76.7
Overcoat 76.7
Suit 76.7
Photo 67.4
Photography 67.4
Portrait 67.4
Woman 67
Person 66.9
Room 66.2
Girl 64.8
Child 61.3
Kid 61.3
Sitting 59.5
Person 59.5
Performer 56.4
Leisure Activities 56.4
Jury 56.1
Press Conference 55.4
Person 55
Person 51.9

Imagga
created on 2022-01-16

person 30
people 28.4
man 28.2
teacher 24.7
nurse 21.2
male 20.6
adult 17.2
business 15.8
room 15.5
professional 15.2
businessman 13.2
classroom 13.2
educator 13.2
student 13.1
group 12.9
life 11.8
team 11.6
silhouette 11.6
education 11.2
spectator 11.1
brass 11
couple 10.4
men 10.3
kin 9.9
planner 9.8
interior 9.7
wind instrument 9.5
lifestyle 9.4
sport 9.2
new 8.9
active 8.8
art 8.8
home 8.8
happy 8.8
women 8.7
boy 8.7
happiness 8.6
blackboard 8.5
child 8.4
black 8.4
old 8.4
performer 8.3
exercise 8.2
world 8.1
success 8
indoors 7.9
love 7.9
play 7.7
musical instrument 7.5
sign 7.5
music 7.4
cheerful 7.3
smiling 7.2
celebration 7.2
family 7.1

Google
created on 2022-01-16

Black 89.7
Dress 86.6
Black-and-white 84.8
Art 75.3
Monochrome photography 75.1
Monochrome 75
Snapshot 74.3
Vintage clothing 73.5
Event 73.2
Font 72.2
Suit 71.3
Room 67.9
Team 65.7
Child 65
History 64.9
Illustration 63.9
Crowd 63.7
Photo caption 63.6
Stock photography 63.5
Uniform 59.4

Microsoft
created on 2022-01-16

person 98
clothing 94.7
text 93.5
man 79.9
group 69.3
posing 58.4
footwear 58.4
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 89.3%
Happy 54.2%
Sad 29.6%
Disgusted 6.9%
Angry 4.1%
Calm 2.1%
Confused 1.3%
Fear 1.1%
Surprised 0.8%

AWS Rekognition

Age 31-41
Gender Male, 76.8%
Calm 68.4%
Happy 17.5%
Sad 10.8%
Fear 1%
Disgusted 0.7%
Surprised 0.7%
Angry 0.6%
Confused 0.3%

AWS Rekognition

Age 37-45
Gender Male, 95.7%
Calm 70.7%
Surprised 14.9%
Sad 4%
Disgusted 3.6%
Confused 2.8%
Happy 1.8%
Angry 1.6%
Fear 0.7%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 40.6%
Surprised 36%
Sad 15.8%
Angry 3.7%
Disgusted 1.2%
Fear 1%
Happy 0.9%
Confused 0.8%

AWS Rekognition

Age 13-21
Gender Male, 99.9%
Calm 85.3%
Sad 4.5%
Surprised 3.9%
Disgusted 3.7%
Angry 1%
Confused 0.7%
Happy 0.7%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 66.5%
Sad 80.1%
Calm 11.8%
Happy 2%
Fear 1.7%
Confused 1.5%
Angry 1.2%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 31-41
Gender Male, 89.7%
Happy 51.2%
Calm 23.9%
Surprised 18.4%
Sad 1.9%
Fear 1.7%
Angry 1.2%
Disgusted 0.9%
Confused 0.7%

AWS Rekognition

Age 57-65
Gender Male, 96.4%
Calm 86.3%
Confused 3.4%
Sad 3.2%
Happy 3.1%
Angry 1.3%
Fear 1%
Surprised 0.9%
Disgusted 0.8%

AWS Rekognition

Age 28-38
Gender Male, 95.2%
Calm 40.2%
Happy 25.5%
Sad 19%
Surprised 9.5%
Confused 1.8%
Angry 1.6%
Disgusted 1.4%
Fear 1.1%

AWS Rekognition

Age 41-49
Gender Female, 89.3%
Sad 64.8%
Calm 20.8%
Happy 13%
Fear 0.4%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 42-50
Gender Male, 91.3%
Calm 86%
Sad 9.6%
Happy 1.4%
Fear 1.1%
Confused 0.6%
Surprised 0.6%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 35-43
Gender Male, 87.3%
Calm 92.5%
Happy 2.4%
Sad 2.4%
Surprised 1.8%
Confused 0.3%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Female, 62.3%
Calm 85.1%
Happy 12.2%
Sad 0.9%
Confused 0.7%
Surprised 0.6%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 99.4%
Happy 47.4%
Calm 45.6%
Sad 4.6%
Disgusted 0.6%
Surprised 0.6%
Confused 0.6%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 47-53
Gender Male, 96.6%
Calm 83.7%
Happy 10.2%
Sad 4.1%
Angry 0.7%
Confused 0.4%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Female, 51.3%
Sad 79.2%
Calm 11.6%
Happy 3.7%
Angry 2.1%
Disgusted 1.4%
Confused 1.1%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 23-33
Gender Male, 98%
Calm 97.9%
Sad 1.5%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 53.1%
Sad 86%
Happy 4.8%
Confused 4%
Calm 3.6%
Surprised 0.4%
Disgusted 0.4%
Angry 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 89.8%

Captions

Microsoft

a group of people posing for a photo 85.4%
a group of people posing for the camera 85.3%
a group of people posing for a picture 85.2%

Text analysis

Amazon

6
RODAK
AARANA