Human Generated Data

Title

Untitled (large family gathering around dining table)

Date

1959

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3024

Human Generated Data

Title

Untitled (large family gathering around dining table)

People

Artist: Harry Annas, American 1897 - 1980

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 97.8
Human 97.8
Person 95.7
Person 95.7
Person 95.3
Person 91.8
Person 91.5
Person 91
Person 87.4
Furniture 87.4
Person 87.2
Person 87
Person 80.3
Person 79.2
Chair 79.1
People 78.7
Indoors 78
Room 78
Chair 73.9
Clinic 70
Person 69.4
Person 67.9
Person 66.7
Shorts 65.6
Apparel 65.6
Clothing 65.6
Chair 61.2
Classroom 59.8
School 59.8
Table 58.8
Coat 57.6
Suit 57.6
Overcoat 57.6
Chair 51.6

Imagga
created on 2022-01-21

classroom 48.5
brass 43
room 40.6
wind instrument 34.4
group 32.2
people 31.8
outfit 31.3
person 27
male 26.2
musical instrument 24.3
man 22.8
businessman 21.2
business 20
adult 19.5
silhouette 18.2
men 18
teacher 14.7
table 14.7
crowd 14.4
chair 14.2
women 13.4
team 13.4
happy 13.1
sitting 12.9
work 12.5
lifestyle 12.3
smiling 11.6
job 11.5
couple 11.3
professional 11.1
together 10.5
boy 10.4
meeting 10.3
portrait 10.3
learning 10.3
corporate 10.3
casual 10.2
communication 10.1
copy space 9.9
education 9.5
blackboard 9.2
stage 9.2
businesswoman 9.1
worker 9
cheerful 8.9
office 8.8
student 8.8
class 8.7
gymnasium 8.4
friendship 8.4
modern 8.4
teamwork 8.3
executive 8.3
holding 8.2
confident 8.2
suit 8.1
success 8
graphic 8
cornet 7.9
day 7.8
happiness 7.8
dancer 7.8
conference 7.8
teaching 7.8
drinking 7.6
friends 7.5
human 7.5
fun 7.5
manager 7.4
company 7.4
training 7.4
girls 7.3
laptop 7.3
board 7.2
trombone 7
indoors 7

Google
created on 2022-01-21

Black 89.6
Font 82.2
Art 78.2
Chair 71.8
Team 70.6
Event 67
Rectangle 66.1
Illustration 65.1
Room 62.9
Photo caption 62.3
Visual arts 58.1
Painting 57.9
Crew 56.4
Picture frame 54.9
History 54.5
Sitting 53.6
Monochrome 53.2

Microsoft
created on 2022-01-21

text 97.7
person 95.8
outdoor 94.7
player 89.7
posing 47.9
old 43.8

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 84.7%
Calm 99.5%
Sad 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 23-31
Gender Male, 74.8%
Calm 58%
Sad 24.8%
Confused 9.8%
Happy 4.2%
Fear 0.9%
Angry 0.9%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 37-45
Gender Male, 98.2%
Sad 91.1%
Calm 3.8%
Angry 2%
Fear 0.9%
Confused 0.7%
Disgusted 0.7%
Happy 0.5%
Surprised 0.4%

AWS Rekognition

Age 36-44
Gender Female, 92.9%
Happy 60.2%
Sad 32.1%
Confused 2.4%
Calm 2%
Fear 1.2%
Angry 0.9%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 31-41
Gender Male, 58.7%
Sad 74.4%
Calm 13.3%
Confused 5.6%
Happy 4.4%
Fear 0.8%
Disgusted 0.6%
Angry 0.5%
Surprised 0.3%

AWS Rekognition

Age 48-54
Gender Male, 98.5%
Sad 71.5%
Calm 25.5%
Happy 1.2%
Confused 0.8%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Sad 50.1%
Calm 20.6%
Happy 10.9%
Disgusted 6.7%
Angry 4.6%
Confused 2.6%
Surprised 2.6%
Fear 2.1%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Sad 76.8%
Happy 9.8%
Calm 6.9%
Confused 4%
Surprised 1.1%
Disgusted 0.6%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Male, 97.2%
Sad 74.1%
Angry 11.2%
Calm 5%
Disgusted 2.7%
Happy 2.5%
Confused 2%
Surprised 1.3%
Fear 1.2%

AWS Rekognition

Age 43-51
Gender Male, 98.8%
Calm 99.6%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Female, 90.7%
Sad 51.3%
Happy 38.6%
Confused 3.1%
Disgusted 2.6%
Calm 2%
Fear 0.8%
Surprised 0.8%
Angry 0.6%

AWS Rekognition

Age 43-51
Gender Female, 98.1%
Sad 87.2%
Calm 9.4%
Happy 1.7%
Confused 0.8%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Calm 39%
Sad 26.7%
Happy 16%
Confused 8%
Angry 5.1%
Surprised 2.2%
Disgusted 1.9%
Fear 1%

AWS Rekognition

Age 36-44
Gender Male, 97.1%
Calm 92.7%
Happy 3.9%
Sad 0.8%
Angry 0.7%
Confused 0.7%
Fear 0.4%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 29-39
Gender Male, 95.5%
Sad 91.3%
Calm 4.1%
Confused 2.5%
Happy 0.8%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 42-50
Gender Female, 99.6%
Sad 63.6%
Happy 19%
Calm 8.1%
Confused 4.3%
Disgusted 2%
Angry 1.2%
Fear 1%
Surprised 0.8%

AWS Rekognition

Age 28-38
Gender Female, 57%
Sad 60.8%
Calm 26.1%
Disgusted 3.6%
Happy 2.6%
Surprised 2.3%
Fear 1.9%
Angry 1.6%
Confused 1.2%

AWS Rekognition

Age 27-37
Gender Male, 81.9%
Sad 48.5%
Happy 22.7%
Calm 15.4%
Fear 3.9%
Confused 3.8%
Surprised 2.6%
Angry 2%
Disgusted 1.2%

AWS Rekognition

Age 27-37
Gender Male, 86.2%
Sad 87.2%
Happy 8.3%
Confused 1.8%
Calm 1.5%
Fear 0.4%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 47-53
Gender Female, 77.3%
Calm 59.7%
Sad 22.8%
Happy 14.8%
Confused 1.5%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 95.6%
Sad 78.2%
Calm 13.3%
Angry 2.8%
Surprised 2.3%
Confused 1.5%
Fear 0.7%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 29-39
Gender Female, 64.1%
Sad 68.8%
Calm 23.2%
Happy 4.2%
Confused 2.6%
Fear 0.4%
Disgusted 0.3%
Angry 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Feature analysis

Amazon

Person 97.8%
Chair 79.1%

Captions

Microsoft

a group of people posing for a photo 85.9%
a group of people posing for the camera 85.8%
a group of people posing for a picture 85.7%

Text analysis

Amazon

CAT