Human Generated Data

Title

Untitled (large family gathering around dining table)
Date

1959
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3023

Human Generated Data

Title

Untitled (large family gathering around dining table)

People

Artist: Harry Annas, American 1897 - 1980

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 98.4
Human 98.4
Person 98
Person 97.8
Person 95.4
Person 95
Person 93.1
Person 92.1
Person 91.8
Person 91.6
Person 91
Person 86.4
People 82.9
Person 82.8
Furniture 79.4
Chair 79.4
Indoors 78.8
Room 78.5
Chair 70.8
Clinic 66.8
Shorts 66.4
Clothing 66.4
Apparel 66.4
Person 64.9
Person 63.8
Crowd 61.6
School 58
Classroom 58
Chair 57.2
Person 56.2
Cafeteria 56.1
Restaurant 56.1
Audience 55.1
Person 55.1

Imagga
created on 2022-01-21

brass 62.4
wind instrument 48.5
musical instrument 34.8
person 34.2
people 28.4
group 26.6
male 24.8
man 23.5
planner 22.4
outfit 22.4
lifestyle 16.6
silhouette 16.5
women 15.8
adult 15.4
men 14.6
happy 14.4
business 14
classroom 13.9
businessman 13.2
crowd 12.5
couple 12.2
friendship 12.2
room 11.9
dancer 11.8
cornet 11.6
smiling 11.6
fun 11.2
outdoors 11.2
portrait 11
happiness 11
copy space 10.8
sport 10.7
together 10.5
boy 10.4
active 10.4
sitting 10.3
trombone 10.1
teenager 10
team 9.8
dance 9.5
friends 9.4
teacher 9.1
professional 9
sky 8.9
success 8.8
work 8.6
human 8.2
competition 8.2
exercise 8.2
body 8
stage 7.8
day 7.8
standing 7.8
black 7.8
corporate 7.7
chair 7.7
fashion 7.5
performer 7.5
holding 7.4
girls 7.3
device 7.2
color 7.2
fitness 7.2
sunset 7.2
holiday 7.2
life 7.1

Google
created on 2022-01-21

Font 83.4
Line 82.2
Art 80.6
Rectangle 76.9
Painting 75.7
Snapshot 74.3
Picture frame 73.3
Illustration 68.4
Drawing 68.1
Event 67.5
Visual arts 66.1
Team 64.4
Chair 63.3
Room 63.2
Suit 62.8
Crew 58.9
Photo caption 55
Metal 53.2
Sitting 50.9
History 50.1

Microsoft
created on 2022-01-21

text 98.2
person 93.6
player 91.5
outdoor 85.8
posing 62.5

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 78.8%
Sad 97.6%
Calm 0.6%
Happy 0.5%
Fear 0.5%
Surprised 0.3%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 64.1%
Calm 56.6%
Sad 28.2%
Happy 6.4%
Disgusted 2.9%
Fear 2.5%
Confused 1.5%
Surprised 1%
Angry 0.9%

AWS Rekognition

Age 27-37
Gender Male, 92.5%
Sad 86.9%
Happy 9.3%
Calm 2.2%
Confused 0.7%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 97.1%
Calm 69.5%
Surprised 26.1%
Sad 1.9%
Fear 0.7%
Angry 0.6%
Confused 0.5%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Sad 98.3%
Confused 1.2%
Calm 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Female, 61.4%
Calm 85.8%
Sad 9.4%
Happy 2.3%
Confused 1%
Angry 0.7%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Female, 58.4%
Sad 81.7%
Calm 8.7%
Confused 3.6%
Fear 2.2%
Angry 1.6%
Happy 1%
Disgusted 0.7%
Surprised 0.5%

AWS Rekognition

Age 36-44
Gender Female, 99.1%
Sad 68%
Calm 16%
Happy 10.2%
Confused 3.8%
Angry 1%
Disgusted 0.5%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Male, 91.2%
Sad 81.1%
Calm 13.4%
Confused 3.1%
Happy 1.1%
Angry 0.4%
Fear 0.3%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Angry 33.6%
Calm 26.6%
Confused 13.7%
Sad 10.6%
Happy 9.5%
Disgusted 2.9%
Surprised 2%
Fear 1.2%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Sad 92.3%
Happy 3.1%
Calm 3%
Angry 0.6%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 48-54
Gender Female, 99.8%
Sad 61.7%
Calm 32.6%
Happy 3.7%
Disgusted 0.7%
Confused 0.6%
Angry 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 95.7%
Sad 48%
Calm 38.7%
Confused 5%
Disgusted 3.4%
Angry 2.7%
Happy 1%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 27-37
Gender Male, 93.3%
Sad 87.9%
Happy 8.4%
Calm 1.7%
Disgusted 0.6%
Confused 0.5%
Angry 0.5%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 36-44
Gender Female, 52.5%
Sad 50.5%
Calm 20.4%
Happy 15.4%
Confused 7.2%
Disgusted 2.3%
Surprised 1.9%
Angry 1.3%
Fear 1%

AWS Rekognition

Age 33-41
Gender Male, 96.9%
Sad 57.7%
Happy 23.7%
Calm 13%
Confused 1.4%
Fear 1.4%
Angry 1.2%
Surprised 1.1%
Disgusted 0.6%

AWS Rekognition

Age 30-40
Gender Female, 93.3%
Sad 53%
Happy 21.5%
Calm 16.2%
Confused 3.6%
Surprised 2.1%
Disgusted 1.7%
Angry 1.4%
Fear 0.6%

AWS Rekognition

Age 36-44
Gender Male, 50.6%
Calm 67.7%
Sad 23%
Angry 5.3%
Confused 1.7%
Happy 0.8%
Fear 0.6%
Disgusted 0.4%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 98.4%
Chair 79.4%

Captions

Microsoft

a group of people posing for a photo 89.6%
a group of people posing for a picture 89.5%
a group of people posing for the camera 89.4%

Text analysis

Amazon

YOUR