Human Generated Data

Title

Untitled (large family gathering around dining table)

Date

1959

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3025

Human Generated Data

Title

Untitled (large family gathering around dining table)

People

Artist: Harry Annas, American 1897 - 1980

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 98.3
Human 98.3
Person 98.1
Chair 98
Furniture 98
Person 96.9
Person 96.8
Person 96.5
Person 96.1
Person 94.9
Person 94.9
Person 90.6
Person 90.6
Indoors 90
Room 90
Person 89.4
Person 86.7
People 85.8
Chair 78.7
Table 78.3
Chair 75.8
Person 75.1
Person 70.1
Chair 67.4
Crowd 66.3
Apparel 65.1
Clothing 65.1
Dining Table 64.7
Photo 61.1
Photography 61.1
Face 61.1
Portrait 61.1
Stage 60.9
Clinic 59.8
School 57.6
Classroom 57.6
Cafeteria 56.9
Restaurant 56.9
Person 56
Person 45.6

Imagga
created on 2022-01-21

brass 100
wind instrument 77.6
musical instrument 54.1
people 26.2
cornet 23.7
person 23.7
group 22.5
male 21.3
man 20.8
businessman 19.4
chair 19.2
table 19
business 16.4
room 16.1
silhouette 15.7
men 15.4
lifestyle 12.3
boy 12.2
sitting 12
adult 11.7
teacher 11.4
crowd 10.5
classroom 10.5
bass 10.1
team 9.8
modern 9.8
interior 9.7
portrait 9.7
sax 9.7
corporate 9.4
happy 9.4
human 9
job 8.8
trombone 8.8
concert 8.7
couple 8.7
women 8.7
work 8.7
smiling 8.7
party 8.6
glass 8.5
friendship 8.4
black 8.4
company 8.4
event 8.3
fashion 8.3
outfit 8.2
board 8.1
worker 8.1
indoors 7.9
music 7.9
day 7.8
hands 7.8
conference 7.8
restaurant 7.8
wall 7.7
musical 7.7
stage 7.6
dinner 7.6
meeting 7.5
learning 7.5
holding 7.4
design 7.3
girls 7.3
active 7.3
device 7.3
success 7.2
handsome 7.1
dancer 7
together 7

Google
created on 2022-01-21

Font 80
Art 79.7
Painting 79.4
Event 71.6
Rectangle 71.3
Chair 71.1
Picture frame 70.7
Suit 69.6
Illustration 68.4
Room 67
Photo caption 66.7
Visual arts 65.5
Drawing 65.3
Team 60.7
Crew 58.2
History 53
Class 52.9
Sitting 51.6

Microsoft
created on 2022-01-21

text 95.6
player 90.4
clothing 87.1
person 87
man 81.7
footwear 72.1
old 51.3
posing 47.9

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 55.6%
Calm 98.1%
Sad 1.3%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 34-42
Gender Male, 87%
Sad 99.7%
Calm 0.1%
Angry 0.1%
Fear 0%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 40-48
Gender Female, 89.9%
Sad 52.6%
Happy 28.8%
Calm 9.7%
Confused 3.4%
Surprised 2.1%
Fear 1.8%
Disgusted 0.8%
Angry 0.7%

AWS Rekognition

Age 33-41
Gender Male, 99.3%
Sad 93.7%
Happy 1.8%
Angry 1.1%
Disgusted 1%
Fear 0.8%
Confused 0.8%
Calm 0.5%
Surprised 0.3%

AWS Rekognition

Age 29-39
Gender Male, 67.1%
Sad 65.2%
Calm 24.7%
Happy 5.2%
Confused 2.3%
Angry 0.9%
Disgusted 0.6%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 35-43
Gender Male, 67.6%
Sad 76%
Calm 21.9%
Confused 0.8%
Happy 0.6%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 11-19
Gender Male, 54.5%
Calm 75.8%
Sad 20.9%
Fear 1%
Confused 0.8%
Happy 0.6%
Angry 0.3%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Sad 70.5%
Calm 27.8%
Confused 0.6%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 40.2%
Angry 38.2%
Happy 11.6%
Sad 3.5%
Confused 2.7%
Surprised 1.7%
Fear 1.4%
Disgusted 0.7%

AWS Rekognition

Age 27-37
Gender Male, 72.8%
Sad 40.3%
Calm 28%
Happy 25.1%
Confused 2.5%
Surprised 1.5%
Disgusted 1%
Fear 0.9%
Angry 0.8%

AWS Rekognition

Age 49-57
Gender Male, 97.4%
Sad 76.3%
Calm 11.4%
Happy 3.4%
Confused 3.4%
Disgusted 1.8%
Angry 1.8%
Fear 1.2%
Surprised 0.9%

AWS Rekognition

Age 29-39
Gender Female, 76.9%
Sad 70.8%
Happy 13.1%
Calm 11.2%
Confused 3.7%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Female, 87.5%
Sad 64.4%
Calm 28.7%
Confused 2.9%
Happy 2.8%
Angry 0.4%
Fear 0.4%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Sad 67.4%
Angry 11.4%
Calm 10.2%
Fear 3.7%
Confused 2.8%
Disgusted 1.8%
Happy 1.3%
Surprised 1.2%

AWS Rekognition

Age 29-39
Gender Female, 88.5%
Sad 77.4%
Calm 7.7%
Confused 7.5%
Happy 4.8%
Angry 0.9%
Disgusted 0.9%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 24-34
Gender Male, 72.3%
Sad 33.4%
Calm 31.3%
Happy 15%
Confused 13.6%
Disgusted 3.2%
Surprised 2%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 35-43
Gender Female, 55.5%
Calm 99.1%
Happy 0.3%
Sad 0.2%
Confused 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 25-35
Gender Male, 91.5%
Sad 67.4%
Calm 22.4%
Confused 2.7%
Happy 2.4%
Fear 2.1%
Angry 1.7%
Disgusted 0.7%
Surprised 0.6%

AWS Rekognition

Age 42-50
Gender Male, 97.3%
Calm 60.6%
Happy 15.4%
Sad 6.2%
Confused 6%
Disgusted 4.1%
Fear 3.5%
Angry 2.5%
Surprised 1.6%

AWS Rekognition

Age 27-37
Gender Male, 84.4%
Sad 30.5%
Happy 27.5%
Calm 19.6%
Confused 18.4%
Angry 1.1%
Disgusted 1%
Surprised 1%
Fear 0.8%

AWS Rekognition

Age 19-27
Gender Female, 51%
Happy 57.4%
Sad 24.7%
Calm 8.6%
Fear 5.4%
Disgusted 1.2%
Surprised 1%
Angry 0.9%
Confused 0.9%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 69.6%
Calm 16%
Sad 11.5%
Confused 1.3%
Fear 0.7%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 98.3%
Chair 98%

Captions

Microsoft

a group of people posing for a photo 84.8%
a group of people posing for a picture 84.7%
a group of people posing for the camera 84.6%

Text analysis

Amazon

E
18
RAGO
T33A 2 RAGO
T33A 2

Google

2.VEE.
3) 2.VEE.
3)