Human Generated Data

Title

Untitled (view of banquet hall with two long tables and head table filled with people)

Date

1954

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9511

Human Generated Data

Title

Untitled (view of banquet hall with two long tables and head table filled with people)

People

Artist: Martin Schweig, American 20th century

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.2
Human 99.2
Person 99
Person 97.9
Person 93.9
Person 91.3
Person 91.1
Person 88.3
Apparel 87.4
Clothing 87.4
Restaurant 83.3
Person 83.1
Person 78.6
Crowd 77.8
People 75.1
Person 70.5
Person 69
Furniture 65.5
Indoors 63.3
Person 61.7
Cafeteria 59.9
Photography 59.8
Photo 59.8
Chair 59.7
Table 58.8
Gown 57.3
Fashion 57.3
Cafe 57.3
Person 57.1
Bar Counter 56
Pub 56
Wedding 56

Imagga
created on 2022-01-28

brass 48.9
wind instrument 41.4
cornet 35.5
teacher 34.6
person 33.1
man 32.2
people 29.5
musical instrument 29.3
male 27.6
adult 23.8
businessman 22.1
couple 21.8
professional 21.2
happy 20.7
business 19.4
group 19.3
educator 18.3
room 17.5
men 17.2
dress 16.3
black 15
bride 14.4
women 14.2
education 13.8
modern 13.3
meeting 13.2
together 13.1
groom 13
blackboard 12.9
hand 12.9
office 12.8
classroom 12.7
suit 12.6
team 12.5
happiness 12.5
smiling 12.3
new 12.1
wedding 11.9
planner 11.9
student 11.6
holding 11.5
corporate 11.2
home 11.2
love 11
two 11
portrait 11
board 10.8
lifestyle 10.8
teaching 10.7
job 10.6
interior 10.6
indoors 10.5
hands 10.4
table 10.4
bouquet 10.4
stage 10.2
businesswoman 10
smile 10
class 9.6
desk 9.4
manager 9.3
teamwork 9.3
school 9.1
fashion 9
conference 8.8
executive 8.7
formal 8.6
marriage 8.5
device 8.5
senior 8.4
presentation 8.4
silhouette 8.3
indoor 8.2
cheerful 8.1
success 8
handsome 8
celebration 8
work 8
sitting 7.7
chair 7.7
married 7.7
boss 7.6
life 7.6
communication 7.6
study 7.5
mature 7.4
event 7.4
training 7.4
worker 7.3
family 7.1

Google
created on 2022-01-28

Photograph 94.2
Black 89.5
Line 81.7
Font 81.3
Snapshot 74.3
Monochrome photography 71.8
Event 70.4
Monochrome 70.2
Suit 67.5
Room 67.4
Stock photography 66.4
Chair 64
History 62.7
Photo caption 62
Art 61.7
Hat 58.7
Vintage clothing 55.7
Team 54.2
Illustration 52.2
Photography 52.1

Microsoft
created on 2022-01-28

person 96.7
text 95.4
man 87.1
clothing 86.6
player 72.2
drawing 64.2
old 41
posing 38.3

Face analysis

Amazon

Google

AWS Rekognition

Age 13-21
Gender Female, 64.7%
Fear 52.5%
Calm 18.3%
Sad 13.3%
Happy 4.5%
Confused 4.3%
Surprised 2.6%
Angry 2.4%
Disgusted 2.1%

AWS Rekognition

Age 27-37
Gender Female, 50.1%
Calm 67.7%
Sad 30.1%
Confused 1.1%
Happy 0.4%
Angry 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 53.4%
Calm 54.3%
Happy 22.8%
Sad 7.9%
Fear 7.8%
Confused 4.4%
Angry 1.1%
Disgusted 0.9%
Surprised 0.8%

AWS Rekognition

Age 29-39
Gender Male, 89.5%
Calm 93.8%
Angry 2.5%
Confused 1.4%
Disgusted 0.9%
Sad 0.7%
Fear 0.4%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Female, 64.3%
Sad 39.9%
Calm 25.6%
Confused 10.1%
Happy 8.4%
Disgusted 5.4%
Fear 4.6%
Angry 4.3%
Surprised 1.7%

AWS Rekognition

Age 21-29
Gender Female, 66.9%
Calm 66.1%
Sad 13.4%
Fear 6.2%
Happy 5.5%
Angry 3.9%
Confused 2%
Disgusted 1.6%
Surprised 1.4%

AWS Rekognition

Age 18-26
Gender Female, 82.7%
Disgusted 48.6%
Calm 27.4%
Sad 14.7%
Happy 2.5%
Angry 2%
Confused 1.6%
Fear 1.6%
Surprised 1.5%

AWS Rekognition

Age 12-20
Gender Female, 76.9%
Calm 85.1%
Sad 11%
Happy 1.4%
Confused 0.6%
Surprised 0.6%
Fear 0.6%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 27-37
Gender Male, 82.1%
Calm 59.9%
Sad 22.6%
Fear 5.6%
Confused 4.9%
Angry 2.9%
Happy 2.4%
Disgusted 1.1%
Surprised 0.6%

AWS Rekognition

Age 12-20
Gender Female, 80.3%
Calm 67.7%
Surprised 16.4%
Sad 7.4%
Confused 3.2%
Fear 2.3%
Angry 1.8%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 20-28
Gender Female, 65.1%
Calm 91.5%
Sad 2.4%
Happy 1.9%
Confused 1.7%
Disgusted 1.2%
Angry 0.8%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 14-22
Gender Male, 69.7%
Fear 52.4%
Sad 23.7%
Calm 8.4%
Surprised 7.8%
Happy 3.5%
Confused 2.1%
Angry 1.2%
Disgusted 1%

AWS Rekognition

Age 18-24
Gender Male, 85.7%
Calm 77.9%
Confused 16%
Disgusted 2.6%
Surprised 1.2%
Angry 0.7%
Sad 0.7%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 18-26
Gender Male, 65.3%
Sad 82%
Calm 5.1%
Happy 4.4%
Confused 4.2%
Fear 1.7%
Disgusted 1.1%
Surprised 0.7%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Female, 57.6%
Calm 99.2%
Happy 0.4%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 74.1%
Sad 58.7%
Calm 35.9%
Confused 1.8%
Fear 1.4%
Angry 0.8%
Disgusted 0.5%
Happy 0.5%
Surprised 0.3%

AWS Rekognition

Age 19-27
Gender Male, 84.8%
Sad 91.8%
Calm 7.5%
Confused 0.4%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0%

AWS Rekognition

Age 25-35
Gender Male, 66.9%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%
Angry 0%
Surprised 0%

AWS Rekognition

Age 18-26
Gender Female, 66.8%
Surprised 36.5%
Happy 24.7%
Calm 19.2%
Fear 6.1%
Angry 5%
Disgusted 3.2%
Sad 3%
Confused 2.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 89.9%
a group of people standing in front of a crowd 89.8%
a group of people standing in front of a window 86.1%

Text analysis

Amazon

WOROB

Google

MJI7--YT 37A°2 - - XAGON
MJI7--YT
-
37A°2
XAGON