Human Generated Data

Title

Untitled (crowded tables at banquet)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19331

Human Generated Data

Title

Untitled (crowded tables at banquet)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99.2
Human 99.2
Person 99.1
Crowd 97.8
Person 97.2
Person 97.1
Person 97
Advertisement 96.9
Poster 96.9
Person 96.8
Person 94.2
Person 92.9
Person 88.7
Audience 88.6
Text 86.6
Press Conference 80.5
Person 78.7
Person 78.4
Person 76.2
People 68.7
Person 65.5
Person 63.4
Jury 63.3

Imagga
created on 2022-02-25

businessman 38.8
people 37.9
meeting 37.6
person 37.5
professional 37.4
business 36.4
teacher 36.3
man 35.6
group 34.6
team 34
office 33.2
businesswoman 32.7
male 29.8
teamwork 28.7
corporate 27.5
work 27.4
adult 25.9
businesspeople 25.6
executive 24.1
classroom 23.4
happy 23.2
job 23
communication 22.7
together 21.9
student 21.7
desk 21.7
working 21.2
room 20.9
education 19
educator 18.9
smiling 18.8
success 18.5
indoors 17.6
women 16.6
colleagues 16.5
successful 16.5
table 16.4
men 16.3
sitting 16.3
life 16.3
modern 15.4
lifestyle 15.2
conference 14.6
confident 14.5
worker 14.5
computer 14.4
career 14.2
smile 13.5
suit 13.5
presentation 13
indoor 12.8
staff 12.4
laptop 11.8
school 11.7
portrait 11.6
cooperation 11.6
partner 11.6
holding 11.5
collar 11.5
interior 11.5
boss 11.5
talking 11.4
manager 11.2
training 11.1
coworkers 10.8
cheerful 10.6
workplace 10.5
couple 10.4
showing 10.3
occupation 10.1
board 9.9
hand 9.9
seminar 9.8
to 9.7
discussion 9.7
partners 9.7
class 9.6
planning 9.6
looking 9.6
enrollee 9.5
happiness 9.4
two 9.3
friendly 9.1
technology 8.9
partnership 8.6
plan 8.5
study 8.4
positive 8.3
employee 8.2
collaboration 7.9
discussing 7.9
boy 7.8
teaching 7.8
corporation 7.7
finance 7.6
chair 7.6
smart 7.5
company 7.4
phone 7.4
color 7.2
hall 7.2
handsome 7.1
groom 7
shop 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.7
person 95.4
clothing 87.6
man 83.9
people 78.8
group 72.1
human face 69.9
posing 64
picture frame 23.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Female, 56.6%
Calm 99.6%
Happy 0.1%
Fear 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Calm 91.3%
Angry 4%
Sad 2%
Confused 1.2%
Surprised 0.5%
Disgusted 0.5%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 9-17
Gender Female, 99%
Sad 87.4%
Surprised 3.6%
Disgusted 2.6%
Fear 2.4%
Calm 1.8%
Angry 1.2%
Confused 0.7%
Happy 0.3%

AWS Rekognition

Age 45-51
Gender Female, 100%
Happy 81.9%
Calm 10.7%
Angry 1.7%
Surprised 1.4%
Fear 1.3%
Disgusted 1.2%
Sad 1%
Confused 0.7%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 79.6%
Angry 4.9%
Happy 4.8%
Surprised 3.9%
Disgusted 2.8%
Confused 1.7%
Sad 1.6%
Fear 0.7%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 91.5%
Happy 3%
Sad 1.4%
Confused 1.2%
Surprised 1%
Angry 0.9%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 88%
Confused 6.7%
Surprised 2.3%
Angry 0.9%
Sad 0.7%
Disgusted 0.7%
Fear 0.4%
Happy 0.2%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Happy 51.6%
Calm 18.2%
Surprised 16.4%
Confused 3.7%
Disgusted 3.1%
Angry 2.9%
Sad 2.2%
Fear 1.7%

AWS Rekognition

Age 45-51
Gender Female, 99.8%
Happy 92.1%
Angry 2.6%
Fear 2%
Confused 1.5%
Sad 0.6%
Surprised 0.5%
Calm 0.3%
Disgusted 0.3%

AWS Rekognition

Age 60-70
Gender Female, 99.9%
Calm 94.4%
Sad 2.3%
Fear 0.9%
Happy 0.6%
Angry 0.5%
Confused 0.4%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 50-58
Gender Male, 82.1%
Calm 93.8%
Sad 4.8%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 99%
Confused 0.5%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Angry 92%
Calm 5.1%
Sad 1%
Disgusted 0.7%
Confused 0.5%
Surprised 0.4%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 100%
Confused 74.3%
Calm 10.1%
Angry 5.1%
Disgusted 5%
Sad 2.2%
Happy 1.3%
Surprised 1.1%
Fear 1%

AWS Rekognition

Age 22-30
Gender Male, 98.4%
Calm 77.8%
Sad 15.4%
Fear 5.7%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Sad 75.8%
Calm 10.8%
Confused 9%
Surprised 1.2%
Angry 1%
Fear 0.8%
Happy 0.7%
Disgusted 0.7%

AWS Rekognition

Age 29-39
Gender Female, 100%
Sad 68.4%
Calm 29.3%
Happy 0.8%
Fear 0.4%
Surprised 0.3%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 50-58
Gender Male, 88%
Calm 88.4%
Sad 5.3%
Surprised 2.2%
Happy 1.7%
Angry 0.9%
Fear 0.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 28-38
Gender Male, 73.3%
Calm 42.7%
Sad 33.4%
Happy 8.4%
Angry 5.9%
Confused 4.7%
Disgusted 2%
Fear 2%
Surprised 0.9%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Calm 34.4%
Happy 23.8%
Sad 16%
Angry 9.9%
Confused 6.8%
Surprised 6.5%
Disgusted 1.5%
Fear 1.1%

AWS Rekognition

Age 14-22
Gender Male, 93.5%
Sad 48.1%
Calm 28.2%
Fear 6.6%
Angry 4.2%
Happy 4%
Confused 3.9%
Surprised 3.3%
Disgusted 1.7%

AWS Rekognition

Age 23-33
Gender Male, 97.5%
Fear 93.8%
Sad 4.3%
Calm 0.9%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 2-10
Gender Male, 97.5%
Calm 72.9%
Confused 12.7%
Disgusted 4.5%
Angry 3.1%
Sad 2.5%
Surprised 1.7%
Fear 1.6%
Happy 1%

AWS Rekognition

Age 24-34
Gender Female, 62.9%
Disgusted 58.4%
Calm 31.3%
Sad 3.9%
Angry 1.9%
Surprised 1.6%
Fear 1.5%
Confused 1%
Happy 0.6%

AWS Rekognition

Age 63-73
Gender Male, 92.5%
Calm 85.6%
Angry 4%
Confused 2.9%
Sad 2%
Surprised 1.8%
Happy 1.7%
Disgusted 1.3%
Fear 0.8%

AWS Rekognition

Age 33-41
Gender Male, 95.5%
Sad 71.6%
Calm 19.3%
Confused 6%
Angry 0.9%
Surprised 0.7%
Disgusted 0.7%
Happy 0.6%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Female, 94.8%
Calm 79.6%
Fear 11.6%
Sad 7.9%
Happy 0.2%
Disgusted 0.2%
Surprised 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 96.4%
Calm 78.4%
Sad 17.2%
Confused 1.8%
Surprised 0.9%
Disgusted 0.6%
Happy 0.5%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 98.7%
Calm 52.9%
Sad 18.5%
Fear 9.6%
Angry 5.6%
Happy 5%
Surprised 3.4%
Disgusted 3.1%
Confused 1.9%

AWS Rekognition

Age 7-17
Gender Male, 62.5%
Sad 93.2%
Fear 3%
Calm 1.6%
Surprised 0.7%
Angry 0.5%
Confused 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 14-22
Gender Male, 86.6%
Calm 87.1%
Sad 8.9%
Angry 1.7%
Fear 0.6%
Surprised 0.5%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.2%
Poster 96.9%

Captions

Microsoft

a group of people posing for a photo 89.6%
a group of people posing for the camera 89.5%
a group of people posing for a picture 89.4%

Text analysis

Amazon

65
JAN
5
1322

Google

JAN 65 13? 62
65
JAN
13?
62