Human Generated Data

Title

Untitled (people at table at party)
Date

1964
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19208

Human Generated Data

Title

Untitled (people at table at party)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 98.9
Person 98.9
Person 98.8
Person 98.3
Person 97.2
Person 95.9
Tie 93.7
Accessory 93.7
Accessories 93.7
Person 92.6
Person 89.3
Furniture 87.6
Chair 86.9
Person 86.3
Tie 85.3
Apparel 81
Clothing 81
Coat 81
Overcoat 81
Suit 81
Table 80.9
Crowd 79
Text 77.3
Dining Table 77
People 71.2
Food 67
Meal 67
Art 61.8
Drawing 57.9

Imagga
created on 2022-02-25

business 38.3
businessman 35.3
office 32.2
people 31.2
man 30.9
person 29.5
meeting 29.2
businesswoman 26.3
work 25.1
team 25.1
group 25
male 24.8
professional 23.9
desk 23.2
businesspeople 21.8
corporate 20.6
teamwork 20.4
colleagues 20.4
job 20.3
table 20.2
adult 20
happy 18.8
executive 18.2
communication 17.6
suit 17.2
men 17.2
manager 16.8
smiling 15.9
women 15.8
together 15.8
successful 15.6
indoors 14.9
room 14.7
computer 14.6
success 14.5
entrepreneur 14.3
education 13.8
cheerful 13.8
laptop 13.8
portrait 13.6
worker 13.5
finance 12.7
discussion 12.6
modern 12.6
working 12.4
talking 12.4
presentation 12.1
newspaper 12
indoor 11.9
confident 11.8
conference 11.7
employee 11.7
holding 10.7
hand 10.6
teacher 10.5
plan 10.4
sitting 10.3
lifestyle 10.1
board 9.6
partnership 9.6
collar 9.6
couple 9.6
tie 9.5
career 9.5
blackboard 9.3
smile 9.3
paper 9.2
attractive 9.1
discussing 8.8
wagon 8.8
occupation 8.2
classroom 8.2
handsome 8
creation 8
interior 8
product 7.9
drawing 7.9
boardroom 7.9
lecture 7.9
coworkers 7.9
color 7.8
partner 7.7
class 7.7
two 7.6
gesture 7.6
reading 7.6
college 7.6
coffee 7.4
looking 7.2
restaurant 7.2
student 7.1
happiness 7

Google
created on 2022-02-25

Table 94.4
Tableware 94.2
Coat 91.8
Tablecloth 86.7
Chair 85.3
Suit 84.9
Stemware 81.7
Wine glass 80.8
Sharing 75.5
Event 74.8
Rectangle 73.3
Vintage clothing 71.7
Formal wear 70.5
Family reunion 68.9
Room 66.4
History 64.7
Photo caption 63.9
Plate 63
Rehearsal dinner 62.6
Classic 62.5

Microsoft
created on 2022-02-25

text 99.1
clothing 94.1
person 94
man 90
table 83.8
woman 74

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 41.7%
Happy 28.5%
Sad 8.5%
Confused 6.7%
Surprised 6.3%
Angry 4%
Fear 2.8%
Disgusted 1.4%

AWS Rekognition

Age 25-35
Gender Female, 98.8%
Happy 99.4%
Surprised 0.3%
Confused 0.1%
Sad 0.1%
Calm 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 90.9%
Happy 1.9%
Disgusted 1.7%
Angry 1.3%
Sad 1.3%
Surprised 1.1%
Fear 1.1%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 85.8%
Happy 76.9%
Calm 19.9%
Sad 1%
Fear 0.6%
Disgusted 0.4%
Angry 0.4%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.1%
Happy 99.6%
Confused 0.1%
Calm 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 24-34
Gender Female, 99.6%
Surprised 63%
Fear 12.1%
Confused 8.8%
Happy 6.9%
Angry 3.8%
Disgusted 3.5%
Calm 1.1%
Sad 0.8%

AWS Rekognition

Age 22-30
Gender Male, 99.5%
Sad 70.2%
Angry 23.1%
Happy 2.8%
Calm 2.1%
Disgusted 1.2%
Fear 0.4%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 97.7%
Sad 99.5%
Calm 0.3%
Confused 0.1%
Angry 0%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 98.8%
Angry 85.3%
Happy 7.3%
Sad 2.5%
Disgusted 2%
Fear 1.1%
Surprised 0.9%
Confused 0.6%
Calm 0.3%

AWS Rekognition

Age 29-39
Gender Female, 86.7%
Sad 95.6%
Fear 1.7%
Angry 0.8%
Disgusted 0.8%
Calm 0.7%
Confused 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 13-21
Gender Male, 95.2%
Angry 37.8%
Sad 20.6%
Disgusted 20.1%
Calm 11.1%
Fear 3.9%
Surprised 3.2%
Confused 1.8%
Happy 1.5%

AWS Rekognition

Age 19-27
Gender Male, 85.9%
Sad 93.7%
Fear 4.5%
Confused 0.7%
Calm 0.5%
Disgusted 0.2%
Surprised 0.1%
Happy 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 93.7%
Chair 86.9%
Suit 81%

Captions

Microsoft

a group of people posing for a photo in front of a cake 70.7%
a group of people posing for a photo 70.6%
a group of people in front of a cake 70.5%

Text analysis

Amazon

DEC
64
too
/31

Google

DEC
64
lod
•
31
DEC • 64 lod 31