Human Generated Data

Title

Untitled (guests sitting at cocktail party)

Date

1950

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20027

Human Generated Data

Title

Untitled (guests sitting at cocktail party)

People

Artist: Peter James Studio, American

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.2
Human 99.2
Person 98.7
Person 98.5
Chair 97.5
Furniture 97.5
Dining Table 95.5
Table 95.5
Person 90.5
Person 85.7
Indoors 81.5
Dining Room 78
Room 78
Apparel 74.3
Clothing 74.3
People 69.9
Person 68.7
Flooring 66.6
Game 64.6
Interior Design 60.8
Portrait 60.2
Face 60.2
Photography 60.2
Photo 60.2
Chess 58.9
Tabletop 57.5
Accessory 55.9
Tie 55.9
Accessories 55.9

Imagga
created on 2022-03-05

man 37
businessman 34.4
male 34
brass 33.9
person 33.4
people 32.3
business 29.1
nurse 28.9
meeting 28.3
businesswoman 27.3
wind instrument 26.6
team 26
adult 24.7
men 24
table 23
group 22.6
office 21.9
businesspeople 21.8
room 21.6
colleagues 21.4
women 21.3
corporate 19.8
together 19.3
happy 18.8
executive 18.7
musical instrument 18.7
indoors 18.4
smiling 18.1
lifestyle 18.1
desk 17.3
professional 17.1
talking 17.1
work 16.9
teamwork 16.7
worker 16.5
job 15.9
sitting 15.5
home 15.2
patient 15.1
mature 14.9
laptop 14.8
hospital 14.4
interior 14.1
working 14.1
modern 14
suit 13.5
manager 13
cheerful 13
communication 12.6
couple 12.2
teacher 12
20s 11.9
discussing 11.8
discussion 11.7
portrait 11.6
30s 11.5
classroom 11.1
casual 11
chair 11
associates 10.8
life 10.7
40s 10.7
case 10.7
four 10.5
new 10.5
computer 10.5
successful 10.1
indoor 10
color 10
coworkers 9.8
conference 9.8
cooperation 9.7
education 9.5
ethnic 9.5
presentation 9.3
smile 9.3
holding 9.1
four people 8.9
medical 8.8
mid adult 8.7
happiness 8.6
boss 8.6
plan 8.5
sick person 8.5
two 8.5
ideas 8.4
company 8.4
clothing 8
success 8
boardroom 7.9
collaboration 7.9
explaining 7.9
two people 7.8
attractive 7.7
diversity 7.7
adults 7.6
togetherness 7.5
hall 7.5
doctor 7.5
senior 7.5
friendship 7.5
confident 7.3
handsome 7.1

Google
created on 2022-03-05

Window 87.5
Black-and-white 84.3
Style 83.8
Table 82.1
Chair 82.1
Monochrome 75.9
Curtain 75.5
Monochrome photography 72
Event 68.3
Vintage clothing 68.2
Room 68
Art 66.1
Sitting 65.9
Conversation 62.9
Suit 62.4
History 61.1
Classic 58.2
Coffee table 56.8
Font 53.6
Painting 53.4

Microsoft
created on 2022-03-05

person 96.1
table 94.8
clothing 77.3
furniture 68.7
man 64.1
text 64
vase 62.7
wedding 60.1
dining table 11.7

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 97.6%
Calm 94.3%
Surprised 2.5%
Sad 2.2%
Confused 0.5%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 93.8%
Surprised 81.9%
Calm 6.8%
Confused 3.2%
Sad 2.8%
Fear 2.3%
Happy 1.1%
Disgusted 1%
Angry 0.8%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Sad 48.3%
Calm 18%
Angry 14.7%
Happy 9.7%
Confused 6%
Disgusted 1.7%
Fear 1.1%
Surprised 0.6%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Happy 50.6%
Sad 35%
Surprised 5.9%
Angry 2.6%
Disgusted 1.9%
Fear 1.8%
Confused 1.6%
Calm 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Chair 97.5%
Tie 55.9%

Captions

Microsoft

a group of people standing in a room 97.8%
a group of people standing around a table 96.5%
a group of people in a room 96.4%

Text analysis

Amazon

KODVK
8
KODVK SVLETT
I
SVLETT

Google

FA2-
FA2-